-- Logs begin at Thu 2022-08-04 09:43:06 UTC, end at Thu 2022-08-04 11:07:55 UTC. -- Aug 04 10:23:38.152656 dv-cinder-852003-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 04 10:23:38.162517 dv-cinder-852003-1-iscsi devstack@n-api.service[103258]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 04 10:23:38.164823 dv-cinder-852003-1-iscsi devstack@n-api.service[103258]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Aug 4 10:23:38 2022] *** Aug 04 10:23:38.164823 dv-cinder-852003-1-iscsi devstack@n-api.service[103258]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 04 10:23:38.164823 dv-cinder-852003-1-iscsi devstack@n-api.service[103258]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 04 10:23:38.164823 dv-cinder-852003-1-iscsi devstack@n-api.service[103258]: nodename: dv-cinder-852003-1-iscsi Aug 04 10:23:38.164823 dv-cinder-852003-1-iscsi devstack@n-api.service[103258]: machine: x86_64 Aug 04 10:23:38.164823 dv-cinder-852003-1-iscsi devstack@n-api.service[103258]: clock source: unix Aug 04 10:23:38.164823 dv-cinder-852003-1-iscsi devstack@n-api.service[103258]: pcre jit disabled Aug 04 10:23:38.164823 dv-cinder-852003-1-iscsi devstack@n-api.service[103258]: detected number of CPU cores: 4 Aug 04 10:23:38.164823 dv-cinder-852003-1-iscsi devstack@n-api.service[103258]: current working directory: / Aug 04 10:23:38.164823 dv-cinder-852003-1-iscsi devstack@n-api.service[103258]: detected binary path: /usr/bin/uwsgi-core Aug 04 10:23:38.164823 dv-cinder-852003-1-iscsi devstack@n-api.service[103258]: your processes number limit is 47680 Aug 04 10:23:38.164823 dv-cinder-852003-1-iscsi devstack@n-api.service[103258]: your memory page size is 4096 bytes Aug 04 10:23:38.164823 dv-cinder-852003-1-iscsi devstack@n-api.service[103258]: detected max file descriptor number: 2048 Aug 04 10:23:38.164823 dv-cinder-852003-1-iscsi devstack@n-api.service[103258]: lock engine: pthread robust mutexes Aug 04 10:23:38.166215 dv-cinder-852003-1-iscsi devstack@n-api.service[103258]: thunder lock: enabled Aug 04 10:23:38.166215 dv-cinder-852003-1-iscsi devstack@n-api.service[103258]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 04 10:23:38.166215 dv-cinder-852003-1-iscsi devstack@n-api.service[103258]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 04 10:23:38.205457 dv-cinder-852003-1-iscsi devstack@n-api.service[103258]: Python main interpreter initialized at 0x562fffe049c0 Aug 04 10:23:38.205457 dv-cinder-852003-1-iscsi devstack@n-api.service[103258]: python threads support enabled Aug 04 10:23:38.205457 dv-cinder-852003-1-iscsi devstack@n-api.service[103258]: your server socket listen backlog is limited to 100 connections Aug 04 10:23:38.205457 dv-cinder-852003-1-iscsi devstack@n-api.service[103258]: your mercy for graceful operations on workers is 90 seconds Aug 04 10:23:38.205953 dv-cinder-852003-1-iscsi devstack@n-api.service[103258]: mapped 403077 bytes (393 KB) for 2 cores Aug 04 10:23:38.205953 dv-cinder-852003-1-iscsi devstack@n-api.service[103258]: *** Operational MODE: preforking *** Aug 04 10:23:38.206218 dv-cinder-852003-1-iscsi devstack@n-api.service[103258]: *** uWSGI is running in multiple interpreter mode *** Aug 04 10:23:38.206218 dv-cinder-852003-1-iscsi devstack@n-api.service[103258]: spawned uWSGI master process (pid: 103258) Aug 04 10:23:38.206461 dv-cinder-852003-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 04 10:23:38.208906 dv-cinder-852003-1-iscsi devstack@n-api.service[103258]: spawned uWSGI worker 1 (pid: 103259, cores: 1) Aug 04 10:23:38.208906 dv-cinder-852003-1-iscsi devstack@n-api.service[103258]: spawned uWSGI worker 2 (pid: 103260, cores: 1) Aug 04 10:23:38.208906 dv-cinder-852003-1-iscsi devstack@n-api.service[103258]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 04 10:23:38.909001 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 04 10:23:38.912046 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 04 10:23:40.047887 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 04 10:23:40.047887 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: from cryptography.utils import int_from_bytes Aug 04 10:23:40.048901 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 04 10:23:40.048901 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: from cryptography.utils import int_from_bytes Aug 04 10:23:40.073108 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 04 10:23:40.073108 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: from cryptography.utils import int_from_bytes Aug 04 10:23:40.073828 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 04 10:23:40.073828 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: from cryptography.utils import int_from_bytes Aug 04 10:23:42.701929 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 04 10:23:42.702635 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 04 10:23:42.702716 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 04 10:23:42.703142 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 04 10:23:42.703334 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 04 10:23:42.703707 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.704064 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.704383 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.704706 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.705035 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.705343 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.705666 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.705986 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.706311 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.706538 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.706873 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.707197 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852003-1-iscsi {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.707537 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.707858 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.708188 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.708497 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.708811 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.709132 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.709683 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.709915 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.711401 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.711401 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.711401 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.711401 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.712410 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.712410 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.712410 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.713021 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.713021 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.713446 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.713671 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852003-1-iscsi {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.713966 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.714261 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.714577 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.715011 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.715294 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.715624 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.716001 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.716393 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.716704 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.717041 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.717344 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.717718 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.718068 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.718371 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.718675 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.718986 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.719330 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.719633 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.719936 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.720197 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.720515 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.720818 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.721137 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.721458 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.721710 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.721959 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.722276 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.722593 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.722921 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.723293 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.723601 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.723910 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.724256 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.724573 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.724870 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.725181 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.725499 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.725816 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.726138 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.726452 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.726771 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.727169 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.121 {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.727420 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.121 {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.727731 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.728090 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.728409 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.728719 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.729031 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.729351 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.729659 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.729963 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.730269 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.730587 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.730921 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.731226 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.731476 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.731773 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.732102 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.732563 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.733123 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.733670 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.734221 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.734764 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.735237 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.735549 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.735859 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.736193 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.736860 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.737167 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.737476 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.737789 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.738089 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.738403 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.738764 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.739052 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.739359 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.739666 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.739990 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.740310 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.740615 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.740922 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.741241 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.741548 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.741852 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.742166 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.742476 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.742779 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.743096 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.743396 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.743702 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.744040 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.744350 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.744656 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.744958 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.745260 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.745561 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.745865 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.746166 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.746473 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.746771 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.747088 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.747407 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.747714 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.748127 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.748435 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.748753 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.749088 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.749417 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.749759 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.750072 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.750408 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.750819 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.751217 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.751533 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.751848 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.752202 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.752518 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.752834 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.753147 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.753466 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.753787 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.754115 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.754583 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.755146 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.755717 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.756300 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.756656 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.756990 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.757316 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.757630 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.757981 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.758323 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.758639 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.758964 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.759288 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.759601 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.759915 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.760253 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.760577 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.760920 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.761233 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.761551 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.761862 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.762176 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.762488 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.762865 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.763209 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.763548 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.763866 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.764210 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.764524 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.764843 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.765156 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.765468 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.765779 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.766083 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.766393 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.766697 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.767006 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.767308 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.767629 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.767972 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.768282 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.768610 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.768918 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.769229 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.769537 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.769873 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.770178 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.770489 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.770802 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.771110 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.771435 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.771747 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.772077 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.772402 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.772708 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.773014 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.773330 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.773642 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.773954 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.774267 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.774578 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.774898 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.775212 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.775525 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.775862 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.776224 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.776537 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.776860 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.777186 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.777503 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.777807 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.778118 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.778422 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.778725 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.779028 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.779336 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.779635 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.779938 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.780352 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.780658 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.780962 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.781285 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.781595 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.781902 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.782206 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.782511 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.782855 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.783159 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.783500 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.783834 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.784180 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.784508 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.784820 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.785136 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.785491 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.785810 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.786121 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.786438 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.786762 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.787072 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.787390 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.787701 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.788045 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.788358 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.788679 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.788982 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.789295 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.789672 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.790269 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.790617 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.790942 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.791294 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.791575 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.791886 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.792239 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.792547 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.792858 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.793177 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.793486 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.793802 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.794110 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.794498 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.794740 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.795056 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.795359 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.795671 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.796019 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.796358 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.796669 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.796981 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.797300 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.797609 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.797918 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.798291 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.798590 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 04 10:23:42.799109 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.799281 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 04 10:23:42.799437 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.799437 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.799720 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.799863 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 04 10:23:42.800036 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.800185 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.800406 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 04 10:23:42.800561 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.800781 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.800930 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 04 10:23:42.801137 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.801426 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.801611 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.801757 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.802023 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.802183 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.802327 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.802640 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.802889 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.803055 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.803311 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.803463 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.803607 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.803895 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.804101 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.804261 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.804403 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.804569 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.804807 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.804967 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.805119 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.805337 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.805503 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.805657 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.805979 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.806191 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.806383 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.806531 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.806687 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.806921 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.807148 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.807310 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.807508 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.807673 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852003-1-iscsi {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.807829 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.808159 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.808397 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.808557 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.808725 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.808872 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.809038 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.809300 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.809535 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.809705 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.809855 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.810000 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.810254 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.810481 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.810643 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.810840 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.810994 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.811153 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.811696 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.811926 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.812134 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.812281 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.812471 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.812645 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.813040 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.813195 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.813375 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.813604 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.813810 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.814003 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.814199 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.814352 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.814629 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.814807 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.815039 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.815279 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.815447 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.815601 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.815856 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.816075 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.816232 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.816457 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.816618 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.816955 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.817118 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.817469 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.817635 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.817925 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.818096 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.818497 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852003-1-iscsi {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.818666 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.818954 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.819122 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.819402 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.819560 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.819852 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.820059 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.820472 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.820655 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.820926 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.821086 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.821376 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.821570 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.821818 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.822140 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.822302 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.822684 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.822854 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.823166 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.823324 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.823625 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.823786 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.824112 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.824277 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.824621 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.824790 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.824988 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.825244 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.825406 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.825727 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.825898 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.826277 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.826439 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.826705 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.826895 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.827127 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.827440 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.827617 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.827909 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.828271 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.828430 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.828583 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.828830 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.829013 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.829285 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.829449 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.829638 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.829864 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.830038 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.830416 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.830584 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.830869 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.831030 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.831306 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.831558 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.831730 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.832197 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.832371 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.832663 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.832822 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.833084 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.833242 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.833519 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.833677 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.833951 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.834197 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.834387 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.834547 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.834834 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.835048 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.835331 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.835641 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.835793 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.836226 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.836392 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.836584 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.836726 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.837231 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.121 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.837398 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.837582 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.121 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.837900 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.838059 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.838273 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.838465 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.838820 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.838958 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.839260 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.839437 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.839721 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.839820 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.840187 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.840284 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.840670 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.840778 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.841109 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.841268 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.841544 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.841809 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.841989 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.842374 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.842489 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.842872 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.842965 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.843225 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.843447 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.843653 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.843841 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.844107 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.844211 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.844543 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.844745 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.844976 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.845290 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.845392 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.845803 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.845891 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.846227 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.846418 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.846662 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.846783 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.847092 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.847195 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.847523 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.847622 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.848037 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.848203 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.848479 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.848590 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.848908 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.849033 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.849354 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.849487 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.849777 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.849953 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.850203 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.850464 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.850649 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.851017 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.851107 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.851475 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.851574 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.851910 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.852026 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.852367 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.852488 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.852802 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.852907 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.853255 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.853344 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.853696 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.853831 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.854131 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.854324 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.854573 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.854714 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.855008 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.855153 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.855436 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.855682 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.855880 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.856068 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.856343 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.856587 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.856781 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.857007 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.857236 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.857548 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.857698 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.858065 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.858226 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.858517 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.858693 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.858946 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.859199 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.859372 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.859639 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.859784 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.860243 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.860387 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.860677 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.860823 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.861100 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.861245 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.861880 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.862128 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.862354 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.862524 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.862726 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.863046 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.863185 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.863646 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.863792 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.864119 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.864279 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.864561 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.864794 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.864991 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.865331 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.865495 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:23:42.865712 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.865889 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.866282 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.866373 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.866804 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.866905 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.867222 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.867326 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.867676 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.867817 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.868151 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.868467 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.868588 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.869023 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.869110 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.869461 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.869637 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.869908 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.870235 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.870347 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.870781 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.870878 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.871210 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.871358 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.871649 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.871972 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.872107 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.872542 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.872664 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.872993 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.873095 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.873441 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.873673 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.873883 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.874259 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.874365 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.874743 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.874845 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.875194 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.875411 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.875659 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.875829 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.876119 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.876453 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.876593 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.877012 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.877106 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.877485 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.877574 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.877938 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.878089 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.878389 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.878667 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.878812 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.879294 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.879382 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.879735 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.879838 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.880227 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.880319 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.880700 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.880882 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.881140 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.881404 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.881579 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.882010 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.882173 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.882439 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.882770 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.882874 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.883323 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.883420 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.883789 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.883885 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.884319 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.884494 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.884795 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.885074 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.885266 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.885665 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.885765 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.886190 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.886279 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.886663 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.886818 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.887131 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.887514 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.887611 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.888068 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.888167 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.888525 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.888639 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.888978 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.889207 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.889442 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.889773 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.889897 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.890240 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.890393 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.890704 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.890843 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.891288 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.891384 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.891782 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.891881 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.892264 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.892406 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.892798 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.892969 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.893182 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.893567 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.893679 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.894055 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.894217 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.894516 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.894684 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.895014 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.895256 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.895475 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.895836 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.895987 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.896431 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.896530 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.896892 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.897199 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.897381 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.897698 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.897839 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.898270 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.898361 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.898750 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.898854 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.899200 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.899369 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.899655 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.900005 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.900122 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.900441 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.900560 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.901026 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.901116 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.901482 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.901610 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.901933 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.902230 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.902410 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.902818 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.902970 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.903315 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.903452 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.903777 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.904012 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.904283 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.904582 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.904730 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.905167 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.905290 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.905605 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.905765 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.906027 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.906231 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.906463 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.906895 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.907212 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.907318 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.907759 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.907901 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.908338 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.908511 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.908780 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.909077 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.909212 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.909637 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.909791 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.910094 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.910290 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.910606 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.910783 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.911042 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.911201 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.911477 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.911745 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.911917 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.912340 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.912504 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.912859 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.913079 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.913366 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.913477 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.913860 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.914002 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.914332 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.914605 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.914758 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.915187 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.915346 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.915689 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.915826 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.916157 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.916295 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.916609 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.916864 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.917041 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.917450 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.917588 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.917908 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.918130 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.918378 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.918533 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.918806 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.918957 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.919251 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.919541 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.919688 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.920159 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.920317 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.920609 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.920757 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.921040 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.921300 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.921485 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.921848 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.921950 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.922166 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.922415 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.922642 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.922857 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.922982 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.923311 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.923519 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.923750 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.923863 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.924226 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.924415 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.924686 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.924959 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.925120 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.925535 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.925643 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.925987 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.926110 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.926479 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.926711 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.926908 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.927228 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.927369 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.927808 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.928040 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.928314 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.928412 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.928762 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.928986 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.929224 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.929475 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.929664 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.929939 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.930128 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.930432 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.930605 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.930824 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.931083 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.931173 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.931444 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.931532 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.931762 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.931981 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.932100 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.932417 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.932521 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.932724 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.932876 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.933052 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.933327 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.933416 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.933677 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.933799 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.933997 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.934204 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.934294 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.934600 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.934684 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.934909 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.935077 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.935258 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.935531 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.935679 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.936014 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.936121 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.936450 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.936547 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.936891 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.936980 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.937339 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.937554 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.937777 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.938152 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.938262 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.938634 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.938740 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.939085 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.939175 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.939545 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.939634 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.940008 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.940179 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.940451 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.940779 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.940887 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.941306 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.941438 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.941816 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.941921 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.942268 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.942416 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.942714 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.942991 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.943154 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.943592 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.943679 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.944025 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.944159 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.944354 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.944543 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.944670 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.944990 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.945080 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.945359 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.945507 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.945683 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.945871 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.946021 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.946307 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.946446 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.946618 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.946768 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.946949 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.947215 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.947306 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.947557 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.947660 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.947881 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.948119 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.948248 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.948569 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.948669 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.948886 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.949017 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.949201 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.949459 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.949549 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.949860 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.949952 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.950179 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.950330 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.950486 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.950778 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.950879 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.951101 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.951228 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.951417 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.951686 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.951788 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.952048 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.952163 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.952365 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.952612 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.952709 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.952977 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.953067 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.953288 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.953474 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.953601 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.953915 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.954015 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.954240 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.954352 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.954571 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.954891 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.955162 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.955257 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.955502 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.955638 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.955817 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.956110 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.956398 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.956566 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.956719 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.957019 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.957107 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.957428 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.957550 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.957758 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.958032 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.958138 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.958390 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.958508 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.958712 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.958995 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.959095 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.959313 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.959441 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.959626 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.959889 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.960015 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.960255 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.960343 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.960579 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.960777 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.960896 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.961194 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.961293 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.961501 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.961643 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.961810 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.962054 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.962342 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.962486 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.962699 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.962928 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.963020 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.963314 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.963404 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.963637 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.963784 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.963970 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.964313 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.964434 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.964591 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.964695 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.964895 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.965116 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.965215 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.965499 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.965587 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.965809 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.965985 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.966154 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.966427 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.966536 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.966802 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.966893 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.967113 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.967310 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.967401 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.967715 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.967816 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.968152 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.968260 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.968491 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.968604 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.968788 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.969075 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.969174 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.969382 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.969519 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.969693 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.969997 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.970095 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.970299 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.970471 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.970602 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.970905 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.971091 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.971218 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.971391 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.971519 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.971831 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.971975 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.972156 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.972320 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.972465 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.972758 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.972891 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.973106 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.973263 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.973405 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.973642 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.973732 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.974002 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.974089 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.974366 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.974529 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.974686 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.974922 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.975023 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.975300 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.975390 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.975609 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.975806 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.975904 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.976281 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.976390 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.976597 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.976723 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.977147 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.977289 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.977483 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.977587 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.977801 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.977992 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.978137 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.978442 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.978534 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.978767 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.978885 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.979074 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.979317 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.979415 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.979690 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.979786 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.980035 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.980201 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.980349 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.980639 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.980746 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.980961 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.981078 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.981267 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.981498 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.981595 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.981878 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.981980 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.982182 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.982367 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.982490 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.982798 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.982915 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.983108 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.983242 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.983414 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.983683 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.983788 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.984040 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.984164 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.984356 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.984620 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.984722 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.985006 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.985097 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.985328 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.985504 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.985638 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.985946 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.986047 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.986257 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.986386 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.986928 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.987177 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.987347 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.987530 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.987676 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.987833 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.988053 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.988184 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.988486 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.988591 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.988853 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.988997 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.989289 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.989460 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.989601 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.989916 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.990008 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.990236 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.990333 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.990552 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.990756 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.990868 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.991188 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.991294 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.991491 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.991615 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.991812 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.992073 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.992170 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.992463 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.992558 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.992800 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.992928 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.993130 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.993366 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.993457 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.993745 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.993843 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.994058 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.994212 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.994359 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.994650 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.994854 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.994982 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.995107 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.995269 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.995545 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.995645 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.995860 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.996002 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.996199 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.996435 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.996530 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.996796 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.996901 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.997252 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.997379 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.997493 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.997765 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.997871 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.998089 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.998273 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.998392 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.998697 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.998840 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.999001 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.999158 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.999317 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.999612 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.999705 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:42.999918 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.000093 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.000247 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.000514 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.000606 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.000841 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.000960 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.001146 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.001393 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.001541 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.001764 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.001854 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.002095 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.002275 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.002410 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.002729 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.002828 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.003040 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.003175 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.003359 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.003612 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.003701 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.004009 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.004163 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.004436 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.004579 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.004765 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.005038 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.005141 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.005390 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.005566 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.005700 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.005947 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.006039 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.006296 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.006413 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.006603 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.006850 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.006942 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.007216 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.007351 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.007535 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.007730 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.007860 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.008191 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.008303 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.008516 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.008661 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.008834 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.009114 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.009227 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.009464 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.009595 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.009768 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.009977 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.010095 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.010406 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.010494 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.010715 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.010846 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.011022 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.011287 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.011387 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.011631 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.011761 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.011994 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.012175 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.012325 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.012565 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.012654 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.012881 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.013034 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.013195 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.013501 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.013606 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.013834 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.013934 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.014151 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.014354 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.014510 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.014785 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.014982 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.015124 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.015225 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.015437 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.015627 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.015786 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.016096 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.016192 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.016460 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.016723 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.016824 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.017066 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.017164 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.017310 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 04 10:23:43.017616 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.018044 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.018494 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.018941 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.019407 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.019928 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.020405 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.021013 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.021467 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.021919 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.022357 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.022794 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.023235 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.023677 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.024162 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.024599 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.025058 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.025464 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.025917 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.026358 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.026818 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.027411 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.027860 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.028331 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.028926 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.029368 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.029816 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.030278 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.030746 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.031213 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.031666 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.032170 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.032631 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.033109 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.033593 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.034041 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.034502 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.034935 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.035540 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.035890 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.036375 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.036840 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.037438 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.037898 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.038346 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.038801 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.039266 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.039704 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.040167 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.040607 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.041040 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.041476 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.041935 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.042371 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.042808 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.043260 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.043698 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.044164 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.044607 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.045068 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.045511 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.045980 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.046438 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.046898 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.047358 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.047797 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.048293 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.048739 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.049173 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.049610 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.050052 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.050550 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.050985 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.051521 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.052034 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.052516 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.052956 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.053437 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.053902 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.054354 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.054811 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.055275 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.055710 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.056171 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.056622 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.057071 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.057512 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.057953 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.058404 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.058849 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.059293 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.059729 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.060213 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.060646 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.061112 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.061546 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.061987 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.062441 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.062876 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.063371 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.063808 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.064307 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.064747 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.065216 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.065679 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.066133 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.066599 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.067099 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.067560 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.068042 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.068506 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.068957 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.069420 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.069882 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.070349 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.071181 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.071660 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.072145 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.072599 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.073049 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.073505 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.073956 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.074408 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.074850 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.075298 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.075747 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.076256 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.076728 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.077195 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.077672 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.078128 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.078573 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.079015 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.079468 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.080018 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.080477 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.080916 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.081364 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.081819 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.082369 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.082806 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.083272 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.083730 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.084211 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.084673 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.085124 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.085578 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.086030 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.086505 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.086992 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.087455 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.087907 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.088388 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.088856 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.089699 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.090166 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.090656 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.091117 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.091580 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.092063 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.092522 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.092993 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.093433 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.093869 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.094329 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.094779 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.095219 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.095685 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.096174 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.096615 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.097073 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.097520 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.098404 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.098911 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.099372 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.099835 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.100337 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.100796 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.101249 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.101721 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.102170 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.102609 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.103063 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.103511 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.103982 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.104408 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.104863 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.105308 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.105748 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.106187 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.106631 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.107108 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.107553 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.108022 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.108469 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.108917 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.109345 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.109777 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.110211 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.110646 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.111084 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.111870 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.112352 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.112783 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.113229 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.113744 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.114187 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.114630 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.115098 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.115535 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.116078 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.116550 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.117007 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.117471 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.117924 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.118373 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.118882 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.119342 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.120227 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.120723 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.121193 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.121679 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.122158 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.122601 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.123050 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.123488 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.124015 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.124430 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.124883 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.125334 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.125780 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.126226 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.126671 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.127122 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.127573 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.128053 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.128504 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.128952 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.129443 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.129887 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.130328 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.130788 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.131302 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.131766 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.132254 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.132712 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.133182 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.133676 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.134122 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.134556 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.135003 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.135451 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.135923 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.136409 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.136849 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.137459 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.137916 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.138387 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.138846 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.139295 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.139768 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.140278 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.140762 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.140979 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.141294 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.141626 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.141974 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.142300 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.142625 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.142933 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.143242 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.143545 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.143853 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.144202 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.144510 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.144928 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.145190 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.145500 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.145805 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.146109 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.146411 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.146725 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.147014 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.147335 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.147742 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.147918 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.148243 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.148541 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.148839 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.149143 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.149445 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.149745 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.150043 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.150342 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.150636 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.150969 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.151297 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.151611 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.151928 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.152258 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.152574 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.152881 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.153201 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.153516 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.153834 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.154137 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.154464 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.154875 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.155187 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.155495 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.155796 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.156126 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.156436 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.156765 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.157087 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.157386 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.157705 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.158018 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.158375 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.158688 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.158998 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.159319 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.159626 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.159937 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.160265 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.160613 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.160924 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.161235 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.161543 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.161848 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.162160 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.162472 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.162793 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.163121 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.163426 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.163747 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.164099 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.164448 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.164760 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.165108 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.165435 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.165747 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.166058 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.166359 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:23:43.166600 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 04 10:23:43.173167 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: INFO dbcounter [None req-294981c5-cf3d-4ebb-ae8f-2387494faa77 None None] Registered counter for database nova_api Aug 04 10:23:43.199597 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG oslo_db.sqlalchemy.engines [None req-294981c5-cf3d-4ebb-ae8f-2387494faa77 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103259) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 10:23:43.205247 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG dbcounter [-] [103259] Writer thread running {{(pid=103259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 10:23:43.264345 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.context [None req-294981c5-cf3d-4ebb-ae8f-2387494faa77 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e4c5daf7-b6c6-4192-b3cd-ab91ed13477f(cell1) {{(pid=103259) load_cells /opt/stack/nova/nova/context.py:464}} Aug 04 10:23:43.268796 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG oslo_concurrency.lockutils [None req-294981c5-cf3d-4ebb-ae8f-2387494faa77 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:23:43.270544 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG oslo_concurrency.lockutils [None req-294981c5-cf3d-4ebb-ae8f-2387494faa77 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:23:43.271454 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG oslo_concurrency.lockutils [None req-294981c5-cf3d-4ebb-ae8f-2387494faa77 None None] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:23:43.273631 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG oslo_concurrency.lockutils [None req-294981c5-cf3d-4ebb-ae8f-2387494faa77 None None] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103259) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:23:43.275936 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: INFO dbcounter [None req-294981c5-cf3d-4ebb-ae8f-2387494faa77 None None] Registered counter for database nova_cell0 Aug 04 10:23:43.282649 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: INFO dbcounter [None req-294981c5-cf3d-4ebb-ae8f-2387494faa77 None None] Registered counter for database nova_cell1 Aug 04 10:23:43.291892 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG oslo_db.sqlalchemy.engines [None req-294981c5-cf3d-4ebb-ae8f-2387494faa77 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103259) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 10:23:43.295739 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG oslo_db.sqlalchemy.engines [None req-294981c5-cf3d-4ebb-ae8f-2387494faa77 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103259) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 10:23:43.299146 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG dbcounter [-] [103259] Writer thread running {{(pid=103259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 10:23:43.327627 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: INFO dbcounter [None req-6aff745b-8c04-47f7-bf59-808797bf86a7 None None] Registered counter for database nova_api Aug 04 10:23:43.349394 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG oslo_db.sqlalchemy.engines [None req-6aff745b-8c04-47f7-bf59-808797bf86a7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103260) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 10:23:43.356824 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG dbcounter [-] [103260] Writer thread running {{(pid=103260) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 10:23:43.414545 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.context [None req-6aff745b-8c04-47f7-bf59-808797bf86a7 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e4c5daf7-b6c6-4192-b3cd-ab91ed13477f(cell1) {{(pid=103260) load_cells /opt/stack/nova/nova/context.py:464}} Aug 04 10:23:43.418605 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG oslo_concurrency.lockutils [None req-6aff745b-8c04-47f7-bf59-808797bf86a7 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:23:43.420195 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG oslo_concurrency.lockutils [None req-6aff745b-8c04-47f7-bf59-808797bf86a7 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:23:43.421152 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG oslo_concurrency.lockutils [None req-6aff745b-8c04-47f7-bf59-808797bf86a7 None None] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:23:43.423171 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG oslo_concurrency.lockutils [None req-6aff745b-8c04-47f7-bf59-808797bf86a7 None None] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:23:43.425232 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: INFO dbcounter [None req-6aff745b-8c04-47f7-bf59-808797bf86a7 None None] Registered counter for database nova_cell0 Aug 04 10:23:43.430808 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: INFO dbcounter [None req-6aff745b-8c04-47f7-bf59-808797bf86a7 None None] Registered counter for database nova_cell1 Aug 04 10:23:43.438584 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG oslo_db.sqlalchemy.engines [None req-6aff745b-8c04-47f7-bf59-808797bf86a7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103260) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 10:23:43.441601 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG oslo_db.sqlalchemy.engines [None req-6aff745b-8c04-47f7-bf59-808797bf86a7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103260) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 10:23:43.442671 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG dbcounter [-] [103259] Writer thread running {{(pid=103259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 10:23:43.445747 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG dbcounter [-] [103260] Writer thread running {{(pid=103260) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 10:23:43.453405 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: INFO dbcounter [None req-294981c5-cf3d-4ebb-ae8f-2387494faa77 None None] Registered counter for database nova_cell0 Aug 04 10:23:43.465312 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG oslo_db.sqlalchemy.engines [None req-294981c5-cf3d-4ebb-ae8f-2387494faa77 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103259) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 10:23:43.473468 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG dbcounter [-] [103259] Writer thread running {{(pid=103259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 10:23:43.588810 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG dbcounter [-] [103260] Writer thread running {{(pid=103260) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 10:23:43.599578 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: INFO dbcounter [None req-6aff745b-8c04-47f7-bf59-808797bf86a7 None None] Registered counter for database nova_cell0 Aug 04 10:23:43.610883 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG oslo_db.sqlalchemy.engines [None req-6aff745b-8c04-47f7-bf59-808797bf86a7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103260) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 10:23:43.622424 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG dbcounter [-] [103260] Writer thread running {{(pid=103260) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 10:23:43.955248 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: WARNING keystonemiddleware.auth_token [None req-6aff745b-8c04-47f7-bf59-808797bf86a7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 04 10:23:43.962665 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: WARNING keystonemiddleware.auth_token [None req-6aff745b-8c04-47f7-bf59-808797bf86a7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 04 10:23:44.065758 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: WARNING keystonemiddleware.auth_token [None req-294981c5-cf3d-4ebb-ae8f-2387494faa77 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 04 10:23:44.077974 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: WARNING keystonemiddleware.auth_token [None req-294981c5-cf3d-4ebb-ae8f-2387494faa77 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 04 10:23:44.315304 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: WARNING keystonemiddleware.auth_token [None req-6aff745b-8c04-47f7-bf59-808797bf86a7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 04 10:23:44.321865 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: WARNING keystonemiddleware.auth_token [None req-6aff745b-8c04-47f7-bf59-808797bf86a7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 04 10:23:44.327311 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x562fffe049c0 pid: 103260 (default app) Aug 04 10:23:44.329635 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi [None req-6aff745b-8c04-47f7-bf59-808797bf86a7 None None] Calling method '>' {{(pid=103260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:23:44.330901 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: INFO nova.api.openstack.requestlog [None req-6aff745b-8c04-47f7-bf59-808797bf86a7 None None] 10.222.0.121 "GET /compute/v2.1/" status: 200 len: 389 microversion: 2.1 time: 0.001966 Aug 04 10:23:44.331344 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: [pid: 103260|app: 0|req: 1/1] 10.222.0.121 () {50 vars in 793 bytes} [Thu Aug 4 10:23:44 2022] GET /compute/v2.1/ => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:23:44.510283 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: WARNING keystonemiddleware.auth_token [None req-294981c5-cf3d-4ebb-ae8f-2387494faa77 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 04 10:23:44.516740 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: WARNING keystonemiddleware.auth_token [None req-294981c5-cf3d-4ebb-ae8f-2387494faa77 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 04 10:23:44.522296 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x562fffe049c0 pid: 103259 (default app) Aug 04 10:25:07.516748 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi [None req-6aff745b-8c04-47f7-bf59-808797bf86a7 None None] Calling method '>' {{(pid=103260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:25:07.518571 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: INFO nova.api.openstack.requestlog [None req-6aff745b-8c04-47f7-bf59-808797bf86a7 None None] 10.222.0.121 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.002376 Aug 04 10:25:07.524071 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: [pid: 103260|app: 0|req: 2/2] 10.222.0.121 () {54 vars in 936 bytes} [Thu Aug 4 10:25:07 2022] GET /compute/v2.1 => generated 389 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:25:07.538411 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG dbcounter [-] [103259] Writing DB stats nova_api:SELECT=3 {{(pid=103259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:25:07.540488 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG dbcounter [-] [103259] Writing DB stats nova_cell0:SELECT=3 {{(pid=103259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:25:07.542412 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG dbcounter [-] [103259] Writing DB stats nova_cell1:SELECT=3 {{(pid=103259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:25:07.544545 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG dbcounter [-] [103259] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:25:08.449192 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi [None req-a1513bcb-9df0-4367-87a7-7e75851af7db admin admin] Calling method '>' {{(pid=103259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:25:08.482806 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: INFO nova.api.openstack.requestlog [None req-a1513bcb-9df0-4367-87a7-7e75851af7db admin admin] 10.222.0.121 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.954932 Aug 04 10:25:08.493478 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: [pid: 103259|app: 0|req: 1/3] 10.222.0.121 () {60 vars in 1297 bytes} [Thu Aug 4 10:25:07 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:25:10.766291 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi [None req-6aff745b-8c04-47f7-bf59-808797bf86a7 None None] Calling method '>' {{(pid=103260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:25:10.767318 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: INFO nova.api.openstack.requestlog [None req-6aff745b-8c04-47f7-bf59-808797bf86a7 None None] 10.222.0.121 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001485 Aug 04 10:25:10.767916 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: [pid: 103260|app: 0|req: 3/4] 10.222.0.121 () {54 vars in 936 bytes} [Thu Aug 4 10:25:10 2022] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:25:11.272053 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi [None req-c58ea299-1347-4e3b-864d-f6e93a362d7a admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "ram": 256, "rxtx_factor": 1.0, "id": "c1", "disk": 1, "os-flavor-access:is_public": true, "name": "cirros256", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0}} {{(pid=103259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:25:11.293762 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 10:25:11.293762 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: warnings.warn(msg) Aug 04 10:25:11.322996 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: INFO nova.api.openstack.requestlog [None req-c58ea299-1347-4e3b-864d-f6e93a362d7a admin admin] 10.222.0.121 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.61 time: 0.548263 Aug 04 10:25:11.328443 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: [pid: 103259|app: 0|req: 2/5] 10.222.0.121 () {64 vars in 1288 bytes} [Thu Aug 4 10:25:10 2022] POST /compute/v2.1/flavors => generated 409 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 04 10:25:11.338369 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG dbcounter [-] [103260] Writing DB stats nova_api:SELECT=3 {{(pid=103260) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:25:11.339720 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG dbcounter [-] [103260] Writing DB stats nova_cell0:SELECT=3 {{(pid=103260) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:25:11.340845 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG dbcounter [-] [103260] Writing DB stats nova_cell1:SELECT=3 {{(pid=103260) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:25:11.341710 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG dbcounter [-] [103260] Writing DB stats nova_cell0:SELECT=3 {{(pid=103260) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:25:11.545173 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi [None req-60cdb312-62be-47ee-b228-43bea3754403 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:25:11.549625 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 10:25:11.549625 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: warnings.warn(msg) Aug 04 10:25:11.619635 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: INFO nova.api.openstack.requestlog [None req-60cdb312-62be-47ee-b228-43bea3754403 admin admin] 10.222.0.121 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.287158 Aug 04 10:25:11.620285 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: [pid: 103260|app: 0|req: 4/6] 10.222.0.121 () {64 vars in 1341 bytes} [Thu Aug 4 10:25:11 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 10:25:13.896806 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi [None req-c58ea299-1347-4e3b-864d-f6e93a362d7a admin admin] Calling method '>' {{(pid=103259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:25:13.898559 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: INFO nova.api.openstack.requestlog [None req-c58ea299-1347-4e3b-864d-f6e93a362d7a admin admin] 10.222.0.121 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.002343 Aug 04 10:25:13.900489 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: [pid: 103259|app: 0|req: 3/7] 10.222.0.121 () {54 vars in 936 bytes} [Thu Aug 4 10:25:13 2022] GET /compute/v2.1 => generated 389 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:25:14.623442 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi [None req-7e92077d-058e-4c05-9f9f-d39d96d5259d admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "id": "d1", "disk": 5, "vcpus": 1, "ram": 512, "swap": 0, "name": "ds512M", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true}} {{(pid=103260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:25:14.642188 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 10:25:14.642188 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: warnings.warn(msg) Aug 04 10:25:14.664186 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: INFO nova.api.openstack.requestlog [None req-7e92077d-058e-4c05-9f9f-d39d96d5259d admin admin] 10.222.0.121 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.757181 Aug 04 10:25:14.665180 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: [pid: 103260|app: 0|req: 5/8] 10.222.0.121 () {64 vars in 1288 bytes} [Thu Aug 4 10:25:13 2022] POST /compute/v2.1/flavors => generated 406 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 04 10:25:14.677236 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi [None req-73516cba-b619-47c4-bee3-83ba626e865c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:25:14.680422 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 10:25:14.680422 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: warnings.warn(msg) Aug 04 10:25:14.714461 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: INFO nova.api.openstack.requestlog [None req-73516cba-b619-47c4-bee3-83ba626e865c admin admin] 10.222.0.121 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.040962 Aug 04 10:25:14.715046 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: [pid: 103259|app: 0|req: 4/9] 10.222.0.121 () {64 vars in 1341 bytes} [Thu Aug 4 10:25:14 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:25:16.982669 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi [None req-7e92077d-058e-4c05-9f9f-d39d96d5259d admin admin] Calling method '>' {{(pid=103260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:25:16.983667 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: INFO nova.api.openstack.requestlog [None req-7e92077d-058e-4c05-9f9f-d39d96d5259d admin admin] 10.222.0.121 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001458 Aug 04 10:25:16.984314 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: [pid: 103260|app: 0|req: 6/10] 10.222.0.121 () {54 vars in 936 bytes} [Thu Aug 4 10:25:16 2022] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:25:17.462762 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi [None req-c2a511d9-65b9-4388-ab14-97c2eb9c1d03 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d2", "ram": 1024, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "name": "ds1G", "os-flavor-access:is_public": true, "disk": 10, "vcpus": 1}} {{(pid=103259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:25:17.483755 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: INFO nova.api.openstack.requestlog [None req-c2a511d9-65b9-4388-ab14-97c2eb9c1d03 admin admin] 10.222.0.121 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.491980 Aug 04 10:25:17.484632 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: [pid: 103259|app: 0|req: 5/11] 10.222.0.121 () {64 vars in 1288 bytes} [Thu Aug 4 10:25:16 2022] POST /compute/v2.1/flavors => generated 406 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 04 10:25:17.497067 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi [None req-a6d8422d-f3dd-460d-8a76-7c6c8725970e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:25:17.523593 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: INFO nova.api.openstack.requestlog [None req-a6d8422d-f3dd-460d-8a76-7c6c8725970e admin admin] 10.222.0.121 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030416 Aug 04 10:25:17.524328 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: [pid: 103260|app: 0|req: 7/12] 10.222.0.121 () {64 vars in 1341 bytes} [Thu Aug 4 10:25:17 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 10:25:19.787047 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi [None req-c2a511d9-65b9-4388-ab14-97c2eb9c1d03 admin admin] Calling method '>' {{(pid=103259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:25:19.788122 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: INFO nova.api.openstack.requestlog [None req-c2a511d9-65b9-4388-ab14-97c2eb9c1d03 admin admin] 10.222.0.121 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001536 Aug 04 10:25:19.788531 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: [pid: 103259|app: 0|req: 6/13] 10.222.0.121 () {54 vars in 936 bytes} [Thu Aug 4 10:25:19 2022] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:25:20.239614 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi [None req-86496c19-ba14-4d1f-b595-52a23eaf8af3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "name": "ds2G", "disk": 10, "id": "d3", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "swap": 0, "vcpus": 2}} {{(pid=103260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:25:20.260204 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: INFO nova.api.openstack.requestlog [None req-86496c19-ba14-4d1f-b595-52a23eaf8af3 admin admin] 10.222.0.121 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.465540 Aug 04 10:25:20.260767 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: [pid: 103260|app: 0|req: 8/14] 10.222.0.121 () {64 vars in 1288 bytes} [Thu Aug 4 10:25:19 2022] POST /compute/v2.1/flavors => generated 406 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 10:25:20.272973 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi [None req-c9ed9cf5-4fcf-451a-bb64-55fb8145f554 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:25:20.298874 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: INFO nova.api.openstack.requestlog [None req-c9ed9cf5-4fcf-451a-bb64-55fb8145f554 admin admin] 10.222.0.121 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029687 Aug 04 10:25:20.299753 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: [pid: 103259|app: 0|req: 7/15] 10.222.0.121 () {64 vars in 1341 bytes} [Thu Aug 4 10:25:20 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:25:22.596747 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi [None req-86496c19-ba14-4d1f-b595-52a23eaf8af3 admin admin] Calling method '>' {{(pid=103260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:25:22.597777 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: INFO nova.api.openstack.requestlog [None req-86496c19-ba14-4d1f-b595-52a23eaf8af3 admin admin] 10.222.0.121 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001582 Aug 04 10:25:22.598159 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: [pid: 103260|app: 0|req: 9/16] 10.222.0.121 () {54 vars in 936 bytes} [Thu Aug 4 10:25:22 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:25:23.052170 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi [None req-27b07211-46f9-4432-adf1-4c03ea0864cc admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "vcpus": 4, "id": "d4", "name": "ds4G", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "swap": 0, "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:25:23.082603 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: INFO nova.api.openstack.requestlog [None req-27b07211-46f9-4432-adf1-4c03ea0864cc admin admin] 10.222.0.121 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.468054 Aug 04 10:25:23.082603 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: [pid: 103259|app: 0|req: 8/17] 10.222.0.121 () {64 vars in 1288 bytes} [Thu Aug 4 10:25:22 2022] POST /compute/v2.1/flavors => generated 406 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 10:25:23.086420 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi [None req-7abb4d61-10dc-4e5d-93db-8eea25d52841 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:25:23.120375 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: INFO nova.api.openstack.requestlog [None req-7abb4d61-10dc-4e5d-93db-8eea25d52841 admin admin] 10.222.0.121 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037597 Aug 04 10:25:23.121507 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: [pid: 103260|app: 0|req: 10/18] 10.222.0.121 () {64 vars in 1341 bytes} [Thu Aug 4 10:25:23 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:25:25.399666 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi [None req-27b07211-46f9-4432-adf1-4c03ea0864cc admin admin] Calling method '>' {{(pid=103259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:25:25.400731 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: INFO nova.api.openstack.requestlog [None req-27b07211-46f9-4432-adf1-4c03ea0864cc admin admin] 10.222.0.121 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001767 Aug 04 10:25:25.401431 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: [pid: 103259|app: 0|req: 9/19] 10.222.0.121 () {54 vars in 936 bytes} [Thu Aug 4 10:25:25 2022] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:25:25.854445 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi [None req-f41d1164-4f4a-452b-bbf2-a38646ec8a71 admin admin] Calling method '>' {{(pid=103260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:25:25.880284 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: INFO nova.api.openstack.requestlog [None req-f41d1164-4f4a-452b-bbf2-a38646ec8a71 admin admin] 10.222.0.121 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2116 microversion: 2.61 time: 0.471893 Aug 04 10:25:25.880853 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: [pid: 103260|app: 0|req: 11/20] 10.222.0.121 () {60 vars in 1297 bytes} [Thu Aug 4 10:25:25 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2116 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:25:28.887641 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi [None req-27b07211-46f9-4432-adf1-4c03ea0864cc admin admin] Calling method '>' {{(pid=103259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:25:28.889057 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: INFO nova.api.openstack.requestlog [None req-27b07211-46f9-4432-adf1-4c03ea0864cc admin admin] 10.222.0.121 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001834 Aug 04 10:25:28.889542 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: [pid: 103259|app: 0|req: 10/21] 10.222.0.121 () {54 vars in 936 bytes} [Thu Aug 4 10:25:28 2022] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:25:29.405691 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi [None req-1d2c9d3e-99c9-4841-a328-085a8bc13dd0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "rxtx_factor": 1.0, "id": "1", "swap": 0, "os-flavor-access:is_public": true, "name": "m1.tiny", "vcpus": 1}} {{(pid=103260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:25:29.428519 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: INFO nova.api.openstack.requestlog [None req-1d2c9d3e-99c9-4841-a328-085a8bc13dd0 admin admin] 10.222.0.121 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.530111 Aug 04 10:25:29.435894 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: [pid: 103260|app: 0|req: 12/22] 10.222.0.121 () {64 vars in 1288 bytes} [Thu Aug 4 10:25:28 2022] POST /compute/v2.1/flavors => generated 404 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 10:25:29.441754 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi [None req-f6c8ccda-f67d-49aa-85c4-89d6c3721b55 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:25:29.468303 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: INFO nova.api.openstack.requestlog [None req-f6c8ccda-f67d-49aa-85c4-89d6c3721b55 admin admin] 10.222.0.121 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030175 Aug 04 10:25:29.468900 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: [pid: 103259|app: 0|req: 11/23] 10.222.0.121 () {64 vars in 1338 bytes} [Thu Aug 4 10:25:29 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 10:25:31.747012 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi [None req-1d2c9d3e-99c9-4841-a328-085a8bc13dd0 admin admin] Calling method '>' {{(pid=103260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:25:31.748091 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: INFO nova.api.openstack.requestlog [None req-1d2c9d3e-99c9-4841-a328-085a8bc13dd0 admin admin] 10.222.0.121 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001517 Aug 04 10:25:31.748715 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: [pid: 103260|app: 0|req: 13/24] 10.222.0.121 () {54 vars in 936 bytes} [Thu Aug 4 10:25:31 2022] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:25:32.189724 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi [None req-6249ae27-2235-43d2-89cd-9f66fc4448b4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "rxtx_factor": 1.0, "disk": 20, "id": "2", "name": "m1.small", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "ram": 2048}} {{(pid=103259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:25:32.216525 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: INFO nova.api.openstack.requestlog [None req-6249ae27-2235-43d2-89cd-9f66fc4448b4 admin admin] 10.222.0.121 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.461897 Aug 04 10:25:32.217245 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: [pid: 103259|app: 0|req: 12/25] 10.222.0.121 () {64 vars in 1288 bytes} [Thu Aug 4 10:25:31 2022] POST /compute/v2.1/flavors => generated 407 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 04 10:25:32.230356 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi [None req-08250abf-0b80-4a64-9612-27399981e027 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:25:32.263360 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: INFO nova.api.openstack.requestlog [None req-08250abf-0b80-4a64-9612-27399981e027 admin admin] 10.222.0.121 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036711 Aug 04 10:25:32.263981 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: [pid: 103260|app: 0|req: 14/26] 10.222.0.121 () {64 vars in 1338 bytes} [Thu Aug 4 10:25:32 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:25:34.508852 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi [None req-6249ae27-2235-43d2-89cd-9f66fc4448b4 admin admin] Calling method '>' {{(pid=103259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:25:34.509863 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: INFO nova.api.openstack.requestlog [None req-6249ae27-2235-43d2-89cd-9f66fc4448b4 admin admin] 10.222.0.121 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001545 Aug 04 10:25:34.510501 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: [pid: 103259|app: 0|req: 13/27] 10.222.0.121 () {54 vars in 936 bytes} [Thu Aug 4 10:25:34 2022] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:25:34.891429 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi [None req-10cf406c-0e9c-44bf-913d-e9008e15e971 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 2, "name": "m1.medium", "id": "3", "ram": 4096, "swap": 0, "disk": 40}} {{(pid=103260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:25:34.913165 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: INFO nova.api.openstack.requestlog [None req-10cf406c-0e9c-44bf-913d-e9008e15e971 admin admin] 10.222.0.121 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.395178 Aug 04 10:25:34.913827 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: [pid: 103260|app: 0|req: 15/28] 10.222.0.121 () {64 vars in 1288 bytes} [Thu Aug 4 10:25:34 2022] POST /compute/v2.1/flavors => generated 408 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 10:25:34.928323 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi [None req-f33cae7d-781c-4497-b35e-a9e7b85f0dda admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:25:34.968743 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: INFO nova.api.openstack.requestlog [None req-f33cae7d-781c-4497-b35e-a9e7b85f0dda admin admin] 10.222.0.121 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.046134 Aug 04 10:25:34.970040 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: [pid: 103259|app: 0|req: 14/29] 10.222.0.121 () {64 vars in 1338 bytes} [Thu Aug 4 10:25:34 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:25:37.289209 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi [None req-10cf406c-0e9c-44bf-913d-e9008e15e971 admin admin] Calling method '>' {{(pid=103260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:25:37.290473 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: INFO nova.api.openstack.requestlog [None req-10cf406c-0e9c-44bf-913d-e9008e15e971 admin admin] 10.222.0.121 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001532 Aug 04 10:25:37.291081 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: [pid: 103260|app: 0|req: 16/30] 10.222.0.121 () {54 vars in 936 bytes} [Thu Aug 4 10:25:37 2022] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:25:37.790440 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi [None req-4312db54-b06b-47d2-a4f6-d403063e4e43 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.large", "swap": 0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 8192, "disk": 80, "id": "4", "rxtx_factor": 1.0, "vcpus": 4}} {{(pid=103259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:25:37.799723 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG dbcounter [-] [103259] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=103259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:25:37.811736 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: INFO nova.api.openstack.requestlog [None req-4312db54-b06b-47d2-a4f6-d403063e4e43 admin admin] 10.222.0.121 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.513451 Aug 04 10:25:37.814451 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: [pid: 103259|app: 0|req: 15/31] 10.222.0.121 () {64 vars in 1288 bytes} [Thu Aug 4 10:25:37 2022] POST /compute/v2.1/flavors => generated 407 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 10:25:37.827004 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi [None req-6535fdcf-b0ae-475a-9547-6a74e50964be admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:25:37.856624 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: INFO nova.api.openstack.requestlog [None req-6535fdcf-b0ae-475a-9547-6a74e50964be admin admin] 10.222.0.121 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033221 Aug 04 10:25:37.872321 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: [pid: 103260|app: 0|req: 17/32] 10.222.0.121 () {64 vars in 1338 bytes} [Thu Aug 4 10:25:37 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:25:40.109593 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi [None req-4312db54-b06b-47d2-a4f6-d403063e4e43 admin admin] Calling method '>' {{(pid=103259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:25:40.111311 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: INFO nova.api.openstack.requestlog [None req-4312db54-b06b-47d2-a4f6-d403063e4e43 admin admin] 10.222.0.121 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.002051 Aug 04 10:25:40.112026 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: [pid: 103259|app: 0|req: 16/33] 10.222.0.121 () {54 vars in 936 bytes} [Thu Aug 4 10:25:40 2022] GET /compute/v2.1 => generated 389 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:25:40.673833 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi [None req-ef55c407-2a0a-4304-b2cc-476fdd31eb09 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "disk": 160, "ram": 16384, "vcpus": 8, "os-flavor-access:is_public": true, "name": "m1.xlarge", "id": "5", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:25:40.697297 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: INFO nova.api.openstack.requestlog [None req-ef55c407-2a0a-4304-b2cc-476fdd31eb09 admin admin] 10.222.0.121 "POST /compute/v2.1/flavors" status: 200 len: 410 microversion: 2.61 time: 0.578756 Aug 04 10:25:40.698227 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: [pid: 103260|app: 0|req: 18/34] 10.222.0.121 () {64 vars in 1288 bytes} [Thu Aug 4 10:25:40 2022] POST /compute/v2.1/flavors => generated 410 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 10:25:40.710829 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi [None req-180099ee-8b44-4409-b47b-ae6a83f33e22 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:25:40.759926 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: INFO nova.api.openstack.requestlog [None req-180099ee-8b44-4409-b47b-ae6a83f33e22 admin admin] 10.222.0.121 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.052791 Aug 04 10:25:40.760745 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: [pid: 103259|app: 0|req: 17/35] 10.222.0.121 () {64 vars in 1338 bytes} [Thu Aug 4 10:25:40 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 10:26:01.217380 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi [None req-ef55c407-2a0a-4304-b2cc-476fdd31eb09 admin admin] Calling method '>' {{(pid=103260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:26:01.218382 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: INFO nova.api.openstack.requestlog [None req-ef55c407-2a0a-4304-b2cc-476fdd31eb09 admin admin] 10.222.0.121 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001474 Aug 04 10:26:01.218784 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: [pid: 103260|app: 0|req: 19/36] 10.222.0.121 () {54 vars in 936 bytes} [Thu Aug 4 10:26:01 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:26:01.230258 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG dbcounter [-] [103259] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=103259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:26:01.648177 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi [None req-4614411b-e154-4071-9d6e-7d17d95abba0 admin admin] Calling method '>' {{(pid=103259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:26:01.667248 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: INFO nova.api.openstack.requestlog [None req-4614411b-e154-4071-9d6e-7d17d95abba0 admin admin] 10.222.0.121 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4222 microversion: 2.61 time: 0.441341 Aug 04 10:26:01.667707 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: [pid: 103259|app: 0|req: 18/37] 10.222.0.121 () {60 vars in 1297 bytes} [Thu Aug 4 10:26:01 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4222 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:26:02.812373 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi [None req-ef55c407-2a0a-4304-b2cc-476fdd31eb09 admin admin] Calling method '>' {{(pid=103260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:26:02.813748 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: INFO nova.api.openstack.requestlog [None req-ef55c407-2a0a-4304-b2cc-476fdd31eb09 admin admin] 10.222.0.121 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.002082 Aug 04 10:26:02.814321 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: [pid: 103260|app: 0|req: 20/38] 10.222.0.121 () {56 vars in 1079 bytes} [Thu Aug 4 10:26:02 2022] GET /compute/v2.1 => generated 389 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:26:03.384495 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi [None req-f99a3b7e-ba2f-405d-82f1-13756250e9df admin admin] Calling method '>' {{(pid=103259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:26:03.391335 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: INFO nova.api.openstack.wsgi [None req-f99a3b7e-ba2f-405d-82f1-13756250e9df admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 04 10:26:03.394817 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi [None req-f99a3b7e-ba2f-405d-82f1-13756250e9df admin admin] Request method failure captured: Aug 04 10:26:03.394817 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 04 10:26:03.394817 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: Accept: application/json Aug 04 10:26:03.394817 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: Accept-Encoding: gzip, deflate Aug 04 10:26:03.394817 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: Connection: keep-alive Aug 04 10:26:03.394817 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: Content-Length: 0 Aug 04 10:26:03.394817 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: Host: 10.222.0.121 Aug 04 10:26:03.394817 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: Openstack-Api-Version: compute 2.90 Aug 04 10:26:03.394817 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: Openstack-System-Scope: None Aug 04 10:26:03.394817 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: User-Agent: python-novaclient Aug 04 10:26:03.394817 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: X-Auth-Token: gAAAAABi6566Nggt3KKA3Y6hWsJxLWlgEX9k7JonamiMUfofqgsLCXoy5KAGVGr_ZispryFhxKPclcu6TARrYsd50XUEblKfvfH43_5WGa85taiUzzKDi0M-6bXpLWhTAfLTb5O12FNkYorqj9tNJSDCdcADgIVeCemcAt6QNEaBYIn-_9trNiA Aug 04 10:26:03.394817 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: X-Domain-Id: None Aug 04 10:26:03.394817 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: X-Domain-Name: None Aug 04 10:26:03.394817 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: X-Identity-Status: Confirmed Aug 04 10:26:03.394817 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: X-Is-Admin-Project: True Aug 04 10:26:03.394817 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: X-Openstack-Nova-Api-Version: 2.90 Aug 04 10:26:03.394817 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: X-Project-Domain-Id: default Aug 04 10:26:03.394817 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: X-Project-Domain-Name: Default Aug 04 10:26:03.394817 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: X-Project-Id: 03f48ab98257418c836fe2e290bdf749 Aug 04 10:26:03.394817 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: X-Project-Name: admin Aug 04 10:26:03.394817 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: X-Role: reader,member,admin Aug 04 10:26:03.394817 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: X-Roles: reader,member,admin Aug 04 10:26:03.396783 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/03f48ab98257418c836fe2e290bdf749"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/03f48ab98257418c836fe2e290bdf749"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.121:8080", "publicURL": "http://10.222.0.121:8080/v1/AUTH_03f48ab98257418c836fe2e290bdf749"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2/03f48ab98257418c836fe2e290bdf749"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:9696/networking"}]}] Aug 04 10:26:03.396783 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: X-Tenant: admin Aug 04 10:26:03.396783 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: X-Tenant-Id: 03f48ab98257418c836fe2e290bdf749 Aug 04 10:26:03.396783 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: X-Tenant-Name: admin Aug 04 10:26:03.396783 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: X-User: admin Aug 04 10:26:03.396783 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: X-User-Domain-Id: default Aug 04 10:26:03.396783 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: X-User-Domain-Name: Default Aug 04 10:26:03.396783 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: X-User-Id: 4d1eaa7a05e745a5817149d8a56dab58 Aug 04 10:26:03.396783 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: X-User-Name: admin Aug 04 10:26:03.396783 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: method: > Aug 04 10:26:03.396783 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: exception: Flavor 42 could not be found. Aug 04 10:26:03.396783 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: action_args: {'id': '42'} Aug 04 10:26:03.396783 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: {{(pid=103259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 10:26:03.396783 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:26:03.397842 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 04 10:26:03.397842 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 04 10:26:03.397842 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 04 10:26:03.397842 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 04 10:26:03.397842 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 10:26:03.397842 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 10:26:03.397842 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 04 10:26:03.397842 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 04 10:26:03.397842 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 04 10:26:03.397842 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 10:26:03.397842 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 04 10:26:03.397842 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 04 10:26:03.397842 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 04 10:26:03.397842 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: ERROR nova.api.openstack.wsgi Aug 04 10:26:03.397842 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:26:03.397842 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: ERROR nova.api.openstack.wsgi Aug 04 10:26:03.397842 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:26:03.397842 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:26:03.397842 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:26:03.399054 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 10:26:03.399054 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 10:26:03.399054 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 10:26:03.399054 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 10:26:03.399054 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 04 10:26:03.399054 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 04 10:26:03.399054 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 04 10:26:03.399054 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: ERROR nova.api.openstack.wsgi Aug 04 10:26:03.399054 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:26:03.399054 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: ERROR nova.api.openstack.wsgi Aug 04 10:26:03.399054 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:26:03.399054 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:26:03.399054 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:26:03.399054 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 10:26:03.399054 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 10:26:03.399054 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 04 10:26:03.399054 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: ERROR nova.api.openstack.wsgi Aug 04 10:26:03.399054 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi [None req-f99a3b7e-ba2f-405d-82f1-13756250e9df admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103259) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 10:26:03.400202 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: INFO nova.api.openstack.requestlog [None req-f99a3b7e-ba2f-405d-82f1-13756250e9df admin admin] 10.222.0.121 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.436373 Aug 04 10:26:03.400202 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: [pid: 103259|app: 0|req: 19/39] 10.222.0.121 () {60 vars in 1195 bytes} [Thu Aug 4 10:26:02 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 438 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 04 10:26:03.406726 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi [None req-1bb659d1-a54c-4bdd-93a1-d4e475b44bb8 admin admin] Calling method '>' {{(pid=103260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:26:03.411062 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG dbcounter [-] [103260] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103260) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:26:03.431394 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: INFO nova.api.openstack.requestlog [None req-1bb659d1-a54c-4bdd-93a1-d4e475b44bb8 admin admin] 10.222.0.121 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2076 microversion: 2.90 time: 0.028371 Aug 04 10:26:03.432003 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: [pid: 103260|app: 0|req: 21/40] 10.222.0.121 () {60 vars in 1215 bytes} [Thu Aug 4 10:26:03 2022] GET /compute/v2.1/flavors?is_public=None => generated 2076 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:26:03.442475 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi [None req-3e2028ff-31cd-4f80-9107-78d4502a735d admin admin] Calling method '>' {{(pid=103259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:26:03.467331 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: INFO nova.api.openstack.requestlog [None req-3e2028ff-31cd-4f80-9107-78d4502a735d admin admin] 10.222.0.121 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2076 microversion: 2.90 time: 0.028368 Aug 04 10:26:03.467891 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: [pid: 103259|app: 0|req: 20/41] 10.222.0.121 () {60 vars in 1215 bytes} [Thu Aug 4 10:26:03 2022] GET /compute/v2.1/flavors?is_public=None => generated 2076 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:26:03.483882 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi [None req-1175b98f-9467-4964-ba61-6f58044555f0 admin admin] Calling method '>' {{(pid=103260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:26:03.493656 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: INFO nova.api.openstack.wsgi [None req-1175b98f-9467-4964-ba61-6f58044555f0 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 04 10:26:03.497066 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi [None req-1175b98f-9467-4964-ba61-6f58044555f0 admin admin] Request method failure captured: Aug 04 10:26:03.497066 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 04 10:26:03.497066 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: Accept: application/json Aug 04 10:26:03.497066 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: Accept-Encoding: gzip, deflate Aug 04 10:26:03.497066 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: Connection: keep-alive Aug 04 10:26:03.497066 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: Content-Length: 0 Aug 04 10:26:03.497066 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: Host: 10.222.0.121 Aug 04 10:26:03.497066 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: Openstack-Api-Version: compute 2.90 Aug 04 10:26:03.497066 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: Openstack-System-Scope: None Aug 04 10:26:03.497066 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: User-Agent: python-novaclient Aug 04 10:26:03.497066 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: X-Auth-Token: gAAAAABi6566Nggt3KKA3Y6hWsJxLWlgEX9k7JonamiMUfofqgsLCXoy5KAGVGr_ZispryFhxKPclcu6TARrYsd50XUEblKfvfH43_5WGa85taiUzzKDi0M-6bXpLWhTAfLTb5O12FNkYorqj9tNJSDCdcADgIVeCemcAt6QNEaBYIn-_9trNiA Aug 04 10:26:03.497066 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: X-Domain-Id: None Aug 04 10:26:03.497066 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: X-Domain-Name: None Aug 04 10:26:03.497066 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: X-Identity-Status: Confirmed Aug 04 10:26:03.497066 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: X-Is-Admin-Project: True Aug 04 10:26:03.497066 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: X-Openstack-Nova-Api-Version: 2.90 Aug 04 10:26:03.497066 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: X-Project-Domain-Id: default Aug 04 10:26:03.497066 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: X-Project-Domain-Name: Default Aug 04 10:26:03.497066 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: X-Project-Id: 03f48ab98257418c836fe2e290bdf749 Aug 04 10:26:03.497066 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: X-Project-Name: admin Aug 04 10:26:03.497066 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: X-Role: reader,member,admin Aug 04 10:26:03.497066 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: X-Roles: reader,member,admin Aug 04 10:26:03.498663 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/03f48ab98257418c836fe2e290bdf749"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/03f48ab98257418c836fe2e290bdf749"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.121:8080", "publicURL": "http://10.222.0.121:8080/v1/AUTH_03f48ab98257418c836fe2e290bdf749"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2/03f48ab98257418c836fe2e290bdf749"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:9696/networking"}]}] Aug 04 10:26:03.498663 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: X-Tenant: admin Aug 04 10:26:03.498663 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: X-Tenant-Id: 03f48ab98257418c836fe2e290bdf749 Aug 04 10:26:03.498663 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: X-Tenant-Name: admin Aug 04 10:26:03.498663 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: X-User: admin Aug 04 10:26:03.498663 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: X-User-Domain-Id: default Aug 04 10:26:03.498663 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: X-User-Domain-Name: Default Aug 04 10:26:03.498663 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: X-User-Id: 4d1eaa7a05e745a5817149d8a56dab58 Aug 04 10:26:03.498663 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: X-User-Name: admin Aug 04 10:26:03.498663 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: method: > Aug 04 10:26:03.498663 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: exception: Flavor 42 could not be found. Aug 04 10:26:03.498663 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: action_args: {'id': '42'} Aug 04 10:26:03.498663 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: {{(pid=103260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 10:26:03.498663 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:26:03.499766 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 04 10:26:03.499766 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 04 10:26:03.499766 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 04 10:26:03.499766 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 04 10:26:03.499766 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 10:26:03.499766 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 10:26:03.499766 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 04 10:26:03.499766 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 04 10:26:03.499766 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 04 10:26:03.499766 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 10:26:03.499766 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 04 10:26:03.499766 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 04 10:26:03.499766 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 04 10:26:03.499766 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: ERROR nova.api.openstack.wsgi Aug 04 10:26:03.499766 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:26:03.499766 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: ERROR nova.api.openstack.wsgi Aug 04 10:26:03.499766 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:26:03.499766 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:26:03.499766 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:26:03.501262 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 10:26:03.501262 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 10:26:03.501262 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 10:26:03.501262 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 10:26:03.501262 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 04 10:26:03.501262 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 04 10:26:03.501262 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 04 10:26:03.501262 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: ERROR nova.api.openstack.wsgi Aug 04 10:26:03.501262 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:26:03.501262 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: ERROR nova.api.openstack.wsgi Aug 04 10:26:03.501262 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:26:03.501262 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:26:03.501262 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:26:03.501262 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 10:26:03.501262 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 10:26:03.501262 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 04 10:26:03.501262 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: ERROR nova.api.openstack.wsgi Aug 04 10:26:03.501262 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi [None req-1175b98f-9467-4964-ba61-6f58044555f0 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103260) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 10:26:03.502524 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: INFO nova.api.openstack.requestlog [None req-1175b98f-9467-4964-ba61-6f58044555f0 admin admin] 10.222.0.121 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.020714 Aug 04 10:26:03.502524 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: [pid: 103260|app: 0|req: 22/42] 10.222.0.121 () {60 vars in 1195 bytes} [Thu Aug 4 10:26:03 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 22 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 04 10:26:04.519265 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi [None req-3e2028ff-31cd-4f80-9107-78d4502a735d admin admin] Calling method '>' {{(pid=103259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:26:04.520374 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: INFO nova.api.openstack.requestlog [None req-3e2028ff-31cd-4f80-9107-78d4502a735d admin admin] 10.222.0.121 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001554 Aug 04 10:26:04.520785 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: [pid: 103259|app: 0|req: 21/43] 10.222.0.121 () {56 vars in 1079 bytes} [Thu Aug 4 10:26:04 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:26:05.086183 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi [None req-ed35cdc9-61bf-4ca8-ac15-892fef37383f admin admin] Calling method '>' {{(pid=103260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:26:05.092193 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: INFO nova.api.openstack.wsgi [None req-ed35cdc9-61bf-4ca8-ac15-892fef37383f admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 04 10:26:05.093650 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi [None req-ed35cdc9-61bf-4ca8-ac15-892fef37383f admin admin] Request method failure captured: Aug 04 10:26:05.093650 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 04 10:26:05.093650 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: Accept: application/json Aug 04 10:26:05.093650 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: Accept-Encoding: gzip, deflate Aug 04 10:26:05.093650 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: Connection: keep-alive Aug 04 10:26:05.093650 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: Content-Length: 0 Aug 04 10:26:05.093650 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: Host: 10.222.0.121 Aug 04 10:26:05.093650 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: Openstack-Api-Version: compute 2.90 Aug 04 10:26:05.093650 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: Openstack-System-Scope: None Aug 04 10:26:05.093650 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: User-Agent: python-novaclient Aug 04 10:26:05.093650 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: X-Auth-Token: gAAAAABi6568rDnnGoS-WcX5frlD5_lKUcjpavwBgG6fY3-1gHILDLJjcxufPaZP0LsRiic1LCxnmcU3tg_JGkzADHloUXFpLXP3SpCQ1ueW5h1QBQ7fgiITN_Hfic__mdz3GHy8O7x5wAn0abEPVz-CMCArVottjEtp7UK2qr9qc0inr_me_-A Aug 04 10:26:05.093650 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: X-Domain-Id: None Aug 04 10:26:05.093650 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: X-Domain-Name: None Aug 04 10:26:05.093650 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: X-Identity-Status: Confirmed Aug 04 10:26:05.093650 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: X-Is-Admin-Project: True Aug 04 10:26:05.093650 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: X-Openstack-Nova-Api-Version: 2.90 Aug 04 10:26:05.093650 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: X-Project-Domain-Id: default Aug 04 10:26:05.093650 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: X-Project-Domain-Name: Default Aug 04 10:26:05.093650 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: X-Project-Id: 03f48ab98257418c836fe2e290bdf749 Aug 04 10:26:05.093650 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: X-Project-Name: admin Aug 04 10:26:05.093650 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: X-Role: reader,member,admin Aug 04 10:26:05.093650 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: X-Roles: reader,member,admin Aug 04 10:26:05.095093 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/03f48ab98257418c836fe2e290bdf749"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/03f48ab98257418c836fe2e290bdf749"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.121:8080", "publicURL": "http://10.222.0.121:8080/v1/AUTH_03f48ab98257418c836fe2e290bdf749"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2/03f48ab98257418c836fe2e290bdf749"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:9696/networking"}]}] Aug 04 10:26:05.095093 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: X-Tenant: admin Aug 04 10:26:05.095093 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: X-Tenant-Id: 03f48ab98257418c836fe2e290bdf749 Aug 04 10:26:05.095093 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: X-Tenant-Name: admin Aug 04 10:26:05.095093 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: X-User: admin Aug 04 10:26:05.095093 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: X-User-Domain-Id: default Aug 04 10:26:05.095093 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: X-User-Domain-Name: Default Aug 04 10:26:05.095093 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: X-User-Id: 4d1eaa7a05e745a5817149d8a56dab58 Aug 04 10:26:05.095093 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: X-User-Name: admin Aug 04 10:26:05.095093 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: method: > Aug 04 10:26:05.095093 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: exception: Flavor 84 could not be found. Aug 04 10:26:05.095093 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: action_args: {'id': '84'} Aug 04 10:26:05.095093 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: {{(pid=103260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 10:26:05.095093 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:26:05.095978 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 04 10:26:05.095978 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 04 10:26:05.095978 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 04 10:26:05.095978 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 04 10:26:05.095978 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 10:26:05.095978 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 10:26:05.095978 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 04 10:26:05.095978 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 04 10:26:05.095978 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 04 10:26:05.095978 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 10:26:05.095978 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 04 10:26:05.095978 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 04 10:26:05.095978 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 04 10:26:05.095978 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: ERROR nova.api.openstack.wsgi Aug 04 10:26:05.095978 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:26:05.095978 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: ERROR nova.api.openstack.wsgi Aug 04 10:26:05.095978 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:26:05.095978 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:26:05.095978 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:26:05.097112 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 10:26:05.097112 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 10:26:05.097112 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 10:26:05.097112 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 10:26:05.097112 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 04 10:26:05.097112 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 04 10:26:05.097112 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 04 10:26:05.097112 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: ERROR nova.api.openstack.wsgi Aug 04 10:26:05.097112 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:26:05.097112 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: ERROR nova.api.openstack.wsgi Aug 04 10:26:05.097112 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:26:05.097112 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:26:05.097112 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:26:05.097112 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 10:26:05.097112 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 10:26:05.097112 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 04 10:26:05.097112 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: ERROR nova.api.openstack.wsgi Aug 04 10:26:05.097112 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi [None req-ed35cdc9-61bf-4ca8-ac15-892fef37383f admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103260) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 10:26:05.098148 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: INFO nova.api.openstack.requestlog [None req-ed35cdc9-61bf-4ca8-ac15-892fef37383f admin admin] 10.222.0.121 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.427103 Aug 04 10:26:05.098148 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: [pid: 103260|app: 0|req: 23/44] 10.222.0.121 () {60 vars in 1195 bytes} [Thu Aug 4 10:26:04 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 428 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 04 10:26:05.105132 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi [None req-4bec9403-f918-4b4f-a0e6-a7ad1b4e0dc4 admin admin] Calling method '>' {{(pid=103259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:26:05.120656 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: INFO nova.api.openstack.requestlog [None req-4bec9403-f918-4b4f-a0e6-a7ad1b4e0dc4 admin admin] 10.222.0.121 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2076 microversion: 2.90 time: 0.019068 Aug 04 10:26:05.121214 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: [pid: 103259|app: 0|req: 22/45] 10.222.0.121 () {60 vars in 1215 bytes} [Thu Aug 4 10:26:05 2022] GET /compute/v2.1/flavors?is_public=None => generated 2076 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:26:05.132035 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi [None req-7b5ed0f8-0fae-415e-a61b-d6595988e0aa admin admin] Calling method '>' {{(pid=103260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:26:05.150697 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: INFO nova.api.openstack.requestlog [None req-7b5ed0f8-0fae-415e-a61b-d6595988e0aa admin admin] 10.222.0.121 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2076 microversion: 2.90 time: 0.022558 Aug 04 10:26:05.151310 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: [pid: 103260|app: 0|req: 24/46] 10.222.0.121 () {60 vars in 1215 bytes} [Thu Aug 4 10:26:05 2022] GET /compute/v2.1/flavors?is_public=None => generated 2076 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:26:05.162173 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi [None req-1194e431-8044-4ec2-b953-15390782fc07 admin admin] Calling method '>' {{(pid=103259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:26:05.168144 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: INFO nova.api.openstack.wsgi [None req-1194e431-8044-4ec2-b953-15390782fc07 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 04 10:26:05.169680 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi [None req-1194e431-8044-4ec2-b953-15390782fc07 admin admin] Request method failure captured: Aug 04 10:26:05.169680 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 04 10:26:05.169680 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: Accept: application/json Aug 04 10:26:05.169680 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: Accept-Encoding: gzip, deflate Aug 04 10:26:05.169680 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: Connection: keep-alive Aug 04 10:26:05.169680 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: Content-Length: 0 Aug 04 10:26:05.169680 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: Host: 10.222.0.121 Aug 04 10:26:05.169680 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: Openstack-Api-Version: compute 2.90 Aug 04 10:26:05.169680 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: Openstack-System-Scope: None Aug 04 10:26:05.169680 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: User-Agent: python-novaclient Aug 04 10:26:05.169680 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: X-Auth-Token: gAAAAABi6568rDnnGoS-WcX5frlD5_lKUcjpavwBgG6fY3-1gHILDLJjcxufPaZP0LsRiic1LCxnmcU3tg_JGkzADHloUXFpLXP3SpCQ1ueW5h1QBQ7fgiITN_Hfic__mdz3GHy8O7x5wAn0abEPVz-CMCArVottjEtp7UK2qr9qc0inr_me_-A Aug 04 10:26:05.169680 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: X-Domain-Id: None Aug 04 10:26:05.169680 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: X-Domain-Name: None Aug 04 10:26:05.169680 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: X-Identity-Status: Confirmed Aug 04 10:26:05.169680 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: X-Is-Admin-Project: True Aug 04 10:26:05.169680 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: X-Openstack-Nova-Api-Version: 2.90 Aug 04 10:26:05.169680 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: X-Project-Domain-Id: default Aug 04 10:26:05.169680 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: X-Project-Domain-Name: Default Aug 04 10:26:05.169680 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: X-Project-Id: 03f48ab98257418c836fe2e290bdf749 Aug 04 10:26:05.169680 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: X-Project-Name: admin Aug 04 10:26:05.169680 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: X-Role: reader,member,admin Aug 04 10:26:05.169680 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: X-Roles: reader,member,admin Aug 04 10:26:05.171395 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/03f48ab98257418c836fe2e290bdf749"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/03f48ab98257418c836fe2e290bdf749"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.121:8080", "publicURL": "http://10.222.0.121:8080/v1/AUTH_03f48ab98257418c836fe2e290bdf749"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2/03f48ab98257418c836fe2e290bdf749"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:9696/networking"}]}] Aug 04 10:26:05.171395 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: X-Tenant: admin Aug 04 10:26:05.171395 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: X-Tenant-Id: 03f48ab98257418c836fe2e290bdf749 Aug 04 10:26:05.171395 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: X-Tenant-Name: admin Aug 04 10:26:05.171395 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: X-User: admin Aug 04 10:26:05.171395 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: X-User-Domain-Id: default Aug 04 10:26:05.171395 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: X-User-Domain-Name: Default Aug 04 10:26:05.171395 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: X-User-Id: 4d1eaa7a05e745a5817149d8a56dab58 Aug 04 10:26:05.171395 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: X-User-Name: admin Aug 04 10:26:05.171395 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: method: > Aug 04 10:26:05.171395 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: exception: Flavor 84 could not be found. Aug 04 10:26:05.171395 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: action_args: {'id': '84'} Aug 04 10:26:05.171395 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: {{(pid=103259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 10:26:05.171395 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:26:05.172358 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 04 10:26:05.172358 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 04 10:26:05.172358 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 04 10:26:05.172358 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 04 10:26:05.172358 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 10:26:05.172358 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 10:26:05.172358 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 04 10:26:05.172358 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 04 10:26:05.172358 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 04 10:26:05.172358 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 10:26:05.172358 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 04 10:26:05.172358 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 04 10:26:05.172358 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 04 10:26:05.172358 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: ERROR nova.api.openstack.wsgi Aug 04 10:26:05.172358 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:26:05.172358 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: ERROR nova.api.openstack.wsgi Aug 04 10:26:05.172358 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:26:05.172358 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:26:05.172358 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:26:05.173717 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 10:26:05.173717 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 10:26:05.173717 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 10:26:05.173717 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 10:26:05.173717 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 04 10:26:05.173717 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 04 10:26:05.173717 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 04 10:26:05.173717 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: ERROR nova.api.openstack.wsgi Aug 04 10:26:05.173717 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:26:05.173717 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: ERROR nova.api.openstack.wsgi Aug 04 10:26:05.173717 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:26:05.173717 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:26:05.173717 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:26:05.173717 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 10:26:05.173717 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 10:26:05.173717 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 04 10:26:05.173717 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: ERROR nova.api.openstack.wsgi Aug 04 10:26:05.173717 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi [None req-1194e431-8044-4ec2-b953-15390782fc07 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103259) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 10:26:05.175017 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: INFO nova.api.openstack.requestlog [None req-1194e431-8044-4ec2-b953-15390782fc07 admin admin] 10.222.0.121 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012890 Aug 04 10:26:05.175017 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: [pid: 103259|app: 0|req: 23/47] 10.222.0.121 () {60 vars in 1195 bytes} [Thu Aug 4 10:26:05 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 04 10:26:06.158645 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi [None req-7b5ed0f8-0fae-415e-a61b-d6595988e0aa admin admin] Calling method '>' {{(pid=103260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:26:06.159702 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: INFO nova.api.openstack.requestlog [None req-7b5ed0f8-0fae-415e-a61b-d6595988e0aa admin admin] 10.222.0.121 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001570 Aug 04 10:26:06.160141 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: [pid: 103260|app: 0|req: 25/48] 10.222.0.121 () {56 vars in 1079 bytes} [Thu Aug 4 10:26:06 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:26:06.777388 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi [None req-d84bf5be-9ec2-43f4-8ed5-5637375eb782 admin admin] Calling method '>' {{(pid=103259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:26:06.785423 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: INFO nova.api.openstack.wsgi [None req-d84bf5be-9ec2-43f4-8ed5-5637375eb782 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 04 10:26:06.787829 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi [None req-d84bf5be-9ec2-43f4-8ed5-5637375eb782 admin admin] Request method failure captured: Aug 04 10:26:06.787829 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 04 10:26:06.787829 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: Accept: application/json Aug 04 10:26:06.787829 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: Accept-Encoding: gzip, deflate Aug 04 10:26:06.787829 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: Connection: keep-alive Aug 04 10:26:06.787829 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: Content-Length: 0 Aug 04 10:26:06.787829 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: Host: 10.222.0.121 Aug 04 10:26:06.787829 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: Openstack-Api-Version: compute 2.90 Aug 04 10:26:06.787829 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: Openstack-System-Scope: None Aug 04 10:26:06.787829 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: User-Agent: python-novaclient Aug 04 10:26:06.787829 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: X-Auth-Token: gAAAAABi656-4guRv6nIPOg_I9Om77U3Pc2LxQTfPYkue9iEFE997PMoEFW68adR2-ld7UG1VG6Xckn9uoy45yw6TgZ0G-8Sglvb-eAWp0Z2VRjf0qlFmYM8-Ajr04kXNXy4T7EL1ZndcLeoByepPgxY7jdKKWaeeGGb6pNiDrznqCvStllMxs0 Aug 04 10:26:06.787829 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: X-Domain-Id: None Aug 04 10:26:06.787829 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: X-Domain-Name: None Aug 04 10:26:06.787829 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: X-Identity-Status: Confirmed Aug 04 10:26:06.787829 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: X-Is-Admin-Project: True Aug 04 10:26:06.787829 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: X-Openstack-Nova-Api-Version: 2.90 Aug 04 10:26:06.787829 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: X-Project-Domain-Id: default Aug 04 10:26:06.787829 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: X-Project-Domain-Name: Default Aug 04 10:26:06.787829 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: X-Project-Id: 03f48ab98257418c836fe2e290bdf749 Aug 04 10:26:06.787829 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: X-Project-Name: admin Aug 04 10:26:06.787829 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: X-Role: reader,member,admin Aug 04 10:26:06.787829 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: X-Roles: reader,member,admin Aug 04 10:26:06.791079 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/03f48ab98257418c836fe2e290bdf749"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/03f48ab98257418c836fe2e290bdf749"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.121:8080", "publicURL": "http://10.222.0.121:8080/v1/AUTH_03f48ab98257418c836fe2e290bdf749"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2/03f48ab98257418c836fe2e290bdf749"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:9696/networking"}]}] Aug 04 10:26:06.791079 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: X-Tenant: admin Aug 04 10:26:06.791079 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: X-Tenant-Id: 03f48ab98257418c836fe2e290bdf749 Aug 04 10:26:06.791079 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: X-Tenant-Name: admin Aug 04 10:26:06.791079 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: X-User: admin Aug 04 10:26:06.791079 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: X-User-Domain-Id: default Aug 04 10:26:06.791079 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: X-User-Domain-Name: Default Aug 04 10:26:06.791079 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: X-User-Id: 4d1eaa7a05e745a5817149d8a56dab58 Aug 04 10:26:06.791079 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: X-User-Name: admin Aug 04 10:26:06.791079 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: method: > Aug 04 10:26:06.791079 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: exception: Flavor 451 could not be found. Aug 04 10:26:06.791079 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: action_args: {'id': '451'} Aug 04 10:26:06.791079 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: {{(pid=103259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 10:26:06.791079 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:26:06.792665 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 04 10:26:06.792665 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 04 10:26:06.792665 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 04 10:26:06.792665 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 04 10:26:06.792665 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 10:26:06.792665 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 10:26:06.792665 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 04 10:26:06.792665 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 04 10:26:06.792665 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 04 10:26:06.792665 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 10:26:06.792665 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 04 10:26:06.792665 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 04 10:26:06.792665 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 04 10:26:06.792665 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: ERROR nova.api.openstack.wsgi Aug 04 10:26:06.792665 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:26:06.792665 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: ERROR nova.api.openstack.wsgi Aug 04 10:26:06.792665 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:26:06.792665 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:26:06.792665 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:26:06.794083 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 10:26:06.794083 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 10:26:06.794083 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 10:26:06.794083 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 10:26:06.794083 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 04 10:26:06.794083 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 04 10:26:06.794083 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 04 10:26:06.794083 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: ERROR nova.api.openstack.wsgi Aug 04 10:26:06.794083 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:26:06.794083 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: ERROR nova.api.openstack.wsgi Aug 04 10:26:06.794083 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:26:06.794083 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:26:06.794083 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:26:06.794083 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 10:26:06.794083 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 10:26:06.794083 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 04 10:26:06.794083 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: ERROR nova.api.openstack.wsgi Aug 04 10:26:06.794083 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi [None req-d84bf5be-9ec2-43f4-8ed5-5637375eb782 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103259) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 10:26:06.795587 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: INFO nova.api.openstack.requestlog [None req-d84bf5be-9ec2-43f4-8ed5-5637375eb782 admin admin] 10.222.0.121 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.486038 Aug 04 10:26:06.795587 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: [pid: 103259|app: 0|req: 24/49] 10.222.0.121 () {60 vars in 1198 bytes} [Thu Aug 4 10:26:06 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 487 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 04 10:26:06.801675 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi [None req-b1183769-7e95-4820-bc5f-833a8e5a27e6 admin admin] Calling method '>' {{(pid=103260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:26:06.817860 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: INFO nova.api.openstack.requestlog [None req-b1183769-7e95-4820-bc5f-833a8e5a27e6 admin admin] 10.222.0.121 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2076 microversion: 2.90 time: 0.020684 Aug 04 10:26:06.818420 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: [pid: 103260|app: 0|req: 26/50] 10.222.0.121 () {60 vars in 1215 bytes} [Thu Aug 4 10:26:06 2022] GET /compute/v2.1/flavors?is_public=None => generated 2076 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:26:06.828543 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi [None req-a317a5f9-841e-4856-80f3-b7cc376764dd admin admin] Calling method '>' {{(pid=103259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:26:06.844670 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: INFO nova.api.openstack.requestlog [None req-a317a5f9-841e-4856-80f3-b7cc376764dd admin admin] 10.222.0.121 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2076 microversion: 2.90 time: 0.019689 Aug 04 10:26:06.845243 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: [pid: 103259|app: 0|req: 25/51] 10.222.0.121 () {60 vars in 1215 bytes} [Thu Aug 4 10:26:06 2022] GET /compute/v2.1/flavors?is_public=None => generated 2076 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:26:06.855274 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi [None req-b4ea843a-7a00-4c94-a87f-107a2f1da002 admin admin] Calling method '>' {{(pid=103260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:26:06.861648 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: INFO nova.api.openstack.wsgi [None req-b4ea843a-7a00-4c94-a87f-107a2f1da002 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 04 10:26:06.863204 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi [None req-b4ea843a-7a00-4c94-a87f-107a2f1da002 admin admin] Request method failure captured: Aug 04 10:26:06.863204 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 04 10:26:06.863204 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: Accept: application/json Aug 04 10:26:06.863204 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: Accept-Encoding: gzip, deflate Aug 04 10:26:06.863204 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: Connection: keep-alive Aug 04 10:26:06.863204 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: Content-Length: 0 Aug 04 10:26:06.863204 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: Host: 10.222.0.121 Aug 04 10:26:06.863204 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: Openstack-Api-Version: compute 2.90 Aug 04 10:26:06.863204 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: Openstack-System-Scope: None Aug 04 10:26:06.863204 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: User-Agent: python-novaclient Aug 04 10:26:06.863204 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: X-Auth-Token: gAAAAABi656-4guRv6nIPOg_I9Om77U3Pc2LxQTfPYkue9iEFE997PMoEFW68adR2-ld7UG1VG6Xckn9uoy45yw6TgZ0G-8Sglvb-eAWp0Z2VRjf0qlFmYM8-Ajr04kXNXy4T7EL1ZndcLeoByepPgxY7jdKKWaeeGGb6pNiDrznqCvStllMxs0 Aug 04 10:26:06.863204 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: X-Domain-Id: None Aug 04 10:26:06.863204 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: X-Domain-Name: None Aug 04 10:26:06.863204 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: X-Identity-Status: Confirmed Aug 04 10:26:06.863204 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: X-Is-Admin-Project: True Aug 04 10:26:06.863204 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: X-Openstack-Nova-Api-Version: 2.90 Aug 04 10:26:06.863204 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: X-Project-Domain-Id: default Aug 04 10:26:06.863204 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: X-Project-Domain-Name: Default Aug 04 10:26:06.863204 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: X-Project-Id: 03f48ab98257418c836fe2e290bdf749 Aug 04 10:26:06.863204 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: X-Project-Name: admin Aug 04 10:26:06.863204 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: X-Role: reader,member,admin Aug 04 10:26:06.863204 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: X-Roles: reader,member,admin Aug 04 10:26:06.865120 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/03f48ab98257418c836fe2e290bdf749"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/03f48ab98257418c836fe2e290bdf749"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.121:8080", "publicURL": "http://10.222.0.121:8080/v1/AUTH_03f48ab98257418c836fe2e290bdf749"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2/03f48ab98257418c836fe2e290bdf749"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:9696/networking"}]}] Aug 04 10:26:06.865120 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: X-Tenant: admin Aug 04 10:26:06.865120 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: X-Tenant-Id: 03f48ab98257418c836fe2e290bdf749 Aug 04 10:26:06.865120 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: X-Tenant-Name: admin Aug 04 10:26:06.865120 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: X-User: admin Aug 04 10:26:06.865120 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: X-User-Domain-Id: default Aug 04 10:26:06.865120 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: X-User-Domain-Name: Default Aug 04 10:26:06.865120 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: X-User-Id: 4d1eaa7a05e745a5817149d8a56dab58 Aug 04 10:26:06.865120 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: X-User-Name: admin Aug 04 10:26:06.865120 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: method: > Aug 04 10:26:06.865120 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: exception: Flavor 451 could not be found. Aug 04 10:26:06.865120 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: action_args: {'id': '451'} Aug 04 10:26:06.865120 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: {{(pid=103260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 10:26:06.865120 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:26:06.866137 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 04 10:26:06.866137 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 04 10:26:06.866137 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 04 10:26:06.866137 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 04 10:26:06.866137 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 10:26:06.866137 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 10:26:06.866137 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 04 10:26:06.866137 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 04 10:26:06.866137 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 04 10:26:06.866137 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 10:26:06.866137 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 04 10:26:06.866137 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 04 10:26:06.866137 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 04 10:26:06.866137 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: ERROR nova.api.openstack.wsgi Aug 04 10:26:06.866137 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:26:06.866137 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: ERROR nova.api.openstack.wsgi Aug 04 10:26:06.866137 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:26:06.866137 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:26:06.866137 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:26:06.867543 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 10:26:06.867543 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 10:26:06.867543 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 10:26:06.867543 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 10:26:06.867543 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 04 10:26:06.867543 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 04 10:26:06.867543 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 04 10:26:06.867543 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: ERROR nova.api.openstack.wsgi Aug 04 10:26:06.867543 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:26:06.867543 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: ERROR nova.api.openstack.wsgi Aug 04 10:26:06.867543 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:26:06.867543 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:26:06.867543 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:26:06.867543 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 10:26:06.867543 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 10:26:06.867543 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 04 10:26:06.867543 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: ERROR nova.api.openstack.wsgi Aug 04 10:26:06.867543 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi [None req-b4ea843a-7a00-4c94-a87f-107a2f1da002 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103260) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 10:26:06.868913 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: INFO nova.api.openstack.requestlog [None req-b4ea843a-7a00-4c94-a87f-107a2f1da002 admin admin] 10.222.0.121 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.013134 Aug 04 10:26:06.868913 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: [pid: 103260|app: 0|req: 27/52] 10.222.0.121 () {60 vars in 1198 bytes} [Thu Aug 4 10:26:06 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 04 10:26:07.860142 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi [None req-a317a5f9-841e-4856-80f3-b7cc376764dd admin admin] Calling method '>' {{(pid=103259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:26:07.861148 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: INFO nova.api.openstack.requestlog [None req-a317a5f9-841e-4856-80f3-b7cc376764dd admin admin] 10.222.0.121 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001866 Aug 04 10:26:07.861528 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: [pid: 103259|app: 0|req: 26/53] 10.222.0.121 () {56 vars in 1079 bytes} [Thu Aug 4 10:26:07 2022] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:26:08.414942 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi [None req-8ca78b5b-eee0-4b96-834b-3d45fdbab60b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:26:08.436670 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: INFO nova.api.openstack.requestlog [None req-8ca78b5b-eee0-4b96-834b-3d45fdbab60b admin admin] 10.222.0.121 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.90 time: 0.436025 Aug 04 10:26:08.437231 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: [pid: 103260|app: 0|req: 28/54] 10.222.0.121 () {64 vars in 1240 bytes} [Thu Aug 4 10:26:07 2022] POST /compute/v2.1/flavors => generated 406 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 10:26:09.464142 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi [None req-a317a5f9-841e-4856-80f3-b7cc376764dd admin admin] Calling method '>' {{(pid=103259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:26:09.465148 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: INFO nova.api.openstack.requestlog [None req-a317a5f9-841e-4856-80f3-b7cc376764dd admin admin] 10.222.0.121 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001506 Aug 04 10:26:09.465546 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: [pid: 103259|app: 0|req: 27/55] 10.222.0.121 () {56 vars in 1079 bytes} [Thu Aug 4 10:26:09 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:26:10.054837 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi [None req-0084d701-f487-4f33-a3ff-9edf509f4f68 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:26:10.080866 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: INFO nova.api.openstack.requestlog [None req-0084d701-f487-4f33-a3ff-9edf509f4f68 admin admin] 10.222.0.121 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.478090 Aug 04 10:26:10.081425 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: [pid: 103260|app: 0|req: 29/56] 10.222.0.121 () {64 vars in 1240 bytes} [Thu Aug 4 10:26:09 2022] POST /compute/v2.1/flavors => generated 407 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 10:26:11.083493 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi [None req-a317a5f9-841e-4856-80f3-b7cc376764dd admin admin] Calling method '>' {{(pid=103259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:26:11.084539 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: INFO nova.api.openstack.requestlog [None req-a317a5f9-841e-4856-80f3-b7cc376764dd admin admin] 10.222.0.121 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001544 Aug 04 10:26:11.084910 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: [pid: 103259|app: 0|req: 28/57] 10.222.0.121 () {56 vars in 1079 bytes} [Thu Aug 4 10:26:11 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:26:11.674439 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi [None req-645b2675-b306-4bf0-9573-cc6ca080f971 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:26:11.696128 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: INFO nova.api.openstack.requestlog [None req-645b2675-b306-4bf0-9573-cc6ca080f971 admin admin] 10.222.0.121 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.473621 Aug 04 10:26:11.696682 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: [pid: 103260|app: 0|req: 30/58] 10.222.0.121 () {64 vars in 1240 bytes} [Thu Aug 4 10:26:11 2022] POST /compute/v2.1/flavors => generated 409 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 10:26:12.683626 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi [None req-a317a5f9-841e-4856-80f3-b7cc376764dd admin admin] Calling method '>' {{(pid=103259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:26:12.684965 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: INFO nova.api.openstack.requestlog [None req-a317a5f9-841e-4856-80f3-b7cc376764dd admin admin] 10.222.0.121 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.002138 Aug 04 10:26:12.685558 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: [pid: 103259|app: 0|req: 29/59] 10.222.0.121 () {56 vars in 1079 bytes} [Thu Aug 4 10:26:12 2022] GET /compute/v2.1 => generated 389 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:26:13.283958 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi [None req-5f253e3c-f09f-4e04-84a7-d56ada11211d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:26:13.306978 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: INFO nova.api.openstack.requestlog [None req-5f253e3c-f09f-4e04-84a7-d56ada11211d admin admin] 10.222.0.121 "POST /compute/v2.1/flavors" status: 200 len: 411 microversion: 2.90 time: 0.476118 Aug 04 10:26:13.307541 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: [pid: 103260|app: 0|req: 31/60] 10.222.0.121 () {64 vars in 1240 bytes} [Thu Aug 4 10:26:12 2022] POST /compute/v2.1/flavors => generated 411 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 10:26:14.329283 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi [None req-a317a5f9-841e-4856-80f3-b7cc376764dd admin admin] Calling method '>' {{(pid=103259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:26:14.330299 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: INFO nova.api.openstack.requestlog [None req-a317a5f9-841e-4856-80f3-b7cc376764dd admin admin] 10.222.0.121 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001478 Aug 04 10:26:14.330823 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: [pid: 103259|app: 0|req: 30/61] 10.222.0.121 () {56 vars in 1079 bytes} [Thu Aug 4 10:26:14 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:26:14.912248 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi [None req-c5b5834a-1d23-4f74-8e0a-c5f839bbb687 admin admin] Calling method '>' {{(pid=103260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:26:14.934285 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: INFO nova.api.openstack.requestlog [None req-c5b5834a-1d23-4f74-8e0a-c5f839bbb687 admin admin] 10.222.0.121 "GET /compute/v2.1/flavors/detail" status: 200 len: 5805 microversion: 2.90 time: 0.462656 Aug 04 10:26:14.934837 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: [pid: 103260|app: 0|req: 32/62] 10.222.0.121 () {60 vars in 1207 bytes} [Thu Aug 4 10:26:14 2022] GET /compute/v2.1/flavors/detail => generated 5805 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:27:08.772000 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi [None req-a317a5f9-841e-4856-80f3-b7cc376764dd admin admin] Calling method '>' {{(pid=103259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:27:08.773164 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: INFO nova.api.openstack.requestlog [None req-a317a5f9-841e-4856-80f3-b7cc376764dd admin admin] 10.222.0.121 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.002068 Aug 04 10:27:08.773804 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: [pid: 103259|app: 0|req: 31/63] 10.222.0.121 () {54 vars in 936 bytes} [Thu Aug 4 10:27:08 2022] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:27:08.787270 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG dbcounter [-] [103260] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103260) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:27:09.213421 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi [None req-443da346-9432-4d2d-8ce4-53a04a84f7e4 admin admin] Calling method '>' {{(pid=103260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:27:09.235718 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: INFO nova.api.openstack.requestlog [None req-443da346-9432-4d2d-8ce4-53a04a84f7e4 admin admin] 10.222.0.121 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5819 microversion: 2.61 time: 0.453150 Aug 04 10:27:09.236343 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: [pid: 103260|app: 0|req: 33/64] 10.222.0.121 () {60 vars in 1297 bytes} [Thu Aug 4 10:27:08 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5819 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 10:27:09.258676 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG dbcounter [-] [103259] Writing DB stats nova_api:SELECT=14 {{(pid=103259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:27:09.262619 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi [None req-e9c002b5-d089-4d6a-9bff-744c40d2bc60 admin admin] Calling method '>' {{(pid=103259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:27:09.271167 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: INFO nova.api.openstack.requestlog [None req-e9c002b5-d089-4d6a-9bff-744c40d2bc60 admin admin] 10.222.0.121 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.014004 Aug 04 10:27:09.271706 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: [pid: 103259|app: 0|req: 32/65] 10.222.0.121 () {60 vars in 1288 bytes} [Thu Aug 4 10:27:09 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:27:09.289758 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi [None req-363a66df-79fc-45f8-ab49-71f81ed95d40 admin admin] Calling method '>' {{(pid=103260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:27:09.301512 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: INFO nova.api.openstack.requestlog [None req-363a66df-79fc-45f8-ab49-71f81ed95d40 admin admin] 10.222.0.121 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.017229 Aug 04 10:27:09.302054 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: [pid: 103260|app: 0|req: 34/66] 10.222.0.121 () {60 vars in 1291 bytes} [Thu Aug 4 10:27:09 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:27:09.316638 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi [None req-e68f9eb9-3d4f-4e79-884a-ac8bb4ce1d50 admin admin] Calling method '>' {{(pid=103259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:27:09.327473 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: INFO nova.api.openstack.requestlog [None req-e68f9eb9-3d4f-4e79-884a-ac8bb4ce1d50 admin admin] 10.222.0.121 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.016555 Aug 04 10:27:09.328209 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: [pid: 103259|app: 0|req: 33/67] 10.222.0.121 () {60 vars in 1291 bytes} [Thu Aug 4 10:27:09 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:27:09.346397 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi [None req-c441b931-cc55-4618-a8e6-e6eff658a7c2 admin admin] Calling method '>' {{(pid=103260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:27:09.358471 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: INFO nova.api.openstack.requestlog [None req-c441b931-cc55-4618-a8e6-e6eff658a7c2 admin admin] 10.222.0.121 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.017279 Aug 04 10:27:09.359090 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: [pid: 103260|app: 0|req: 35/68] 10.222.0.121 () {60 vars in 1288 bytes} [Thu Aug 4 10:27:09 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:30:40.712707 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi [None req-e68f9eb9-3d4f-4e79-884a-ac8bb4ce1d50 admin admin] Calling method '>' {{(pid=103259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:30:40.713661 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: INFO nova.api.openstack.requestlog [None req-e68f9eb9-3d4f-4e79-884a-ac8bb4ce1d50 admin admin] 10.222.0.121 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001518 Aug 04 10:30:40.714052 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: [pid: 103259|app: 0|req: 34/69] 10.222.0.121 () {56 vars in 1079 bytes} [Thu Aug 4 10:30:40 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:30:40.857480 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG dbcounter [-] [103260] Writing DB stats nova_api:SELECT=6 {{(pid=103260) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:30:41.037129 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi [None req-c4c9e277-f141-43af-ab5c-e5fcb7d17dd2 admin admin] Calling method '>' {{(pid=103260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:30:41.039647 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 10:30:41.039647 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: warnings.warn(msg) Aug 04 10:30:41.040932 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG oslo_concurrency.lockutils [None req-c4c9e277-f141-43af-ab5c-e5fcb7d17dd2 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:30:41.041379 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG oslo_concurrency.lockutils [None req-c4c9e277-f141-43af-ab5c-e5fcb7d17dd2 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:30:41.042159 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG oslo_concurrency.lockutils [None req-c4c9e277-f141-43af-ab5c-e5fcb7d17dd2 admin admin] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:30:41.042578 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG oslo_concurrency.lockutils [None req-c4c9e277-f141-43af-ab5c-e5fcb7d17dd2 admin admin] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:30:41.077169 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: INFO nova.api.openstack.requestlog [None req-c4c9e277-f141-43af-ab5c-e5fcb7d17dd2 admin admin] 10.222.0.121 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.221093 Aug 04 10:30:41.077760 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: [pid: 103260|app: 0|req: 36/70] 10.222.0.121 () {60 vars in 1198 bytes} [Thu Aug 4 10:30:40 2022] GET /compute/v2.1/os-services => generated 791 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 10:30:41.960549 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi [None req-e68f9eb9-3d4f-4e79-884a-ac8bb4ce1d50 admin admin] Calling method '>' {{(pid=103259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:30:41.961556 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: INFO nova.api.openstack.requestlog [None req-e68f9eb9-3d4f-4e79-884a-ac8bb4ce1d50 admin admin] 10.222.0.121 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001509 Aug 04 10:30:41.961955 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: [pid: 103259|app: 0|req: 35/71] 10.222.0.121 () {56 vars in 1079 bytes} [Thu Aug 4 10:30:41 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:30:42.158443 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi [None req-b425d93a-1641-41fa-9426-dd92c7b88bd9 admin admin] Calling method '>' {{(pid=103260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:30:42.161481 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 10:30:42.161481 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: warnings.warn(msg) Aug 04 10:30:42.161951 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG oslo_concurrency.lockutils [None req-b425d93a-1641-41fa-9426-dd92c7b88bd9 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:30:42.162392 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG oslo_concurrency.lockutils [None req-b425d93a-1641-41fa-9426-dd92c7b88bd9 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:30:42.163171 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG oslo_concurrency.lockutils [None req-b425d93a-1641-41fa-9426-dd92c7b88bd9 admin admin] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:30:42.163579 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG oslo_concurrency.lockutils [None req-b425d93a-1641-41fa-9426-dd92c7b88bd9 admin admin] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:30:42.184829 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: INFO nova.api.openstack.requestlog [None req-b425d93a-1641-41fa-9426-dd92c7b88bd9 admin admin] 10.222.0.121 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.083834 Aug 04 10:30:42.185698 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: [pid: 103260|app: 0|req: 37/72] 10.222.0.121 () {60 vars in 1198 bytes} [Thu Aug 4 10:30:42 2022] GET /compute/v2.1/os-services => generated 791 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 10:30:53.669069 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi [None req-e68f9eb9-3d4f-4e79-884a-ac8bb4ce1d50 admin admin] Calling method '>' {{(pid=103259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:30:53.670089 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: INFO nova.api.openstack.requestlog [None req-e68f9eb9-3d4f-4e79-884a-ac8bb4ce1d50 admin admin] 10.222.0.121 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001494 Aug 04 10:30:53.670503 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: [pid: 103259|app: 0|req: 36/73] 10.222.0.121 () {56 vars in 1079 bytes} [Thu Aug 4 10:30:53 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:30:53.829053 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG dbcounter [-] [103260] Writing DB stats nova_cell0:SELECT=4 {{(pid=103260) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:30:53.829920 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG dbcounter [-] [103260] Writing DB stats nova_cell1:SELECT=4 {{(pid=103260) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:30:53.830677 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG dbcounter [-] [103260] Writing DB stats nova_api:SELECT=8 {{(pid=103260) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:30:53.893737 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi [None req-d4f8ba2a-d903-4bfa-b437-84a214a1b3c2 admin admin] Calling method '>' {{(pid=103260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:30:53.898042 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 10:30:53.898042 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: warnings.warn(msg) Aug 04 10:30:53.900107 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG oslo_concurrency.lockutils [None req-d4f8ba2a-d903-4bfa-b437-84a214a1b3c2 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:30:53.900818 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG oslo_concurrency.lockutils [None req-d4f8ba2a-d903-4bfa-b437-84a214a1b3c2 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:30:53.902105 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG oslo_concurrency.lockutils [None req-d4f8ba2a-d903-4bfa-b437-84a214a1b3c2 admin admin] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:30:53.902880 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG oslo_concurrency.lockutils [None req-d4f8ba2a-d903-4bfa-b437-84a214a1b3c2 admin admin] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:30:53.944527 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: INFO nova.api.openstack.requestlog [None req-d4f8ba2a-d903-4bfa-b437-84a214a1b3c2 admin admin] 10.222.0.121 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.120287 Aug 04 10:30:53.945159 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: [pid: 103260|app: 0|req: 38/74] 10.222.0.121 () {60 vars in 1198 bytes} [Thu Aug 4 10:30:53 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:30:54.851266 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: DEBUG nova.api.openstack.wsgi [None req-e68f9eb9-3d4f-4e79-884a-ac8bb4ce1d50 admin admin] Calling method '>' {{(pid=103259) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:30:54.852327 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: INFO nova.api.openstack.requestlog [None req-e68f9eb9-3d4f-4e79-884a-ac8bb4ce1d50 admin admin] 10.222.0.121 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001462 Aug 04 10:30:54.852709 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: [pid: 103259|app: 0|req: 37/75] 10.222.0.121 () {56 vars in 1079 bytes} [Thu Aug 4 10:30:54 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:30:55.064953 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG nova.api.openstack.wsgi [None req-0df6edba-9d46-4910-ab92-786e6ac8c572 admin admin] Calling method '>' {{(pid=103260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:30:55.067424 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 10:30:55.067424 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: warnings.warn(msg) Aug 04 10:30:55.068851 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG oslo_concurrency.lockutils [None req-0df6edba-9d46-4910-ab92-786e6ac8c572 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:30:55.069517 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG oslo_concurrency.lockutils [None req-0df6edba-9d46-4910-ab92-786e6ac8c572 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:30:55.070324 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG oslo_concurrency.lockutils [None req-0df6edba-9d46-4910-ab92-786e6ac8c572 admin admin] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:30:55.070738 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: DEBUG oslo_concurrency.lockutils [None req-0df6edba-9d46-4910-ab92-786e6ac8c572 admin admin] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:30:55.094912 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: INFO nova.api.openstack.requestlog [None req-0df6edba-9d46-4910-ab92-786e6ac8c572 admin admin] 10.222.0.121 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.093858 Aug 04 10:30:55.095397 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: [pid: 103260|app: 0|req: 39/76] 10.222.0.121 () {60 vars in 1198 bytes} [Thu Aug 4 10:30:54 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:31:54.488227 dv-cinder-852003-1-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 04 10:31:54.489201 dv-cinder-852003-1-iscsi devstack@n-api.service[103258]: Thu Aug 4 10:31:54 2022 - graceful shutdown triggered... Aug 04 10:31:54.489786 dv-cinder-852003-1-iscsi devstack@n-api.service[103259]: Gracefully killing worker 1 (pid: 103259)... Aug 04 10:31:54.490170 dv-cinder-852003-1-iscsi devstack@n-api.service[103260]: Gracefully killing worker 2 (pid: 103260)... Aug 04 10:31:55.490424 dv-cinder-852003-1-iscsi devstack@n-api.service[103258]: worker 1 buried after 1 seconds Aug 04 10:31:55.491286 dv-cinder-852003-1-iscsi devstack@n-api.service[103258]: worker 2 buried after 1 seconds Aug 04 10:31:55.491286 dv-cinder-852003-1-iscsi devstack@n-api.service[103258]: goodbye to uWSGI. Aug 04 10:31:55.492874 dv-cinder-852003-1-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 04 10:31:55.493598 dv-cinder-852003-1-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 04 10:31:55.497643 dv-cinder-852003-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 04 10:31:55.512248 dv-cinder-852003-1-iscsi devstack@n-api.service[124443]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 04 10:31:55.515927 dv-cinder-852003-1-iscsi devstack@n-api.service[124443]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Aug 4 10:31:55 2022] *** Aug 04 10:31:55.515927 dv-cinder-852003-1-iscsi devstack@n-api.service[124443]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 04 10:31:55.515927 dv-cinder-852003-1-iscsi devstack@n-api.service[124443]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 04 10:31:55.515927 dv-cinder-852003-1-iscsi devstack@n-api.service[124443]: nodename: dv-cinder-852003-1-iscsi Aug 04 10:31:55.515927 dv-cinder-852003-1-iscsi devstack@n-api.service[124443]: machine: x86_64 Aug 04 10:31:55.515927 dv-cinder-852003-1-iscsi devstack@n-api.service[124443]: clock source: unix Aug 04 10:31:55.515927 dv-cinder-852003-1-iscsi devstack@n-api.service[124443]: pcre jit disabled Aug 04 10:31:55.515927 dv-cinder-852003-1-iscsi devstack@n-api.service[124443]: detected number of CPU cores: 4 Aug 04 10:31:55.515927 dv-cinder-852003-1-iscsi devstack@n-api.service[124443]: current working directory: / Aug 04 10:31:55.515927 dv-cinder-852003-1-iscsi devstack@n-api.service[124443]: detected binary path: /usr/bin/uwsgi-core Aug 04 10:31:55.515927 dv-cinder-852003-1-iscsi devstack@n-api.service[124443]: your processes number limit is 47680 Aug 04 10:31:55.515927 dv-cinder-852003-1-iscsi devstack@n-api.service[124443]: your memory page size is 4096 bytes Aug 04 10:31:55.515927 dv-cinder-852003-1-iscsi devstack@n-api.service[124443]: detected max file descriptor number: 2048 Aug 04 10:31:55.515927 dv-cinder-852003-1-iscsi devstack@n-api.service[124443]: lock engine: pthread robust mutexes Aug 04 10:31:55.516990 dv-cinder-852003-1-iscsi devstack@n-api.service[124443]: thunder lock: enabled Aug 04 10:31:55.516990 dv-cinder-852003-1-iscsi devstack@n-api.service[124443]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 04 10:31:55.516990 dv-cinder-852003-1-iscsi devstack@n-api.service[124443]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 04 10:31:55.558495 dv-cinder-852003-1-iscsi devstack@n-api.service[124443]: Python main interpreter initialized at 0x55b6380859c0 Aug 04 10:31:55.558495 dv-cinder-852003-1-iscsi devstack@n-api.service[124443]: python threads support enabled Aug 04 10:31:55.558495 dv-cinder-852003-1-iscsi devstack@n-api.service[124443]: your server socket listen backlog is limited to 100 connections Aug 04 10:31:55.558495 dv-cinder-852003-1-iscsi devstack@n-api.service[124443]: your mercy for graceful operations on workers is 90 seconds Aug 04 10:31:55.558994 dv-cinder-852003-1-iscsi devstack@n-api.service[124443]: mapped 403077 bytes (393 KB) for 2 cores Aug 04 10:31:55.558994 dv-cinder-852003-1-iscsi devstack@n-api.service[124443]: *** Operational MODE: preforking *** Aug 04 10:31:55.559245 dv-cinder-852003-1-iscsi devstack@n-api.service[124443]: *** uWSGI is running in multiple interpreter mode *** Aug 04 10:31:55.559245 dv-cinder-852003-1-iscsi devstack@n-api.service[124443]: spawned uWSGI master process (pid: 124443) Aug 04 10:31:55.559484 dv-cinder-852003-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 04 10:31:55.560585 dv-cinder-852003-1-iscsi devstack@n-api.service[124443]: spawned uWSGI worker 1 (pid: 124456, cores: 1) Aug 04 10:31:55.560585 dv-cinder-852003-1-iscsi devstack@n-api.service[124443]: spawned uWSGI worker 2 (pid: 124457, cores: 1) Aug 04 10:31:55.560932 dv-cinder-852003-1-iscsi devstack@n-api.service[124443]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 04 10:31:56.233052 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 04 10:31:56.247317 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 04 10:31:57.394845 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 04 10:31:57.394845 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: from cryptography.utils import int_from_bytes Aug 04 10:31:57.395684 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 04 10:31:57.395684 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: from cryptography.utils import int_from_bytes Aug 04 10:31:57.460261 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 04 10:31:57.460261 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: from cryptography.utils import int_from_bytes Aug 04 10:31:57.460980 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 04 10:31:57.460980 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: from cryptography.utils import int_from_bytes Aug 04 10:31:59.744099 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 04 10:31:59.744762 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 04 10:31:59.744980 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 04 10:31:59.745319 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 04 10:31:59.745513 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 04 10:31:59.745918 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.746262 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.746592 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.746921 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.747246 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.747585 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.747909 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.748270 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.748610 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.748880 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.749208 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.749545 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852003-1-iscsi {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.749877 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.750183 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.750497 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.750831 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.751149 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.751553 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.751874 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.752419 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.754081 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.754081 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.754081 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.754081 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.754486 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.754486 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.754827 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.755108 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.755449 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.755767 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.756217 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852003-1-iscsi {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.756540 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.756861 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.757185 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.757617 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.757937 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.758259 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.758587 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.758922 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.759264 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.759593 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.759915 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.760276 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.760607 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.760922 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.761233 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.761569 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.761884 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.762201 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.762518 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.762779 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.763114 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.763438 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.763771 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.764138 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.764396 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.764656 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.765012 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.765335 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.765654 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.765970 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.766289 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.766603 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.766946 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.767269 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.767587 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.767904 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.768259 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.768601 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.768936 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.769256 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.769577 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.770011 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.121 {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.770270 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.121 {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.770584 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.770936 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.771355 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.771667 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.772117 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.772376 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.772697 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.773022 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.773341 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.773671 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.774011 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.774328 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.774589 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.774906 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.775225 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.775562 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.775884 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.776864 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.777199 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.777518 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.777845 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.778168 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.778492 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.778813 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.779138 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.779503 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.779827 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.780661 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.780661 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.780866 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.781129 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.781445 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.781948 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.782528 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.782854 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.783196 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.783518 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.783828 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.784228 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.784550 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.784885 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.785203 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.785505 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.785833 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.786181 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.786488 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.786807 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.787136 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.787456 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.787775 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.788116 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.788438 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.788755 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.789067 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.789384 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.789702 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.790009 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.790338 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.790671 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.790991 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.791312 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.791628 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.791965 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.792330 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.792677 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.793045 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.793374 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.793724 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.794071 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.794402 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.794725 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.795053 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.795390 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.795715 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.796081 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.796397 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.796724 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.797054 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.797395 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.797723 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.798114 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.798422 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.798754 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.799083 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.799427 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.799760 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.800126 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.800484 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.800844 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.801173 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.801508 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.801844 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.802169 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.802492 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.802819 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.803153 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.803502 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.803826 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.804351 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.804673 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.805005 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.805342 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.805669 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.805984 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.806336 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.806665 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.806990 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.807314 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.807643 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.807993 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.808318 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.808643 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.808961 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.809277 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.809593 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.809916 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.810232 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.810566 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.810905 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.811222 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.811572 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.811888 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.812241 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.812564 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.812896 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.813288 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.813615 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.814036 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.814356 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.814692 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.815016 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.815413 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.815680 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.816070 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.816307 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.816638 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.816955 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.817276 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.817598 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.817923 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.818261 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.818586 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.818910 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.819258 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.819603 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.819926 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.820283 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.820623 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.820956 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.821265 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.821587 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.821928 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.822213 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.822528 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.822854 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.823169 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.823483 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.823797 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.824140 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.824454 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.824785 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.825107 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.825571 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.825789 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.826054 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.826437 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.826708 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.827061 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.827410 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.827745 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.828103 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.828432 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.828760 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.829082 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.829443 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.829769 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.830142 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.830477 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.830801 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.831130 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.831450 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.831785 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.832142 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.832469 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.832790 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.833119 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.833471 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.833815 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.834146 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.834535 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.834847 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.835174 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.835495 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.835835 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.836170 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.836569 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.836837 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.837159 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.837452 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.837773 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.838105 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.838426 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.838754 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.839067 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.839391 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.839731 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.840132 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.840414 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.840737 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.841068 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.841388 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.841847 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.842025 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.842341 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.842657 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.843054 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.843415 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.843748 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.844107 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.844429 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.844755 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.845135 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.845497 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.845634 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 04 10:31:59.846421 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.846561 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 04 10:31:59.846903 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.846903 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.847077 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 04 10:31:59.847173 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.847279 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 04 10:31:59.847279 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 04 10:31:59.847450 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.847450 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.847712 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.847832 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.847922 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.848045 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.848329 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.848448 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.848537 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.848635 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.848872 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.848969 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.849180 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.849275 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.849493 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.849599 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.849814 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.849910 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.850148 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.850989 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.851102 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.851192 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.851289 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.851391 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.851480 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852003-1-iscsi {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.851576 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.851672 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.851760 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.851899 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.852038 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.852130 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.852212 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.852287 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.852359 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.852580 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.852677 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.852906 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.853001 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.853216 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.853311 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.853893 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.854042 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.854214 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.854357 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.854537 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.854667 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.854859 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.854981 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.855195 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.855326 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.855516 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.855643 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.855838 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.855980 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.856191 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.856633 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.856757 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.857110 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.857205 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.857282 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.857355 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.857441 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.857600 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852003-1-iscsi {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.857694 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.857920 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.858044 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.858238 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.858548 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.858664 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.858742 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.858957 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.859052 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.859272 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.859357 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.859587 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.859680 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.859914 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.860068 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.862654 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.862864 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.863041 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.863237 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.863491 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.863692 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.864136 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.864325 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.864484 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.864648 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.864812 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.864978 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.865136 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.865290 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.865637 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.865807 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.865964 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.866148 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.866325 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.866809 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.866960 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.867331 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.867331 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.867490 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.867566 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.867638 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.867710 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.867797 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.867898 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.868015 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.868114 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.868213 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.868300 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.868385 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.868484 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.868572 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.868572 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.868757 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.868833 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.868916 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.869012 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.869112 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.869199 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.869285 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.869389 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.869491 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.869585 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.869678 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.869764 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.869849 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.869942 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.870042 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.870137 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.870234 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.870322 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.870414 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.870514 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.870604 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.870698 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.870784 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.870878 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.870964 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.871058 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.871146 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.871231 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.871315 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.871408 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.871494 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.871588 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.121 {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.871682 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.871776 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.121 {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.871858 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.871932 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.872247 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.872343 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.872426 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.872508 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.872589 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.872663 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.872759 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.872847 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.872933 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.873026 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.873121 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.873208 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.873375 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.873475 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.873590 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.873757 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.873915 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.874079 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.874236 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.874406 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.874549 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.874713 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.874861 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.874965 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.875183 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.875292 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.875504 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.875599 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.875818 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.875923 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.876189 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.876301 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.876501 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.876605 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.876863 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.876979 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.877123 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.877231 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.877467 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.877560 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.877710 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.877821 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.878018 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.878114 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.878334 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.878437 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.878639 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.878742 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.878946 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.879050 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.879255 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.879350 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.879564 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.879663 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.879871 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.880002 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.880216 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.880360 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.880529 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.880687 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.880844 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.880999 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.881164 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.881308 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.881496 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.881622 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.881822 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.881927 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.882136 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.882293 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.882456 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.882558 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.882774 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.882883 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.883091 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.883186 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.883406 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.883502 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.883724 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.883832 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.884062 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.884162 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.884372 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.884464 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.884682 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.884799 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.885007 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.885215 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.885333 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.885532 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.885637 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.885864 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.885959 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.886185 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.886279 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.886497 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.886600 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.886804 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.886939 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.887115 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.887220 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.887511 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.887635 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.887743 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.887832 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.888074 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.888189 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.888350 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.888454 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.888651 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.888747 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.888971 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.889065 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.889296 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.889391 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.889608 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.889703 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.889918 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.890022 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.890230 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.890335 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.890553 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 10:31:59.890648 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.890896 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.890997 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.891216 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.891311 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.891533 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.891627 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.891897 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.892223 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.892370 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.892596 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.892691 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.892937 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.893048 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.893263 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.893349 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.893596 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.893679 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.893927 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.894020 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.894240 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.894362 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.894562 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.894665 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.895452 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.895558 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.895652 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.895795 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.895885 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.896047 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.896142 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.896227 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.896227 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.896429 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.896537 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.896655 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.896741 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.897066 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.897176 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.897299 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.897393 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.897721 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.897821 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.897941 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.898039 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.898281 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.898365 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.898594 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.898686 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.898905 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.898989 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.899240 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.899332 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.899557 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.899657 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.899880 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.900079 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.900236 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.900578 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.900893 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.901072 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.901211 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.901413 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.901519 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.901734 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.901843 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.902161 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.902288 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.902507 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.902617 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.902816 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.902912 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.903145 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.903244 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.903451 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.903565 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.903770 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.903873 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.904129 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.904462 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.904779 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.904873 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.905099 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.905264 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.905454 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.905591 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.905788 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.905937 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.906107 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.906209 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.906426 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.906521 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.906736 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.906878 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.907060 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.907172 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.907371 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.907497 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.907718 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.907836 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.908075 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.908189 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.908397 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.908493 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.908707 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.908818 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.909022 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.909120 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.909330 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.909426 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.909655 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.909785 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.909986 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.910096 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.910294 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.910400 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.910758 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.910946 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.911140 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.911250 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.911477 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.911581 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.911929 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.912072 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.912164 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.912403 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.912514 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.912722 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.912813 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.913037 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.913143 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.913350 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.913454 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.913679 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.913783 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.913995 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.914303 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.914414 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.914622 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.914725 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.914929 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.915026 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.915235 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.915330 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.915554 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.915672 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.915871 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.916002 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.916208 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.916306 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.916523 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.916618 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.916836 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.916941 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.917190 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.917301 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.917481 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.917608 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.917980 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.918099 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.918189 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.918283 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.918460 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.918568 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.918768 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.918889 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.919096 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.919201 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.919425 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.919537 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.919743 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.919848 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.920074 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.920189 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.920388 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.920498 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.920697 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.920808 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.921006 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.921309 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.921411 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.921627 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.921751 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.921937 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.922047 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.922247 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.922354 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.922543 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.922651 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.922851 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.922947 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.923233 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.923369 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.923556 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.923665 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.923870 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.924005 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.924204 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.924314 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.924510 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.924615 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.924817 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.924913 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.925164 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.925274 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.925476 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.925572 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.925792 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.925906 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.926109 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.926322 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.926418 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.926656 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.926751 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.926988 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.927092 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.927305 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.927402 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.927627 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.927767 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.928019 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.928135 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.928303 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.928438 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.928619 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.928705 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.929772 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.929932 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.930021 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.930103 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.930186 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.930260 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.930343 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.930424 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.930500 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.930580 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.930655 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.930728 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.930809 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.930891 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.931110 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.931418 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.931504 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.931806 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.931921 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.932101 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.932185 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.932428 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.932523 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.932749 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.932851 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.934141 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.934257 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.934352 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.934441 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.934548 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.934637 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.934732 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.934820 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.934916 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.935010 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.935107 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.935203 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.935300 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.935387 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.935473 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.935559 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.935660 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.935748 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.935834 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.936082 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.936208 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.936418 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.936598 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.936748 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.936852 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.937064 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.937528 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.937638 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.937724 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.937808 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.937959 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.938064 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.938143 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.938324 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.938435 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.938678 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.938783 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.938993 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.939081 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.939308 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.939428 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.939631 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.939726 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.939964 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.940075 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.940274 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.940378 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.940589 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.940686 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.940900 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.941211 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.941328 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.941522 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.941694 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.941850 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.942031 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.942165 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.942359 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.942466 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.942686 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.942802 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.943019 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.943127 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.943345 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.943449 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.943669 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.943772 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.943993 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.944164 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.944310 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.944396 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.944631 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.944726 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.944945 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.945048 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.945269 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.945373 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.945592 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.945683 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.945899 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.946003 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.946201 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.946304 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.946522 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.946617 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.946839 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.946943 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.947146 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.947241 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.947452 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.947546 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.947757 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.947861 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.948183 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.948292 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.949026 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.949154 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.949247 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.949342 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.949430 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.949516 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.949610 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.949708 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.949796 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.949882 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.950069 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.950165 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.950391 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.950494 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.950706 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.950846 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.951027 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.951139 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.951335 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.951443 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.951644 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.951797 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.952022 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.952188 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.952298 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.952521 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.952617 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.952864 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.952967 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.953191 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.953296 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.953501 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.953604 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.953814 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.953926 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.954156 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.954401 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.954510 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.954732 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.954828 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.955077 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.955182 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.955414 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.955701 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.955805 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.956075 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.956177 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.956401 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.956498 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.956730 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.956827 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.957044 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.957146 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.957359 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.957465 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.957705 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.957824 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.958005 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.958138 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.958320 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.958528 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.958652 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.958788 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.958973 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.959106 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.959287 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.959417 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.959618 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.959727 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.959938 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.960105 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.960353 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.960506 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.960663 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.960872 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.961100 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.961203 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.961299 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.961532 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.961651 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.961856 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.961998 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.962163 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.962334 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.962472 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.962660 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.962789 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.963001 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.963096 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.963321 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.963416 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.963638 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.963742 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.963986 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.964099 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.964313 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.964409 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.964618 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.964720 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.964924 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.965019 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.965286 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.965404 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.965547 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.965654 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.965862 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.965966 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.966182 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.966284 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.966497 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.966591 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.966839 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.966984 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.967145 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.967240 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.967457 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.967558 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.967773 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.967880 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.968104 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.968211 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.968411 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.968495 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.968724 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.968831 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.969031 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.969165 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.969340 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.969428 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.969645 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.969731 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.969984 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.970070 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.970296 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.970379 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.970606 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.970691 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.970918 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.971009 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.971223 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.971317 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.971593 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.971692 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.971834 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.973138 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.973325 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.973486 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.973656 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.973813 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.973988 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.974147 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.974303 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.974473 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.974646 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.974805 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.974959 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.975122 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.975221 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.975321 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.975409 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.975505 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.975593 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.975681 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.975767 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.975905 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.976024 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.976024 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.976175 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.976274 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.976371 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.976474 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.976567 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.976650 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.976737 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.976823 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.977143 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.977246 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.977468 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.977606 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.977775 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.977890 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.978106 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.978201 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.978421 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.978841 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.979042 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.979177 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.979343 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.979431 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.979654 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.979748 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.979995 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.980096 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.980320 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.980423 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.980652 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.980756 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.980941 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.981042 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.981259 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.981354 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.981563 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.981681 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.981895 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.982003 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.982256 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.982356 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.982530 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.982651 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.982850 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.982964 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.983155 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.983284 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.983459 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.983611 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.984049 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.984162 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.984268 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.984367 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.984467 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.984636 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.984785 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.984956 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.985054 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.985284 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.985379 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.985690 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.985803 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.986002 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.986107 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.986321 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.986480 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.986698 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.986808 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.986974 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.987061 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.987306 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.987406 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.987633 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.987730 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.987978 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.988118 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.988301 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.988402 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.988621 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.988727 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.988945 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.989088 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.989277 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.989377 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.989575 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.989671 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.989895 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.989997 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.990200 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.990296 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.990602 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.990697 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.990935 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.991041 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.991259 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.991364 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.991582 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.991687 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.991908 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.992054 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.992369 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.992495 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.992587 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.992683 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.992959 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.993183 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.993281 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.993508 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.993613 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.993824 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.993927 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.994137 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.994242 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.994451 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.994547 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.994766 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.994862 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.995082 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.995302 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.995417 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.995504 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.995698 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.995840 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.996036 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.996156 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.996353 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.996448 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.996671 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.996782 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.996997 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.997117 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.997307 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.997403 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.997622 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.997718 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.997936 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.998033 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.998244 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.998346 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.998552 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.998646 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.998856 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.998951 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.999168 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.999264 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.999476 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.999573 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.999787 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:31:59.999931 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.000136 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.000232 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.000453 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.000568 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.000767 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.000871 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.001108 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.001223 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.001475 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.001585 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.001796 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.001892 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.002113 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.002217 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.002451 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.002571 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.002759 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.002853 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.003078 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.003183 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.003412 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.003517 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.003745 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.003850 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.004100 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.004199 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.004422 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.004532 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.004771 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.004867 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.005093 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.005189 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.005417 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.005522 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.005741 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.005842 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.006051 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.006145 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.006371 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.006467 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.006680 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.006782 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.007075 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.007191 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.007345 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.007452 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.007663 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.007770 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.008025 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.008138 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.008359 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.008462 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.008693 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.008798 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.009024 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.009130 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.009351 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.009447 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.009680 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.009774 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.010002 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.010108 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.010308 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.010412 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.010623 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.010726 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.010937 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.011047 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.011258 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.011354 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.011584 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.011692 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.011904 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.012087 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.012266 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.012362 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.013389 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.013506 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.013596 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.013674 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.013755 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.013837 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.013919 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.013994 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.014081 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.014157 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.014157 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.014289 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.014500 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.014587 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.014825 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.014917 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.015153 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.015248 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.015483 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.015594 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.015795 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.015881 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.016129 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.016217 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.016469 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.016587 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.016857 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.017207 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 04 10:32:00.017983 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.018313 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.018660 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.018984 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.019313 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.019644 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.020080 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.020501 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.020829 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.021166 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.021483 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.021817 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.022213 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.022478 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.022812 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.023272 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.023461 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.023824 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.024122 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.024439 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.024750 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.025511 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.025511 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.025759 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.026129 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.026469 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.026913 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.027157 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.027497 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.027823 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.028180 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.028515 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.028830 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.029140 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.029458 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.029771 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.030083 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.030391 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.030707 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.031016 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.031324 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.031632 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.032011 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.032369 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.032700 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.033086 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.033429 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.033636 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.033944 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.034298 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.034610 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.034948 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.035265 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.035595 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.035935 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.036540 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.036871 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.037193 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.037518 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.037841 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.038169 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.038484 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.038805 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.039128 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.039456 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.040080 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.040415 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.040738 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.041060 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.041385 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.041710 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.042057 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.042357 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.042675 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.042989 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.043306 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.043652 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.044095 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.044336 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.044681 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.045009 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.045329 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.045652 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.045972 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.046343 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.046668 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.046974 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.047292 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.047620 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.047972 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.048374 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.048717 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.049036 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.049353 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.049673 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.050140 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.050311 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.050631 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.050985 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.051337 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.051666 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.052008 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.052593 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.052921 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.053511 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.053834 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.054175 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.054504 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.054833 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.055159 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.055485 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.055832 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.056163 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.056472 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.056789 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.057671 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.057671 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.057886 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.058093 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.058369 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.058652 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.059463 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.059580 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.059911 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.061879 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.061879 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.061879 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.061879 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.061879 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.061879 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.062453 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.062453 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.063395 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.063395 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.063395 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.064365 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.064365 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.064760 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.064760 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.065159 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.065391 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.068613 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.068613 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.068613 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.068613 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.069137 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.069639 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.069994 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.073067 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.073067 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.073067 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.073067 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.073495 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.073583 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.073960 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.074161 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.074485 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.074800 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.075144 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.075461 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.075828 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.076195 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.076521 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.076893 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.081974 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.081974 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.081974 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.081974 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.081974 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.081974 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.081974 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.083405 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.083405 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.083405 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.083405 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.083405 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.083933 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.084094 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.084902 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.084902 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.085106 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.085340 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.085619 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.085939 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.086700 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.086837 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.087256 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.087448 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.087767 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.088124 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.088446 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.088779 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.089143 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.089476 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.089807 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.090128 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.090459 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.090776 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.091094 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.091407 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.091723 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.092077 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.092409 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.092735 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.093056 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.094150 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.094150 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.094479 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.094793 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.095137 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.095473 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.095807 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.096169 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.096499 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.096819 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.097157 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.097586 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.097829 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.098466 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.098786 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.099112 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.099411 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.099731 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.100140 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.100507 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.100820 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.101129 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.101447 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.101759 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.102073 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.102385 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.102696 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.103011 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.103325 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.103972 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.104308 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.104618 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.104929 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.105239 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.105555 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.105863 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.106175 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.106481 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.106790 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.107096 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.107446 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.107784 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.108134 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.108461 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.108778 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.109106 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.109423 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.109773 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.110190 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.110652 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.110975 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.111322 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.111643 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.112000 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.112330 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.112724 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.113153 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.113474 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.113925 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.114429 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.114907 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.115208 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.115560 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.115893 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.116345 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.116702 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.117064 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.117565 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.117953 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.118281 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.118605 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.118927 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.119609 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.119609 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.119882 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.120441 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.120947 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.121296 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.121632 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.121982 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.122288 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.122621 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.123335 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.123335 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.123646 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.123977 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.124459 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.124905 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.125121 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 10:32:00.125324 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 04 10:32:00.191310 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO dbcounter [None req-f7f0732e-ff47-44ac-88b0-09a08c22e0a7 None None] Registered counter for database nova_api Aug 04 10:32:00.215434 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_db.sqlalchemy.engines [None req-f7f0732e-ff47-44ac-88b0-09a08c22e0a7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124457) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 10:32:00.226208 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG dbcounter [-] [124457] Writer thread running {{(pid=124457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 10:32:00.283354 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO dbcounter [None req-b70a6c71-7b48-4a80-a7e2-5316a09bc321 None None] Registered counter for database nova_api Aug 04 10:32:00.291447 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.context [None req-f7f0732e-ff47-44ac-88b0-09a08c22e0a7 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e4c5daf7-b6c6-4192-b3cd-ab91ed13477f(cell1) {{(pid=124457) load_cells /opt/stack/nova/nova/context.py:464}} Aug 04 10:32:00.296058 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-f7f0732e-ff47-44ac-88b0-09a08c22e0a7 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:32:00.297697 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-f7f0732e-ff47-44ac-88b0-09a08c22e0a7 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:32:00.298588 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-f7f0732e-ff47-44ac-88b0-09a08c22e0a7 None None] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:32:00.300796 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-f7f0732e-ff47-44ac-88b0-09a08c22e0a7 None None] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:32:00.302949 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO dbcounter [None req-f7f0732e-ff47-44ac-88b0-09a08c22e0a7 None None] Registered counter for database nova_cell0 Aug 04 10:32:00.305274 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_db.sqlalchemy.engines [None req-b70a6c71-7b48-4a80-a7e2-5316a09bc321 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124456) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 10:32:00.307296 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO dbcounter [None req-f7f0732e-ff47-44ac-88b0-09a08c22e0a7 None None] Registered counter for database nova_cell1 Aug 04 10:32:00.312696 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG dbcounter [-] [124456] Writer thread running {{(pid=124456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 10:32:00.316012 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_db.sqlalchemy.engines [None req-f7f0732e-ff47-44ac-88b0-09a08c22e0a7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124457) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 10:32:00.317404 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_db.sqlalchemy.engines [None req-f7f0732e-ff47-44ac-88b0-09a08c22e0a7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124457) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 10:32:00.324929 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG dbcounter [-] [124457] Writer thread running {{(pid=124457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 10:32:00.327618 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG dbcounter [-] [124457] Writer thread running {{(pid=124457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 10:32:00.373162 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.context [None req-b70a6c71-7b48-4a80-a7e2-5316a09bc321 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e4c5daf7-b6c6-4192-b3cd-ab91ed13477f(cell1) {{(pid=124456) load_cells /opt/stack/nova/nova/context.py:464}} Aug 04 10:32:00.377624 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-b70a6c71-7b48-4a80-a7e2-5316a09bc321 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:32:00.379411 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-b70a6c71-7b48-4a80-a7e2-5316a09bc321 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:32:00.380294 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-b70a6c71-7b48-4a80-a7e2-5316a09bc321 None None] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:32:00.382390 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-b70a6c71-7b48-4a80-a7e2-5316a09bc321 None None] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:32:00.384512 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO dbcounter [None req-b70a6c71-7b48-4a80-a7e2-5316a09bc321 None None] Registered counter for database nova_cell0 Aug 04 10:32:00.388751 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO dbcounter [None req-b70a6c71-7b48-4a80-a7e2-5316a09bc321 None None] Registered counter for database nova_cell1 Aug 04 10:32:00.396642 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_db.sqlalchemy.engines [None req-b70a6c71-7b48-4a80-a7e2-5316a09bc321 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124456) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 10:32:00.397960 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_db.sqlalchemy.engines [None req-b70a6c71-7b48-4a80-a7e2-5316a09bc321 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124456) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 10:32:00.404349 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG dbcounter [-] [124456] Writer thread running {{(pid=124456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 10:32:00.406991 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG dbcounter [-] [124456] Writer thread running {{(pid=124456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 10:32:00.479216 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO dbcounter [None req-f7f0732e-ff47-44ac-88b0-09a08c22e0a7 None None] Registered counter for database nova_cell0 Aug 04 10:32:00.486835 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_db.sqlalchemy.engines [None req-f7f0732e-ff47-44ac-88b0-09a08c22e0a7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124457) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 10:32:00.492380 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG dbcounter [-] [124457] Writer thread running {{(pid=124457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 10:32:00.558661 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO dbcounter [None req-b70a6c71-7b48-4a80-a7e2-5316a09bc321 None None] Registered counter for database nova_cell0 Aug 04 10:32:00.566564 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_db.sqlalchemy.engines [None req-b70a6c71-7b48-4a80-a7e2-5316a09bc321 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124456) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 10:32:00.572498 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG dbcounter [-] [124456] Writer thread running {{(pid=124456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 10:32:00.815719 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: WARNING keystonemiddleware.auth_token [None req-f7f0732e-ff47-44ac-88b0-09a08c22e0a7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 04 10:32:00.823585 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: WARNING keystonemiddleware.auth_token [None req-f7f0732e-ff47-44ac-88b0-09a08c22e0a7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 04 10:32:00.903214 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: WARNING keystonemiddleware.auth_token [None req-b70a6c71-7b48-4a80-a7e2-5316a09bc321 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 04 10:32:00.911102 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: WARNING keystonemiddleware.auth_token [None req-b70a6c71-7b48-4a80-a7e2-5316a09bc321 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 04 10:32:01.174899 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: WARNING keystonemiddleware.auth_token [None req-f7f0732e-ff47-44ac-88b0-09a08c22e0a7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 04 10:32:01.181420 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: WARNING keystonemiddleware.auth_token [None req-f7f0732e-ff47-44ac-88b0-09a08c22e0a7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 04 10:32:01.188085 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55b6380859c0 pid: 124457 (default app) Aug 04 10:32:01.278272 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: WARNING keystonemiddleware.auth_token [None req-b70a6c71-7b48-4a80-a7e2-5316a09bc321 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 04 10:32:01.285676 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: WARNING keystonemiddleware.auth_token [None req-b70a6c71-7b48-4a80-a7e2-5316a09bc321 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 04 10:32:01.292009 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55b6380859c0 pid: 124456 (default app) Aug 04 10:32:38.099359 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG dbcounter [-] [124457] Writing DB stats nova_api:SELECT=3 {{(pid=124457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:32:38.101398 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG dbcounter [-] [124457] Writing DB stats nova_cell0:SELECT=3 {{(pid=124457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:32:38.104560 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG dbcounter [-] [124457] Writing DB stats nova_cell1:SELECT=3 {{(pid=124457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:32:38.105271 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG dbcounter [-] [124457] Writing DB stats nova_cell0:SELECT=3 {{(pid=124457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:32:38.514015 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG dbcounter [-] [124456] Writing DB stats nova_api:SELECT=3 {{(pid=124456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:32:38.517332 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG dbcounter [-] [124456] Writing DB stats nova_cell0:SELECT=3 {{(pid=124456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:32:38.519519 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG dbcounter [-] [124456] Writing DB stats nova_cell1:SELECT=3 {{(pid=124456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:32:38.522037 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG dbcounter [-] [124456] Writing DB stats nova_cell0:SELECT=3 {{(pid=124456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:32:39.822428 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-9e9493a6-262d-4e22-b61b-e469265063fb tempest-VolumesNegativeTest-1945192045 tempest-VolumesNegativeTest-1945192045-project] Action: 'create', calling method: .version_select at 0x7f6756ed5d30>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-495000024", "metadata": {"Type": "work"}}} {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:32:39.852651 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-9e9493a6-262d-4e22-b61b-e469265063fb tempest-VolumesNegativeTest-1945192045 tempest-VolumesNegativeTest-1945192045-project] Request method failure captured: Aug 04 10:32:39.852651 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 04 10:32:39.852651 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: Accept: application/json Aug 04 10:32:39.852651 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: Accept-Encoding: identity Aug 04 10:32:39.852651 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: Connection: close Aug 04 10:32:39.852651 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: Content-Length: 121 Aug 04 10:32:39.852651 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: Content-Type: application/json Aug 04 10:32:39.852651 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: Host: 10.222.0.121 Aug 04 10:32:39.852651 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: Openstack-System-Scope: None Aug 04 10:32:39.852651 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: User-Agent: python-urllib3/1.26.11 Aug 04 10:32:39.852651 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Auth-Token: gAAAAABi66BFC1525_EvhWC6nqitMxMh6a0v7Vv6mTXYK088RpOxpFIsfq1Ig7HbhzYigSHUU5hNaW5-dliykHX4QJt_IIzda2n3rXYo0bBsigyVluCcAQAEzOtuqZxmsNCPJhXq5EKMUL14bNvTjt2-mGltr06pwQPYyFhegY6w4MEKOaQwULw Aug 04 10:32:39.852651 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Domain-Id: None Aug 04 10:32:39.852651 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Domain-Name: None Aug 04 10:32:39.852651 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Identity-Status: Confirmed Aug 04 10:32:39.852651 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Is-Admin-Project: True Aug 04 10:32:39.852651 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Project-Domain-Id: default Aug 04 10:32:39.852651 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Project-Domain-Name: Default Aug 04 10:32:39.852651 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Project-Id: 5d18be11fe1d499dac0af5ee521d0203 Aug 04 10:32:39.852651 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Project-Name: tempest-VolumesNegativeTest-1945192045 Aug 04 10:32:39.852651 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Role: reader,member Aug 04 10:32:39.852651 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Roles: reader,member Aug 04 10:32:39.854557 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/5d18be11fe1d499dac0af5ee521d0203"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/5d18be11fe1d499dac0af5ee521d0203"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.121:8080", "publicURL": "http://10.222.0.121:8080/v1/AUTH_5d18be11fe1d499dac0af5ee521d0203"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2/5d18be11fe1d499dac0af5ee521d0203"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:9696/networking"}]}] Aug 04 10:32:39.854557 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Tenant: tempest-VolumesNegativeTest-1945192045 Aug 04 10:32:39.854557 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Tenant-Id: 5d18be11fe1d499dac0af5ee521d0203 Aug 04 10:32:39.854557 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Tenant-Name: tempest-VolumesNegativeTest-1945192045 Aug 04 10:32:39.854557 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-User: tempest-VolumesNegativeTest-1945192045-project Aug 04 10:32:39.854557 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-User-Domain-Id: default Aug 04 10:32:39.854557 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-User-Domain-Name: Default Aug 04 10:32:39.854557 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-User-Id: 7631e70ced3b4e72b64d971d644fcab2 Aug 04 10:32:39.854557 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-User-Name: tempest-VolumesNegativeTest-1945192045-project Aug 04 10:32:39.854557 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: Aug 04 10:32:39.854557 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-495000024", "metadata": {"Type": "work"}}} Aug 04 10:32:39.854557 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: method: Aug 04 10:32:39.854557 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 04 10:32:39.855454 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-495000024', 'metadata': {'Type': 'work'}}}} Aug 04 10:32:39.855454 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 10:32:39.855454 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:32:39.855454 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 04 10:32:39.855454 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 04 10:32:39.855454 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 04 10:32:39.855454 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi raise error Aug 04 10:32:39.855454 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 04 10:32:39.855454 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Aug 04 10:32:39.855454 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 04 10:32:39.855454 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 04 10:32:39.855454 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Aug 04 10:32:39.855454 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 04 10:32:39.855454 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi '#$%' Aug 04 10:32:39.855454 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Aug 04 10:32:39.855454 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:32:39.855454 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Aug 04 10:32:39.855454 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:32:39.855454 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:32:39.855454 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:32:39.855454 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 10:32:39.855454 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 10:32:39.857354 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 10:32:39.857354 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 10:32:39.857354 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 10:32:39.857354 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 10:32:39.857354 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 04 10:32:39.857354 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 04 10:32:39.857354 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 04 10:32:39.857354 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 04 10:32:39.857354 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 04 10:32:39.857354 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 04 10:32:39.857354 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 04 10:32:39.857354 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Aug 04 10:32:39.857354 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:32:39.857354 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Aug 04 10:32:39.857354 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:32:39.857354 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:32:39.857354 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:32:39.857354 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 04 10:32:39.857354 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 04 10:32:39.860282 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 04 10:32:39.860282 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Aug 04 10:32:39.863590 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-9e9493a6-262d-4e22-b61b-e469265063fb tempest-VolumesNegativeTest-1945192045 tempest-VolumesNegativeTest-1945192045-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=124457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 10:32:39.869604 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-9e9493a6-262d-4e22-b61b-e469265063fb tempest-VolumesNegativeTest-1945192045 tempest-VolumesNegativeTest-1945192045-project] 10.222.0.121 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.791478 Aug 04 10:32:39.870433 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 1/1] 10.222.0.121 () {60 vars in 1161 bytes} [Thu Aug 4 10:32:38 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1794 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 04 10:32:39.892092 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-2fea7f48-6da2-4558-a2bd-9a59619a4b68 tempest-VolumesNegativeTest-1945192045 tempest-VolumesNegativeTest-1945192045-project] Action: 'create', calling method: .version_select at 0x7f6756dd04c0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-2015364306", "metadata": {"Type": "work"}}} {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:32:39.898531 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-2fea7f48-6da2-4558-a2bd-9a59619a4b68 tempest-VolumesNegativeTest-1945192045 tempest-VolumesNegativeTest-1945192045-project] Request method failure captured: Aug 04 10:32:39.898531 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 04 10:32:39.898531 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: Accept: application/json Aug 04 10:32:39.898531 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: Accept-Encoding: identity Aug 04 10:32:39.898531 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: Connection: close Aug 04 10:32:39.898531 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: Content-Length: 120 Aug 04 10:32:39.898531 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: Content-Type: application/json Aug 04 10:32:39.898531 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: Host: 10.222.0.121 Aug 04 10:32:39.898531 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: Openstack-System-Scope: None Aug 04 10:32:39.898531 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: User-Agent: python-urllib3/1.26.11 Aug 04 10:32:39.898531 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Auth-Token: gAAAAABi66BFC1525_EvhWC6nqitMxMh6a0v7Vv6mTXYK088RpOxpFIsfq1Ig7HbhzYigSHUU5hNaW5-dliykHX4QJt_IIzda2n3rXYo0bBsigyVluCcAQAEzOtuqZxmsNCPJhXq5EKMUL14bNvTjt2-mGltr06pwQPYyFhegY6w4MEKOaQwULw Aug 04 10:32:39.898531 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Domain-Id: None Aug 04 10:32:39.898531 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Domain-Name: None Aug 04 10:32:39.898531 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Identity-Status: Confirmed Aug 04 10:32:39.898531 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Is-Admin-Project: True Aug 04 10:32:39.898531 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Project-Domain-Id: default Aug 04 10:32:39.898531 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Project-Domain-Name: Default Aug 04 10:32:39.898531 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Project-Id: 5d18be11fe1d499dac0af5ee521d0203 Aug 04 10:32:39.898531 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Project-Name: tempest-VolumesNegativeTest-1945192045 Aug 04 10:32:39.898531 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Role: reader,member Aug 04 10:32:39.898531 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Roles: reader,member Aug 04 10:32:39.900025 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/5d18be11fe1d499dac0af5ee521d0203"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/5d18be11fe1d499dac0af5ee521d0203"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.121:8080", "publicURL": "http://10.222.0.121:8080/v1/AUTH_5d18be11fe1d499dac0af5ee521d0203"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2/5d18be11fe1d499dac0af5ee521d0203"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:9696/networking"}]}] Aug 04 10:32:39.900025 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Tenant: tempest-VolumesNegativeTest-1945192045 Aug 04 10:32:39.900025 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Tenant-Id: 5d18be11fe1d499dac0af5ee521d0203 Aug 04 10:32:39.900025 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Tenant-Name: tempest-VolumesNegativeTest-1945192045 Aug 04 10:32:39.900025 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-User: tempest-VolumesNegativeTest-1945192045-project Aug 04 10:32:39.900025 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-User-Domain-Id: default Aug 04 10:32:39.900025 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-User-Domain-Name: Default Aug 04 10:32:39.900025 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-User-Id: 7631e70ced3b4e72b64d971d644fcab2 Aug 04 10:32:39.900025 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-User-Name: tempest-VolumesNegativeTest-1945192045-project Aug 04 10:32:39.900025 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: Aug 04 10:32:39.900025 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-2015364306", "metadata": {"Type": "work"}}} Aug 04 10:32:39.900025 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: method: Aug 04 10:32:39.900025 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 04 10:32:39.901461 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-2015364306', 'metadata': {'Type': 'work'}}}} Aug 04 10:32:39.901461 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 10:32:39.901461 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:32:39.901461 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 04 10:32:39.901461 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 04 10:32:39.901461 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 04 10:32:39.901461 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi raise error Aug 04 10:32:39.901461 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 04 10:32:39.901461 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Aug 04 10:32:39.901461 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 04 10:32:39.901461 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 04 10:32:39.901461 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Aug 04 10:32:39.901461 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 04 10:32:39.901461 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi '0' Aug 04 10:32:39.901461 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Aug 04 10:32:39.901461 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:32:39.901461 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Aug 04 10:32:39.901461 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:32:39.901461 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:32:39.901461 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:32:39.901461 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 10:32:39.901461 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 10:32:39.902843 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 10:32:39.902843 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 10:32:39.902843 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 10:32:39.902843 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 10:32:39.902843 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 04 10:32:39.902843 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 04 10:32:39.902843 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 04 10:32:39.902843 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 04 10:32:39.902843 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 04 10:32:39.902843 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 04 10:32:39.902843 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 04 10:32:39.902843 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Aug 04 10:32:39.902843 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:32:39.902843 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Aug 04 10:32:39.902843 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:32:39.902843 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:32:39.902843 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:32:39.902843 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 04 10:32:39.902843 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 04 10:32:39.903996 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 04 10:32:39.903996 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Aug 04 10:32:39.909354 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-2fea7f48-6da2-4558-a2bd-9a59619a4b68 tempest-VolumesNegativeTest-1945192045 tempest-VolumesNegativeTest-1945192045-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=124457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 10:32:39.910949 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-2fea7f48-6da2-4558-a2bd-9a59619a4b68 tempest-VolumesNegativeTest-1945192045 tempest-VolumesNegativeTest-1945192045-project] 10.222.0.121 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.024733 Aug 04 10:32:39.914823 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 2/2] 10.222.0.121 () {60 vars in 1161 bytes} [Thu Aug 4 10:32:39 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 30 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 04 10:32:39.926759 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-a3899acd-4df5-4f1d-b411-f6a431546981 tempest-VolumesNegativeTest-1945192045 tempest-VolumesNegativeTest-1945192045-project] Action: 'create', calling method: .version_select at 0x7f6756d9f940>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-116895059", "metadata": {"Type": "work"}}} {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:32:39.930513 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-a3899acd-4df5-4f1d-b411-f6a431546981 tempest-VolumesNegativeTest-1945192045 tempest-VolumesNegativeTest-1945192045-project] Request method failure captured: Aug 04 10:32:39.930513 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 04 10:32:39.930513 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: Accept: application/json Aug 04 10:32:39.930513 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: Accept-Encoding: identity Aug 04 10:32:39.930513 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: Connection: close Aug 04 10:32:39.930513 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: Content-Length: 118 Aug 04 10:32:39.930513 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: Content-Type: application/json Aug 04 10:32:39.930513 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: Host: 10.222.0.121 Aug 04 10:32:39.930513 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: Openstack-System-Scope: None Aug 04 10:32:39.930513 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: User-Agent: python-urllib3/1.26.11 Aug 04 10:32:39.930513 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Auth-Token: gAAAAABi66BFC1525_EvhWC6nqitMxMh6a0v7Vv6mTXYK088RpOxpFIsfq1Ig7HbhzYigSHUU5hNaW5-dliykHX4QJt_IIzda2n3rXYo0bBsigyVluCcAQAEzOtuqZxmsNCPJhXq5EKMUL14bNvTjt2-mGltr06pwQPYyFhegY6w4MEKOaQwULw Aug 04 10:32:39.930513 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Domain-Id: None Aug 04 10:32:39.930513 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Domain-Name: None Aug 04 10:32:39.930513 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Identity-Status: Confirmed Aug 04 10:32:39.930513 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Is-Admin-Project: True Aug 04 10:32:39.930513 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Project-Domain-Id: default Aug 04 10:32:39.930513 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Project-Domain-Name: Default Aug 04 10:32:39.930513 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Project-Id: 5d18be11fe1d499dac0af5ee521d0203 Aug 04 10:32:39.930513 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Project-Name: tempest-VolumesNegativeTest-1945192045 Aug 04 10:32:39.930513 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Role: reader,member Aug 04 10:32:39.930513 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Roles: reader,member Aug 04 10:32:39.931998 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/5d18be11fe1d499dac0af5ee521d0203"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/5d18be11fe1d499dac0af5ee521d0203"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.121:8080", "publicURL": "http://10.222.0.121:8080/v1/AUTH_5d18be11fe1d499dac0af5ee521d0203"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2/5d18be11fe1d499dac0af5ee521d0203"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:9696/networking"}]}] Aug 04 10:32:39.931998 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Tenant: tempest-VolumesNegativeTest-1945192045 Aug 04 10:32:39.931998 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Tenant-Id: 5d18be11fe1d499dac0af5ee521d0203 Aug 04 10:32:39.931998 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Tenant-Name: tempest-VolumesNegativeTest-1945192045 Aug 04 10:32:39.931998 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-User: tempest-VolumesNegativeTest-1945192045-project Aug 04 10:32:39.931998 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-User-Domain-Id: default Aug 04 10:32:39.931998 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-User-Domain-Name: Default Aug 04 10:32:39.931998 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-User-Id: 7631e70ced3b4e72b64d971d644fcab2 Aug 04 10:32:39.931998 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-User-Name: tempest-VolumesNegativeTest-1945192045-project Aug 04 10:32:39.931998 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: Aug 04 10:32:39.931998 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-116895059", "metadata": {"Type": "work"}}} Aug 04 10:32:39.931998 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: method: Aug 04 10:32:39.931998 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 04 10:32:39.932804 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-116895059', 'metadata': {'Type': 'work'}}}} Aug 04 10:32:39.932804 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 10:32:39.932804 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:32:39.932804 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 04 10:32:39.932804 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 04 10:32:39.932804 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 04 10:32:39.932804 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi raise error Aug 04 10:32:39.932804 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 04 10:32:39.932804 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Aug 04 10:32:39.932804 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 04 10:32:39.932804 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 04 10:32:39.932804 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Aug 04 10:32:39.932804 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 04 10:32:39.932804 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi '' Aug 04 10:32:39.932804 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Aug 04 10:32:39.932804 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:32:39.932804 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Aug 04 10:32:39.932804 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:32:39.932804 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:32:39.932804 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:32:39.932804 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 10:32:39.932804 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 10:32:39.935304 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 10:32:39.935304 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 10:32:39.935304 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 10:32:39.935304 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 10:32:39.935304 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 04 10:32:39.935304 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 04 10:32:39.935304 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 04 10:32:39.935304 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 04 10:32:39.935304 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 04 10:32:39.935304 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 04 10:32:39.935304 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 04 10:32:39.935304 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Aug 04 10:32:39.935304 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:32:39.935304 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Aug 04 10:32:39.935304 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:32:39.935304 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:32:39.935304 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:32:39.935304 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 04 10:32:39.935304 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 04 10:32:39.936629 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 04 10:32:39.936629 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Aug 04 10:32:39.936629 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-a3899acd-4df5-4f1d-b411-f6a431546981 tempest-VolumesNegativeTest-1945192045 tempest-VolumesNegativeTest-1945192045-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=124457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 10:32:39.946704 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-a3899acd-4df5-4f1d-b411-f6a431546981 tempest-VolumesNegativeTest-1945192045 tempest-VolumesNegativeTest-1945192045-project] 10.222.0.121 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.010407 Aug 04 10:32:39.950329 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 3/3] 10.222.0.121 () {60 vars in 1161 bytes} [Thu Aug 4 10:32:39 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 29 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 04 10:32:39.963748 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-c84880cf-b2d5-48ae-9d23-127ce0395351 tempest-VolumesNegativeTest-1945192045 tempest-VolumesNegativeTest-1945192045-project] Calling method '.version_select at 0x7f6756d9f3a0>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:32:40.102114 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-35cc374d-8603-493d-89d8-db8dbdc7d951 tempest-VolumesSnapshotsTestJSON-644414039 tempest-VolumesSnapshotsTestJSON-644414039-project] Action: 'create', calling method: .version_select at 0x7f6756ec3dc0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-881855513"}} {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:32:41.018409 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.wsgi [None req-c84880cf-b2d5-48ae-9d23-127ce0395351 tempest-VolumesNegativeTest-1945192045 tempest-VolumesNegativeTest-1945192045-project] HTTP exception thrown: Volume tempest-invalid-1360106400 could not be found. Aug 04 10:32:41.023702 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-c84880cf-b2d5-48ae-9d23-127ce0395351 tempest-VolumesNegativeTest-1945192045 tempest-VolumesNegativeTest-1945192045-project] Request method failure captured: Aug 04 10:32:41.023702 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1360106400 HTTP/1.1 Aug 04 10:32:41.023702 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: Accept: application/json Aug 04 10:32:41.023702 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: Accept-Encoding: identity Aug 04 10:32:41.023702 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: Connection: close Aug 04 10:32:41.023702 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: Content-Length: 0 Aug 04 10:32:41.023702 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: Content-Type: application/json Aug 04 10:32:41.023702 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: Host: 10.222.0.121 Aug 04 10:32:41.023702 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: Openstack-System-Scope: None Aug 04 10:32:41.023702 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: User-Agent: python-urllib3/1.26.11 Aug 04 10:32:41.023702 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Auth-Token: gAAAAABi66BFC1525_EvhWC6nqitMxMh6a0v7Vv6mTXYK088RpOxpFIsfq1Ig7HbhzYigSHUU5hNaW5-dliykHX4QJt_IIzda2n3rXYo0bBsigyVluCcAQAEzOtuqZxmsNCPJhXq5EKMUL14bNvTjt2-mGltr06pwQPYyFhegY6w4MEKOaQwULw Aug 04 10:32:41.023702 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Domain-Id: None Aug 04 10:32:41.023702 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Domain-Name: None Aug 04 10:32:41.023702 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Identity-Status: Confirmed Aug 04 10:32:41.023702 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Is-Admin-Project: True Aug 04 10:32:41.023702 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Project-Domain-Id: default Aug 04 10:32:41.023702 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Project-Domain-Name: Default Aug 04 10:32:41.023702 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Project-Id: 5d18be11fe1d499dac0af5ee521d0203 Aug 04 10:32:41.023702 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Project-Name: tempest-VolumesNegativeTest-1945192045 Aug 04 10:32:41.023702 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Role: reader,member Aug 04 10:32:41.023702 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Roles: reader,member Aug 04 10:32:41.025532 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/5d18be11fe1d499dac0af5ee521d0203"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/5d18be11fe1d499dac0af5ee521d0203"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.121:8080", "publicURL": "http://10.222.0.121:8080/v1/AUTH_5d18be11fe1d499dac0af5ee521d0203"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2/5d18be11fe1d499dac0af5ee521d0203"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:9696/networking"}]}] Aug 04 10:32:41.025532 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Tenant: tempest-VolumesNegativeTest-1945192045 Aug 04 10:32:41.025532 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Tenant-Id: 5d18be11fe1d499dac0af5ee521d0203 Aug 04 10:32:41.025532 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Tenant-Name: tempest-VolumesNegativeTest-1945192045 Aug 04 10:32:41.025532 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-User: tempest-VolumesNegativeTest-1945192045-project Aug 04 10:32:41.025532 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-User-Domain-Id: default Aug 04 10:32:41.025532 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-User-Domain-Name: Default Aug 04 10:32:41.025532 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-User-Id: 7631e70ced3b4e72b64d971d644fcab2 Aug 04 10:32:41.025532 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-User-Name: tempest-VolumesNegativeTest-1945192045-project Aug 04 10:32:41.025532 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: method: Aug 04 10:32:41.025532 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: exception: Volume tempest-invalid-1360106400 could not be found. Aug 04 10:32:41.025532 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: action_args: {'id': 'tempest-invalid-1360106400'} Aug 04 10:32:41.025532 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 10:32:41.026592 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:32:41.026592 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 10:32:41.026592 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 10:32:41.026592 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 04 10:32:41.026592 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 04 10:32:41.026592 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 04 10:32:41.026592 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 04 10:32:41.026592 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 04 10:32:41.026592 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 04 10:32:41.026592 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 04 10:32:41.026592 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 04 10:32:41.026592 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 10:32:41.026592 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 10:32:41.026592 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 10:32:41.026592 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 10:32:41.026592 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1360106400 could not be found. (HTTP 404) (Request-ID: req-4c4bcf4c-7b9b-45d6-940a-8d593457c2e4) Aug 04 10:32:41.026592 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Aug 04 10:32:41.026592 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:32:41.026592 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Aug 04 10:32:41.028101 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:32:41.028101 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 04 10:32:41.028101 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 04 10:32:41.028101 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 04 10:32:41.028101 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 04 10:32:41.028101 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 04 10:32:41.028101 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 04 10:32:41.028101 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 04 10:32:41.028101 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 04 10:32:41.028101 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 10:32:41.028101 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 10:32:41.028101 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 04 10:32:41.028101 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 04 10:32:41.028101 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 04 10:32:41.028101 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 04 10:32:41.028101 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 04 10:32:41.028101 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 04 10:32:41.028101 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 04 10:32:41.028101 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 04 10:32:41.034058 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 10:32:41.034058 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 10:32:41.034058 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 10:32:41.034058 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 10:32:41.034058 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1360106400 could not be found. Aug 04 10:32:41.034058 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Aug 04 10:32:41.034058 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:32:41.034058 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Aug 04 10:32:41.034058 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:32:41.034058 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:32:41.034058 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:32:41.034058 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 10:32:41.034058 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 10:32:41.034058 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 10:32:41.034058 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 10:32:41.034058 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 10:32:41.034058 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 10:32:41.034058 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 04 10:32:41.034058 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 10:32:41.034058 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1360106400 could not be found. Aug 04 10:32:41.035752 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Aug 04 10:32:41.035752 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:32:41.035752 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Aug 04 10:32:41.035752 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:32:41.035752 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:32:41.035752 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:32:41.035752 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 10:32:41.035752 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 10:32:41.035752 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1360106400 could not be found. Aug 04 10:32:41.035752 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Aug 04 10:32:41.035752 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-c84880cf-b2d5-48ae-9d23-127ce0395351 tempest-VolumesNegativeTest-1945192045 tempest-VolumesNegativeTest-1945192045-project] Returning 404 to user: Volume tempest-invalid-1360106400 could not be found. {{(pid=124457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 10:32:41.035752 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-c84880cf-b2d5-48ae-9d23-127ce0395351 tempest-VolumesNegativeTest-1945192045 tempest-VolumesNegativeTest-1945192045-project] 10.222.0.121 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1360106400" status: 404 len: 99 microversion: 2.1 time: 1.071739 Aug 04 10:32:41.035752 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 4/4] 10.222.0.121 () {58 vars in 1223 bytes} [Thu Aug 4 10:32:39 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1360106400 => generated 99 bytes in 1075 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 04 10:32:41.050691 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-535230ce-0358-4223-8919-8e05c976282e tempest-VolumesNegativeTest-1945192045 tempest-VolumesNegativeTest-1945192045-project] 10.222.0.121 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.013231 Aug 04 10:32:41.051309 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 5/5] 10.222.0.121 () {58 vars in 1145 bytes} [Thu Aug 4 10:32:41 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 15 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 04 10:32:41.069661 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-0c7f15d3-213d-41a3-b911-3cfaf58d037c tempest-VolumesNegativeTest-1945192045 tempest-VolumesNegativeTest-1945192045-project] 10.222.0.121 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004171 Aug 04 10:32:41.086359 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 6/6] 10.222.0.121 () {58 vars in 1142 bytes} [Thu Aug 4 10:32:41 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 24 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 04 10:32:41.095508 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-100e84dc-9cbd-4171-ba57-d36ac5d56fa1 tempest-VolumesNegativeTest-1945192045 tempest-VolumesNegativeTest-1945192045-project] Calling method '.version_select at 0x7f6756ccec10>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:32:41.161155 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.wsgi [None req-100e84dc-9cbd-4171-ba57-d36ac5d56fa1 tempest-VolumesNegativeTest-1945192045 tempest-VolumesNegativeTest-1945192045-project] HTTP exception thrown: Volume 80464f62-dad2-404e-a4a5-fa124908576d could not be found. Aug 04 10:32:41.169560 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-100e84dc-9cbd-4171-ba57-d36ac5d56fa1 tempest-VolumesNegativeTest-1945192045 tempest-VolumesNegativeTest-1945192045-project] Request method failure captured: Aug 04 10:32:41.169560 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: request: DELETE /compute/v2.1/os-volumes/80464f62-dad2-404e-a4a5-fa124908576d HTTP/1.1 Aug 04 10:32:41.169560 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: Accept: application/json Aug 04 10:32:41.169560 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: Accept-Encoding: identity Aug 04 10:32:41.169560 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: Connection: close Aug 04 10:32:41.169560 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: Content-Length: 0 Aug 04 10:32:41.169560 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: Content-Type: application/json Aug 04 10:32:41.169560 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: Host: 10.222.0.121 Aug 04 10:32:41.169560 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: Openstack-System-Scope: None Aug 04 10:32:41.169560 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: User-Agent: python-urllib3/1.26.11 Aug 04 10:32:41.169560 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Auth-Token: gAAAAABi66BFC1525_EvhWC6nqitMxMh6a0v7Vv6mTXYK088RpOxpFIsfq1Ig7HbhzYigSHUU5hNaW5-dliykHX4QJt_IIzda2n3rXYo0bBsigyVluCcAQAEzOtuqZxmsNCPJhXq5EKMUL14bNvTjt2-mGltr06pwQPYyFhegY6w4MEKOaQwULw Aug 04 10:32:41.169560 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Domain-Id: None Aug 04 10:32:41.169560 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Domain-Name: None Aug 04 10:32:41.169560 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Identity-Status: Confirmed Aug 04 10:32:41.169560 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Is-Admin-Project: True Aug 04 10:32:41.169560 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Project-Domain-Id: default Aug 04 10:32:41.169560 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Project-Domain-Name: Default Aug 04 10:32:41.169560 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Project-Id: 5d18be11fe1d499dac0af5ee521d0203 Aug 04 10:32:41.169560 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Project-Name: tempest-VolumesNegativeTest-1945192045 Aug 04 10:32:41.169560 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Role: reader,member Aug 04 10:32:41.169560 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Roles: reader,member Aug 04 10:32:41.171034 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/5d18be11fe1d499dac0af5ee521d0203"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/5d18be11fe1d499dac0af5ee521d0203"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.121:8080", "publicURL": "http://10.222.0.121:8080/v1/AUTH_5d18be11fe1d499dac0af5ee521d0203"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2/5d18be11fe1d499dac0af5ee521d0203"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:9696/networking"}]}] Aug 04 10:32:41.171034 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Tenant: tempest-VolumesNegativeTest-1945192045 Aug 04 10:32:41.171034 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Tenant-Id: 5d18be11fe1d499dac0af5ee521d0203 Aug 04 10:32:41.171034 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Tenant-Name: tempest-VolumesNegativeTest-1945192045 Aug 04 10:32:41.171034 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-User: tempest-VolumesNegativeTest-1945192045-project Aug 04 10:32:41.171034 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-User-Domain-Id: default Aug 04 10:32:41.171034 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-User-Domain-Name: Default Aug 04 10:32:41.171034 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-User-Id: 7631e70ced3b4e72b64d971d644fcab2 Aug 04 10:32:41.171034 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-User-Name: tempest-VolumesNegativeTest-1945192045-project Aug 04 10:32:41.171034 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: method: Aug 04 10:32:41.171034 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: exception: Volume 80464f62-dad2-404e-a4a5-fa124908576d could not be found. Aug 04 10:32:41.171034 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: action_args: {'id': '80464f62-dad2-404e-a4a5-fa124908576d'} Aug 04 10:32:41.171034 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 10:32:41.171861 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:32:41.171861 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 10:32:41.171861 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 10:32:41.171861 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 04 10:32:41.171861 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 04 10:32:41.171861 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 04 10:32:41.171861 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 04 10:32:41.171861 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 04 10:32:41.171861 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 04 10:32:41.171861 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 04 10:32:41.171861 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 04 10:32:41.171861 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 10:32:41.171861 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 10:32:41.171861 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 10:32:41.171861 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 10:32:41.171861 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 80464f62-dad2-404e-a4a5-fa124908576d could not be found. (HTTP 404) (Request-ID: req-486870a9-511f-4192-897e-39ee037a4315) Aug 04 10:32:41.171861 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Aug 04 10:32:41.171861 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:32:41.171861 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Aug 04 10:32:41.173399 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:32:41.173399 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 04 10:32:41.173399 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 04 10:32:41.173399 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 04 10:32:41.173399 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 04 10:32:41.173399 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 04 10:32:41.173399 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 04 10:32:41.173399 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 04 10:32:41.173399 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 04 10:32:41.173399 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 10:32:41.173399 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 10:32:41.173399 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 04 10:32:41.173399 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 04 10:32:41.173399 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 04 10:32:41.173399 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 04 10:32:41.173399 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 04 10:32:41.173399 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 04 10:32:41.173399 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 04 10:32:41.173399 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 04 10:32:41.174550 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 10:32:41.174550 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 10:32:41.174550 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 10:32:41.174550 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 10:32:41.174550 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 80464f62-dad2-404e-a4a5-fa124908576d could not be found. Aug 04 10:32:41.174550 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Aug 04 10:32:41.174550 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:32:41.174550 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Aug 04 10:32:41.174550 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:32:41.174550 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:32:41.174550 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:32:41.174550 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 10:32:41.174550 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 10:32:41.174550 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 10:32:41.174550 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 10:32:41.174550 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 10:32:41.174550 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 10:32:41.174550 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 04 10:32:41.174550 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 10:32:41.175680 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 80464f62-dad2-404e-a4a5-fa124908576d could not be found. Aug 04 10:32:41.175680 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Aug 04 10:32:41.175680 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:32:41.175680 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Aug 04 10:32:41.175680 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:32:41.175680 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:32:41.175680 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:32:41.175680 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 10:32:41.175680 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 10:32:41.175680 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 80464f62-dad2-404e-a4a5-fa124908576d could not be found. Aug 04 10:32:41.175680 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Aug 04 10:32:41.175680 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-100e84dc-9cbd-4171-ba57-d36ac5d56fa1 tempest-VolumesNegativeTest-1945192045 tempest-VolumesNegativeTest-1945192045-project] Returning 404 to user: Volume 80464f62-dad2-404e-a4a5-fa124908576d could not be found. {{(pid=124457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 10:32:41.175680 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-100e84dc-9cbd-4171-ba57-d36ac5d56fa1 tempest-VolumesNegativeTest-1945192045 tempest-VolumesNegativeTest-1945192045-project] 10.222.0.121 "DELETE /compute/v2.1/os-volumes/80464f62-dad2-404e-a4a5-fa124908576d" status: 404 len: 109 microversion: 2.1 time: 0.088372 Aug 04 10:32:41.181622 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 7/7] 10.222.0.121 () {58 vars in 1253 bytes} [Thu Aug 4 10:32:41 2022] DELETE /compute/v2.1/os-volumes/80464f62-dad2-404e-a4a5-fa124908576d => generated 109 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 10:32:41.195691 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-9d6b3e88-7a93-40fd-a8bb-feb1ddde7f53 tempest-VolumesNegativeTest-1945192045 tempest-VolumesNegativeTest-1945192045-project] Calling method '.version_select at 0x7f6756ccedc0>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:32:41.398148 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.wsgi [None req-9d6b3e88-7a93-40fd-a8bb-feb1ddde7f53 tempest-VolumesNegativeTest-1945192045 tempest-VolumesNegativeTest-1945192045-project] HTTP exception thrown: Volume a2e04733-40d9-499b-8b6a-a5e5ef9310e6 could not be found. Aug 04 10:32:41.402091 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-9d6b3e88-7a93-40fd-a8bb-feb1ddde7f53 tempest-VolumesNegativeTest-1945192045 tempest-VolumesNegativeTest-1945192045-project] Request method failure captured: Aug 04 10:32:41.402091 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: request: GET /compute/v2.1/os-volumes/a2e04733-40d9-499b-8b6a-a5e5ef9310e6 HTTP/1.1 Aug 04 10:32:41.402091 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: Accept: application/json Aug 04 10:32:41.402091 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: Accept-Encoding: identity Aug 04 10:32:41.402091 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: Connection: close Aug 04 10:32:41.402091 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: Content-Length: 0 Aug 04 10:32:41.402091 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: Content-Type: application/json Aug 04 10:32:41.402091 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: Host: 10.222.0.121 Aug 04 10:32:41.402091 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: Openstack-System-Scope: None Aug 04 10:32:41.402091 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: User-Agent: python-urllib3/1.26.11 Aug 04 10:32:41.402091 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Auth-Token: gAAAAABi66BFC1525_EvhWC6nqitMxMh6a0v7Vv6mTXYK088RpOxpFIsfq1Ig7HbhzYigSHUU5hNaW5-dliykHX4QJt_IIzda2n3rXYo0bBsigyVluCcAQAEzOtuqZxmsNCPJhXq5EKMUL14bNvTjt2-mGltr06pwQPYyFhegY6w4MEKOaQwULw Aug 04 10:32:41.402091 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Domain-Id: None Aug 04 10:32:41.402091 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Domain-Name: None Aug 04 10:32:41.402091 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Identity-Status: Confirmed Aug 04 10:32:41.402091 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Is-Admin-Project: True Aug 04 10:32:41.402091 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Project-Domain-Id: default Aug 04 10:32:41.402091 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Project-Domain-Name: Default Aug 04 10:32:41.402091 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Project-Id: 5d18be11fe1d499dac0af5ee521d0203 Aug 04 10:32:41.402091 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Project-Name: tempest-VolumesNegativeTest-1945192045 Aug 04 10:32:41.402091 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Role: reader,member Aug 04 10:32:41.402091 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Roles: reader,member Aug 04 10:32:41.403624 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/5d18be11fe1d499dac0af5ee521d0203"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/5d18be11fe1d499dac0af5ee521d0203"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.121:8080", "publicURL": "http://10.222.0.121:8080/v1/AUTH_5d18be11fe1d499dac0af5ee521d0203"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2/5d18be11fe1d499dac0af5ee521d0203"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:9696/networking"}]}] Aug 04 10:32:41.403624 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Tenant: tempest-VolumesNegativeTest-1945192045 Aug 04 10:32:41.403624 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Tenant-Id: 5d18be11fe1d499dac0af5ee521d0203 Aug 04 10:32:41.403624 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Tenant-Name: tempest-VolumesNegativeTest-1945192045 Aug 04 10:32:41.403624 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-User: tempest-VolumesNegativeTest-1945192045-project Aug 04 10:32:41.403624 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-User-Domain-Id: default Aug 04 10:32:41.403624 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-User-Domain-Name: Default Aug 04 10:32:41.403624 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-User-Id: 7631e70ced3b4e72b64d971d644fcab2 Aug 04 10:32:41.403624 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-User-Name: tempest-VolumesNegativeTest-1945192045-project Aug 04 10:32:41.403624 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: method: Aug 04 10:32:41.403624 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: exception: Volume a2e04733-40d9-499b-8b6a-a5e5ef9310e6 could not be found. Aug 04 10:32:41.403624 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: action_args: {'id': 'a2e04733-40d9-499b-8b6a-a5e5ef9310e6'} Aug 04 10:32:41.403624 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 10:32:41.404495 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:32:41.404495 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 10:32:41.404495 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 10:32:41.404495 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 04 10:32:41.404495 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 04 10:32:41.404495 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 04 10:32:41.404495 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 04 10:32:41.404495 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 04 10:32:41.404495 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 04 10:32:41.404495 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 04 10:32:41.404495 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 04 10:32:41.404495 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 10:32:41.404495 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 10:32:41.404495 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 10:32:41.404495 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 10:32:41.404495 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume a2e04733-40d9-499b-8b6a-a5e5ef9310e6 could not be found. (HTTP 404) (Request-ID: req-5cbddb4e-f586-4aed-8442-394eb8f17cd7) Aug 04 10:32:41.404495 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Aug 04 10:32:41.404495 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:32:41.404495 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Aug 04 10:32:41.407041 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:32:41.407041 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 04 10:32:41.407041 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 04 10:32:41.407041 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 04 10:32:41.407041 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 04 10:32:41.407041 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 04 10:32:41.407041 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 04 10:32:41.407041 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 04 10:32:41.407041 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 04 10:32:41.407041 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 10:32:41.407041 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 10:32:41.407041 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 04 10:32:41.407041 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 04 10:32:41.407041 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 04 10:32:41.407041 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 04 10:32:41.407041 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 04 10:32:41.407041 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 04 10:32:41.407041 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 04 10:32:41.407041 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 04 10:32:41.409735 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 10:32:41.409735 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 10:32:41.409735 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 10:32:41.409735 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 10:32:41.409735 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume a2e04733-40d9-499b-8b6a-a5e5ef9310e6 could not be found. Aug 04 10:32:41.409735 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Aug 04 10:32:41.409735 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:32:41.409735 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Aug 04 10:32:41.409735 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:32:41.409735 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:32:41.409735 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:32:41.409735 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 10:32:41.409735 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 10:32:41.409735 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 10:32:41.409735 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 10:32:41.409735 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 10:32:41.409735 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 10:32:41.409735 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 04 10:32:41.409735 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 10:32:41.412926 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume a2e04733-40d9-499b-8b6a-a5e5ef9310e6 could not be found. Aug 04 10:32:41.412926 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Aug 04 10:32:41.412926 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:32:41.412926 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Aug 04 10:32:41.412926 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:32:41.412926 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:32:41.412926 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:32:41.412926 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 10:32:41.412926 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 10:32:41.412926 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume a2e04733-40d9-499b-8b6a-a5e5ef9310e6 could not be found. Aug 04 10:32:41.412926 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Aug 04 10:32:41.412926 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-9d6b3e88-7a93-40fd-a8bb-feb1ddde7f53 tempest-VolumesNegativeTest-1945192045 tempest-VolumesNegativeTest-1945192045-project] Returning 404 to user: Volume a2e04733-40d9-499b-8b6a-a5e5ef9310e6 could not be found. {{(pid=124457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 10:32:41.412926 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-9d6b3e88-7a93-40fd-a8bb-feb1ddde7f53 tempest-VolumesNegativeTest-1945192045 tempest-VolumesNegativeTest-1945192045-project] 10.222.0.121 "GET /compute/v2.1/os-volumes/a2e04733-40d9-499b-8b6a-a5e5ef9310e6" status: 404 len: 109 microversion: 2.1 time: 0.226669 Aug 04 10:32:41.412926 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 8/8] 10.222.0.121 () {58 vars in 1250 bytes} [Thu Aug 4 10:32:41 2022] GET /compute/v2.1/os-volumes/a2e04733-40d9-499b-8b6a-a5e5ef9310e6 => generated 109 bytes in 228 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 10:32:42.504585 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-35cc374d-8603-493d-89d8-db8dbdc7d951 tempest-VolumesSnapshotsTestJSON-644414039 tempest-VolumesSnapshotsTestJSON-644414039-project] 10.222.0.121 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 4.021418 Aug 04 10:32:42.505588 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 1/9] 10.222.0.121 () {60 vars in 1160 bytes} [Thu Aug 4 10:32:38 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 4024 msecs (HTTP/1.1 200) 10 headers in 449 bytes (2 switches on core 0) Aug 04 10:32:42.522467 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-4c9eb95b-f0f4-4616-a864-972ebbb935b6 tempest-VolumesSnapshotsTestJSON-644414039 tempest-VolumesSnapshotsTestJSON-644414039-project] Calling method '.version_select at 0x7f6756d9fdc0>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:32:42.736603 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-4c9eb95b-f0f4-4616-a864-972ebbb935b6 tempest-VolumesSnapshotsTestJSON-644414039 tempest-VolumesSnapshotsTestJSON-644414039-project] 10.222.0.121 "GET /compute/v2.1/os-volumes/b6b2670d-0db9-4734-a655-c372604f3b35" status: 200 len: 344 microversion: 2.1 time: 0.219116 Aug 04 10:32:42.743558 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 9/10] 10.222.0.121 () {58 vars in 1250 bytes} [Thu Aug 4 10:32:42 2022] GET /compute/v2.1/os-volumes/b6b2670d-0db9-4734-a655-c372604f3b35 => generated 344 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:32:43.752716 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-f3624350-3502-44b9-9b39-06fd3439297a tempest-VolumesSnapshotsTestJSON-644414039 tempest-VolumesSnapshotsTestJSON-644414039-project] Calling method '.version_select at 0x7f6756db2c10>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:32:44.033043 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-f3624350-3502-44b9-9b39-06fd3439297a tempest-VolumesSnapshotsTestJSON-644414039 tempest-VolumesSnapshotsTestJSON-644414039-project] 10.222.0.121 "GET /compute/v2.1/os-volumes/b6b2670d-0db9-4734-a655-c372604f3b35" status: 200 len: 344 microversion: 2.1 time: 0.285125 Aug 04 10:32:44.034050 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 2/11] 10.222.0.121 () {58 vars in 1250 bytes} [Thu Aug 4 10:32:43 2022] GET /compute/v2.1/os-volumes/b6b2670d-0db9-4734-a655-c372604f3b35 => generated 344 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:32:45.056244 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-0a6c5687-4c38-4b3a-ad13-cb9f6c12a6d0 tempest-VolumesSnapshotsTestJSON-644414039 tempest-VolumesSnapshotsTestJSON-644414039-project] Calling method '.version_select at 0x7f6756ccee50>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:32:45.208870 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-0a6c5687-4c38-4b3a-ad13-cb9f6c12a6d0 tempest-VolumesSnapshotsTestJSON-644414039 tempest-VolumesSnapshotsTestJSON-644414039-project] 10.222.0.121 "GET /compute/v2.1/os-volumes/b6b2670d-0db9-4734-a655-c372604f3b35" status: 200 len: 345 microversion: 2.1 time: 0.160949 Aug 04 10:32:45.213104 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 10/12] 10.222.0.121 () {58 vars in 1250 bytes} [Thu Aug 4 10:32:45 2022] GET /compute/v2.1/os-volumes/b6b2670d-0db9-4734-a655-c372604f3b35 => generated 345 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:32:45.227497 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-5ed3947d-0de6-4820-8021-e6dcd8124e12 tempest-VolumesSnapshotsTestJSON-644414039 tempest-VolumesSnapshotsTestJSON-644414039-project] Action: 'create', calling method: .version_select at 0x7f6756d53280>, body: {"snapshot": {"volume_id": "b6b2670d-0db9-4734-a655-c372604f3b35", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-983871715"}} {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:32:45.789887 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-5ed3947d-0de6-4820-8021-e6dcd8124e12 tempest-VolumesSnapshotsTestJSON-644414039 tempest-VolumesSnapshotsTestJSON-644414039-project] 10.222.0.121 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.567291 Aug 04 10:32:45.791052 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 3/13] 10.222.0.121 () {60 vars in 1167 bytes} [Thu Aug 4 10:32:45 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:32:45.803765 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-509f5b50-fb16-4155-8e0f-43d895d1d208 tempest-VolumesSnapshotsTestJSON-644414039 tempest-VolumesSnapshotsTestJSON-644414039-project] Calling method '.version_select at 0x7f6756cdb1f0>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:32:45.972946 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-509f5b50-fb16-4155-8e0f-43d895d1d208 tempest-VolumesSnapshotsTestJSON-644414039 tempest-VolumesSnapshotsTestJSON-644414039-project] 10.222.0.121 "GET /compute/v2.1/os-snapshots/fb183e72-3f7c-4d15-be63-08828c77037b" status: 200 len: 286 microversion: 2.1 time: 0.174234 Aug 04 10:32:45.973532 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 11/14] 10.222.0.121 () {58 vars in 1256 bytes} [Thu Aug 4 10:32:45 2022] GET /compute/v2.1/os-snapshots/fb183e72-3f7c-4d15-be63-08828c77037b => generated 286 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:32:45.985393 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-e37ffa47-1448-4092-afa5-44ba91b4d86f tempest-VolumesSnapshotsTestJSON-644414039 tempest-VolumesSnapshotsTestJSON-644414039-project] Calling method '.version_select at 0x7f6756d56430>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:32:46.105264 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-e37ffa47-1448-4092-afa5-44ba91b4d86f tempest-VolumesSnapshotsTestJSON-644414039 tempest-VolumesSnapshotsTestJSON-644414039-project] 10.222.0.121 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.123993 Aug 04 10:32:46.105855 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 4/15] 10.222.0.121 () {58 vars in 1145 bytes} [Thu Aug 4 10:32:45 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:32:46.117569 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-6b7bec86-0b3b-4bd7-91dd-bd531f47c620 tempest-VolumesSnapshotsTestJSON-644414039 tempest-VolumesSnapshotsTestJSON-644414039-project] Calling method '.version_select at 0x7f6756cdb940>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:32:46.185156 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-6b7bec86-0b3b-4bd7-91dd-bd531f47c620 tempest-VolumesSnapshotsTestJSON-644414039 tempest-VolumesSnapshotsTestJSON-644414039-project] 10.222.0.121 "GET /compute/v2.1/os-snapshots/fb183e72-3f7c-4d15-be63-08828c77037b" status: 200 len: 286 microversion: 2.1 time: 0.071395 Aug 04 10:32:46.185769 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 12/16] 10.222.0.121 () {58 vars in 1256 bytes} [Thu Aug 4 10:32:46 2022] GET /compute/v2.1/os-snapshots/fb183e72-3f7c-4d15-be63-08828c77037b => generated 286 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:32:47.198488 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-d5795b53-0fb2-4439-8ef1-7cd37c4f5ce9 tempest-VolumesSnapshotsTestJSON-644414039 tempest-VolumesSnapshotsTestJSON-644414039-project] Calling method '.version_select at 0x7f6756d531f0>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:32:47.291044 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-d5795b53-0fb2-4439-8ef1-7cd37c4f5ce9 tempest-VolumesSnapshotsTestJSON-644414039 tempest-VolumesSnapshotsTestJSON-644414039-project] 10.222.0.121 "GET /compute/v2.1/os-snapshots/fb183e72-3f7c-4d15-be63-08828c77037b" status: 200 len: 286 microversion: 2.1 time: 0.095871 Aug 04 10:32:47.293367 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 5/17] 10.222.0.121 () {58 vars in 1256 bytes} [Thu Aug 4 10:32:47 2022] GET /compute/v2.1/os-snapshots/fb183e72-3f7c-4d15-be63-08828c77037b => generated 286 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:32:48.306968 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-30c41510-625b-4c8e-8e1a-da844a2e995c tempest-VolumesSnapshotsTestJSON-644414039 tempest-VolumesSnapshotsTestJSON-644414039-project] Calling method '.version_select at 0x7f6756cce280>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:32:48.361928 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-30c41510-625b-4c8e-8e1a-da844a2e995c tempest-VolumesSnapshotsTestJSON-644414039 tempest-VolumesSnapshotsTestJSON-644414039-project] 10.222.0.121 "GET /compute/v2.1/os-snapshots/fb183e72-3f7c-4d15-be63-08828c77037b" status: 200 len: 286 microversion: 2.1 time: 0.060466 Aug 04 10:32:48.363011 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 13/18] 10.222.0.121 () {58 vars in 1256 bytes} [Thu Aug 4 10:32:48 2022] GET /compute/v2.1/os-snapshots/fb183e72-3f7c-4d15-be63-08828c77037b => generated 286 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:32:49.379882 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-a1cdd599-afd1-4dda-a1f2-b2e1a895b31b tempest-VolumesSnapshotsTestJSON-644414039 tempest-VolumesSnapshotsTestJSON-644414039-project] Calling method '.version_select at 0x7f6756cce790>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:32:49.459550 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-3d028785-2538-4958-a27a-0e103f557031 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Action: 'create', calling method: .version_select at 0x7f6756db2dc0>, body: {"keypair": {"name": "tempest-keypair-597370449", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEkM2lTKVB6vxQn6VxiiCupJQj8/T1FXpTVmDJezR7MEtqlr11Ct+r4r8SFeP67XlbK/04sxxMsf+OdTsd+Qf18gUPjfnUNhR2rhbIIFWZ9+jxRNMcN5rWBetU+f8/zQJA=="}} {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:32:49.472551 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-a1cdd599-afd1-4dda-a1f2-b2e1a895b31b tempest-VolumesSnapshotsTestJSON-644414039 tempest-VolumesSnapshotsTestJSON-644414039-project] 10.222.0.121 "GET /compute/v2.1/os-snapshots/fb183e72-3f7c-4d15-be63-08828c77037b" status: 200 len: 286 microversion: 2.1 time: 0.100619 Aug 04 10:32:49.473919 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 14/19] 10.222.0.121 () {58 vars in 1256 bytes} [Thu Aug 4 10:32:49 2022] GET /compute/v2.1/os-snapshots/fb183e72-3f7c-4d15-be63-08828c77037b => generated 286 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:32:49.709743 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.quota [None req-3d028785-2538-4958-a27a-0e103f557031 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Getting quotas for project 6f46ab11dd0b428486c673afc14b5b63. Resources: {'key_pairs'} {{(pid=124456) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 10:32:49.721695 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.quota [None req-3d028785-2538-4958-a27a-0e103f557031 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Getting quotas for user 3aa2e2a5a6ed4c5c9db91269266dd30b and project 6f46ab11dd0b428486c673afc14b5b63. Resources: {'key_pairs'} {{(pid=124456) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 10:32:49.865083 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-3d028785-2538-4958-a27a-0e103f557031 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] 10.222.0.121 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 1.075593 Aug 04 10:32:49.874087 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 6/20] 10.222.0.121 () {60 vars in 1164 bytes} [Thu Aug 4 10:32:48 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 1079 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:32:50.487246 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-84a00c2f-5fc8-4768-83e2-a5f94b6bd3da tempest-VolumesSnapshotsTestJSON-644414039 tempest-VolumesSnapshotsTestJSON-644414039-project] Calling method '.version_select at 0x7f6756cdbca0>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:32:50.553427 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-84a00c2f-5fc8-4768-83e2-a5f94b6bd3da tempest-VolumesSnapshotsTestJSON-644414039 tempest-VolumesSnapshotsTestJSON-644414039-project] 10.222.0.121 "GET /compute/v2.1/os-snapshots/fb183e72-3f7c-4d15-be63-08828c77037b" status: 200 len: 286 microversion: 2.1 time: 0.070329 Aug 04 10:32:50.554769 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 15/21] 10.222.0.121 () {58 vars in 1256 bytes} [Thu Aug 4 10:32:50 2022] GET /compute/v2.1/os-snapshots/fb183e72-3f7c-4d15-be63-08828c77037b => generated 286 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:32:51.567284 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-89fad413-bfd4-40df-8a6a-4c1c8feed73a tempest-VolumesSnapshotsTestJSON-644414039 tempest-VolumesSnapshotsTestJSON-644414039-project] Calling method '.version_select at 0x7f6756d2a9d0>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:32:51.668855 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-89fad413-bfd4-40df-8a6a-4c1c8feed73a tempest-VolumesSnapshotsTestJSON-644414039 tempest-VolumesSnapshotsTestJSON-644414039-project] 10.222.0.121 "GET /compute/v2.1/os-snapshots/fb183e72-3f7c-4d15-be63-08828c77037b" status: 200 len: 286 microversion: 2.1 time: 0.105636 Aug 04 10:32:51.669985 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 7/22] 10.222.0.121 () {58 vars in 1256 bytes} [Thu Aug 4 10:32:51 2022] GET /compute/v2.1/os-snapshots/fb183e72-3f7c-4d15-be63-08828c77037b => generated 286 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:32:52.683221 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-1ff284fa-e700-4a81-b566-0a6627ded9d5 tempest-VolumesSnapshotsTestJSON-644414039 tempest-VolumesSnapshotsTestJSON-644414039-project] Calling method '.version_select at 0x7f6756cdb4c0>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:32:52.757629 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-1ff284fa-e700-4a81-b566-0a6627ded9d5 tempest-VolumesSnapshotsTestJSON-644414039 tempest-VolumesSnapshotsTestJSON-644414039-project] 10.222.0.121 "GET /compute/v2.1/os-snapshots/fb183e72-3f7c-4d15-be63-08828c77037b" status: 200 len: 286 microversion: 2.1 time: 0.079127 Aug 04 10:32:52.758715 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 16/23] 10.222.0.121 () {58 vars in 1256 bytes} [Thu Aug 4 10:32:52 2022] GET /compute/v2.1/os-snapshots/fb183e72-3f7c-4d15-be63-08828c77037b => generated 286 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 10:32:53.772265 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-34ca077a-a767-402d-ae9c-28c23ed10a8f tempest-VolumesSnapshotsTestJSON-644414039 tempest-VolumesSnapshotsTestJSON-644414039-project] Calling method '.version_select at 0x7f6756cdb700>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:32:53.912935 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-34ca077a-a767-402d-ae9c-28c23ed10a8f tempest-VolumesSnapshotsTestJSON-644414039 tempest-VolumesSnapshotsTestJSON-644414039-project] 10.222.0.121 "GET /compute/v2.1/os-snapshots/fb183e72-3f7c-4d15-be63-08828c77037b" status: 200 len: 287 microversion: 2.1 time: 0.144918 Aug 04 10:32:53.913724 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 8/24] 10.222.0.121 () {58 vars in 1256 bytes} [Thu Aug 4 10:32:53 2022] GET /compute/v2.1/os-snapshots/fb183e72-3f7c-4d15-be63-08828c77037b => generated 287 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:32:53.925634 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-212048c2-92bd-48f0-9f65-abaf4ac4e25f tempest-VolumesSnapshotsTestJSON-644414039 tempest-VolumesSnapshotsTestJSON-644414039-project] Calling method '.version_select at 0x7f6756cceca0>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:32:54.151244 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-212048c2-92bd-48f0-9f65-abaf4ac4e25f tempest-VolumesSnapshotsTestJSON-644414039 tempest-VolumesSnapshotsTestJSON-644414039-project] 10.222.0.121 "DELETE /compute/v2.1/os-snapshots/fb183e72-3f7c-4d15-be63-08828c77037b" status: 202 len: 0 microversion: 2.1 time: 0.229717 Aug 04 10:32:54.153997 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 17/25] 10.222.0.121 () {58 vars in 1259 bytes} [Thu Aug 4 10:32:53 2022] DELETE /compute/v2.1/os-snapshots/fb183e72-3f7c-4d15-be63-08828c77037b => generated 0 bytes in 232 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 10:32:54.160941 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-be666b0c-8dd5-4667-abd5-7b3753e60fe4 tempest-VolumesSnapshotsTestJSON-644414039 tempest-VolumesSnapshotsTestJSON-644414039-project] Calling method '.version_select at 0x7f6756cdbdc0>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:32:54.408360 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-be666b0c-8dd5-4667-abd5-7b3753e60fe4 tempest-VolumesSnapshotsTestJSON-644414039 tempest-VolumesSnapshotsTestJSON-644414039-project] 10.222.0.121 "GET /compute/v2.1/os-snapshots/fb183e72-3f7c-4d15-be63-08828c77037b" status: 200 len: 286 microversion: 2.1 time: 0.251580 Aug 04 10:32:54.409065 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 9/26] 10.222.0.121 () {58 vars in 1256 bytes} [Thu Aug 4 10:32:54 2022] GET /compute/v2.1/os-snapshots/fb183e72-3f7c-4d15-be63-08828c77037b => generated 286 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:32:55.432149 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-c0f92c9a-e256-40f8-aef4-d840ddc6ce57 tempest-VolumesSnapshotsTestJSON-644414039 tempest-VolumesSnapshotsTestJSON-644414039-project] Calling method '.version_select at 0x7f6756ccee50>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:32:55.505514 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.wsgi [None req-c0f92c9a-e256-40f8-aef4-d840ddc6ce57 tempest-VolumesSnapshotsTestJSON-644414039 tempest-VolumesSnapshotsTestJSON-644414039-project] HTTP exception thrown: Snapshot fb183e72-3f7c-4d15-be63-08828c77037b could not be found. Aug 04 10:32:55.511633 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-c0f92c9a-e256-40f8-aef4-d840ddc6ce57 tempest-VolumesSnapshotsTestJSON-644414039 tempest-VolumesSnapshotsTestJSON-644414039-project] Request method failure captured: Aug 04 10:32:55.511633 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: request: GET /compute/v2.1/os-snapshots/fb183e72-3f7c-4d15-be63-08828c77037b HTTP/1.1 Aug 04 10:32:55.511633 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: Accept: application/json Aug 04 10:32:55.511633 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: Accept-Encoding: identity Aug 04 10:32:55.511633 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: Connection: close Aug 04 10:32:55.511633 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: Content-Length: 0 Aug 04 10:32:55.511633 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: Content-Type: application/json Aug 04 10:32:55.511633 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: Host: 10.222.0.121 Aug 04 10:32:55.511633 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: Openstack-System-Scope: None Aug 04 10:32:55.511633 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: User-Agent: python-urllib3/1.26.11 Aug 04 10:32:55.511633 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Auth-Token: gAAAAABi66BG712SAknd2t0AlBQ0uCXWe9fdIgVV17BxrI4vjci6lCga_wXnkpHg3oGhGfwuH1Sx36YNwOJsJ2vfQGLmBecSf7oVDQPElnNWABSS-Nlj7wW3X-qAfJYx2lWiUpyZCTRPgnErw5vFVRYrW_ja944aFrDMGDkL7dMEmUGO-MM5w98 Aug 04 10:32:55.511633 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Domain-Id: None Aug 04 10:32:55.511633 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Domain-Name: None Aug 04 10:32:55.511633 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Identity-Status: Confirmed Aug 04 10:32:55.511633 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Is-Admin-Project: True Aug 04 10:32:55.511633 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Project-Domain-Id: default Aug 04 10:32:55.511633 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Project-Domain-Name: Default Aug 04 10:32:55.511633 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Project-Id: c95096b8b71b4441836e289040285c19 Aug 04 10:32:55.511633 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-644414039 Aug 04 10:32:55.511633 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Role: reader,member Aug 04 10:32:55.511633 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Roles: reader,member Aug 04 10:32:55.512856 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/c95096b8b71b4441836e289040285c19"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/c95096b8b71b4441836e289040285c19"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.121:8080", "publicURL": "http://10.222.0.121:8080/v1/AUTH_c95096b8b71b4441836e289040285c19"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2/c95096b8b71b4441836e289040285c19"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:9696/networking"}]}] Aug 04 10:32:55.512856 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Tenant: tempest-VolumesSnapshotsTestJSON-644414039 Aug 04 10:32:55.512856 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Tenant-Id: c95096b8b71b4441836e289040285c19 Aug 04 10:32:55.512856 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-644414039 Aug 04 10:32:55.512856 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-User: tempest-VolumesSnapshotsTestJSON-644414039-project Aug 04 10:32:55.512856 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-User-Domain-Id: default Aug 04 10:32:55.512856 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-User-Domain-Name: Default Aug 04 10:32:55.512856 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-User-Id: 2ac28f9efd59480c8c6f5385e5945b25 Aug 04 10:32:55.512856 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-User-Name: tempest-VolumesSnapshotsTestJSON-644414039-project Aug 04 10:32:55.512856 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: method: Aug 04 10:32:55.512856 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: exception: Snapshot fb183e72-3f7c-4d15-be63-08828c77037b could not be found. Aug 04 10:32:55.512856 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: action_args: {'id': 'fb183e72-3f7c-4d15-be63-08828c77037b'} Aug 04 10:32:55.512856 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 10:32:55.513495 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:32:55.513495 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 04 10:32:55.513495 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 04 10:32:55.513495 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 04 10:32:55.513495 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 04 10:32:55.513495 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 04 10:32:55.513495 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 04 10:32:55.513495 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 04 10:32:55.513495 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 04 10:32:55.513495 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 04 10:32:55.513495 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 04 10:32:55.513495 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 10:32:55.513495 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 10:32:55.513495 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 10:32:55.513495 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 10:32:55.513495 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot fb183e72-3f7c-4d15-be63-08828c77037b could not be found. (HTTP 404) (Request-ID: req-63fb7816-81cf-4484-aa03-bfa009d2d452) Aug 04 10:32:55.513495 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Aug 04 10:32:55.513495 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:32:55.514381 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Aug 04 10:32:55.514381 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:32:55.514381 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 04 10:32:55.514381 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 04 10:32:55.514381 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 04 10:32:55.514381 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 04 10:32:55.514381 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 04 10:32:55.514381 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 04 10:32:55.514381 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 04 10:32:55.514381 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 04 10:32:55.514381 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 04 10:32:55.514381 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 04 10:32:55.514381 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 04 10:32:55.514381 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 04 10:32:55.514381 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 04 10:32:55.514381 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 04 10:32:55.514381 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 04 10:32:55.514381 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 04 10:32:55.514381 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 04 10:32:55.515321 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 04 10:32:55.515321 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 10:32:55.515321 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 10:32:55.515321 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 10:32:55.515321 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 10:32:55.515321 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot fb183e72-3f7c-4d15-be63-08828c77037b could not be found. Aug 04 10:32:55.515321 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Aug 04 10:32:55.515321 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:32:55.515321 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Aug 04 10:32:55.515321 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:32:55.515321 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:32:55.515321 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:32:55.515321 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 10:32:55.515321 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 10:32:55.515321 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 10:32:55.515321 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 10:32:55.515321 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 10:32:55.515321 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 10:32:55.515321 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 04 10:32:55.515321 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 10:32:55.516390 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot fb183e72-3f7c-4d15-be63-08828c77037b could not be found. Aug 04 10:32:55.516390 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Aug 04 10:32:55.516390 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:32:55.516390 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Aug 04 10:32:55.516390 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:32:55.516390 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:32:55.516390 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:32:55.516390 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 10:32:55.516390 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 10:32:55.516390 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot fb183e72-3f7c-4d15-be63-08828c77037b could not be found. Aug 04 10:32:55.516390 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Aug 04 10:32:55.516390 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-c0f92c9a-e256-40f8-aef4-d840ddc6ce57 tempest-VolumesSnapshotsTestJSON-644414039 tempest-VolumesSnapshotsTestJSON-644414039-project] Returning 404 to user: Snapshot fb183e72-3f7c-4d15-be63-08828c77037b could not be found. {{(pid=124457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 10:32:55.516390 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-c0f92c9a-e256-40f8-aef4-d840ddc6ce57 tempest-VolumesSnapshotsTestJSON-644414039 tempest-VolumesSnapshotsTestJSON-644414039-project] 10.222.0.121 "GET /compute/v2.1/os-snapshots/fb183e72-3f7c-4d15-be63-08828c77037b" status: 404 len: 111 microversion: 2.1 time: 0.091288 Aug 04 10:32:55.528486 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-df9c60c2-c13f-44e9-9059-50a4aa54354c tempest-VolumesSnapshotsTestJSON-644414039 tempest-VolumesSnapshotsTestJSON-644414039-project] Calling method '.version_select at 0x7f6756cdbb80>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:32:55.530361 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 18/27] 10.222.0.121 () {58 vars in 1256 bytes} [Thu Aug 4 10:32:55 2022] GET /compute/v2.1/os-snapshots/fb183e72-3f7c-4d15-be63-08828c77037b => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 10:32:55.715310 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-df9c60c2-c13f-44e9-9059-50a4aa54354c tempest-VolumesSnapshotsTestJSON-644414039 tempest-VolumesSnapshotsTestJSON-644414039-project] 10.222.0.121 "DELETE /compute/v2.1/os-volumes/b6b2670d-0db9-4734-a655-c372604f3b35" status: 202 len: 0 microversion: 2.1 time: 0.195332 Aug 04 10:32:55.727555 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 10/28] 10.222.0.121 () {58 vars in 1253 bytes} [Thu Aug 4 10:32:55 2022] DELETE /compute/v2.1/os-volumes/b6b2670d-0db9-4734-a655-c372604f3b35 => generated 0 bytes in 208 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 10:32:55.730216 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-bc983f36-159c-4a49-b9b3-e152d51d4270 tempest-VolumesSnapshotsTestJSON-644414039 tempest-VolumesSnapshotsTestJSON-644414039-project] Calling method '.version_select at 0x7f6756cfd0d0>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:32:55.924155 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-bc983f36-159c-4a49-b9b3-e152d51d4270 tempest-VolumesSnapshotsTestJSON-644414039 tempest-VolumesSnapshotsTestJSON-644414039-project] 10.222.0.121 "GET /compute/v2.1/os-volumes/b6b2670d-0db9-4734-a655-c372604f3b35" status: 200 len: 344 microversion: 2.1 time: 0.201750 Aug 04 10:32:55.925740 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 19/29] 10.222.0.121 () {58 vars in 1250 bytes} [Thu Aug 4 10:32:55 2022] GET /compute/v2.1/os-volumes/b6b2670d-0db9-4734-a655-c372604f3b35 => generated 344 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:32:56.940849 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-f37c4ed2-b625-4c1c-8f90-f12ed1510a07 tempest-VolumesSnapshotsTestJSON-644414039 tempest-VolumesSnapshotsTestJSON-644414039-project] Calling method '.version_select at 0x7f6756cce4c0>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:32:56.996063 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.wsgi [None req-f37c4ed2-b625-4c1c-8f90-f12ed1510a07 tempest-VolumesSnapshotsTestJSON-644414039 tempest-VolumesSnapshotsTestJSON-644414039-project] HTTP exception thrown: Volume b6b2670d-0db9-4734-a655-c372604f3b35 could not be found. Aug 04 10:32:56.998787 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-f37c4ed2-b625-4c1c-8f90-f12ed1510a07 tempest-VolumesSnapshotsTestJSON-644414039 tempest-VolumesSnapshotsTestJSON-644414039-project] Request method failure captured: Aug 04 10:32:56.998787 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: request: GET /compute/v2.1/os-volumes/b6b2670d-0db9-4734-a655-c372604f3b35 HTTP/1.1 Aug 04 10:32:56.998787 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: Accept: application/json Aug 04 10:32:56.998787 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: Accept-Encoding: identity Aug 04 10:32:56.998787 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: Connection: close Aug 04 10:32:56.998787 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: Content-Length: 0 Aug 04 10:32:56.998787 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: Content-Type: application/json Aug 04 10:32:56.998787 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: Host: 10.222.0.121 Aug 04 10:32:56.998787 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: Openstack-System-Scope: None Aug 04 10:32:56.998787 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: User-Agent: python-urllib3/1.26.11 Aug 04 10:32:56.998787 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Auth-Token: gAAAAABi66BG712SAknd2t0AlBQ0uCXWe9fdIgVV17BxrI4vjci6lCga_wXnkpHg3oGhGfwuH1Sx36YNwOJsJ2vfQGLmBecSf7oVDQPElnNWABSS-Nlj7wW3X-qAfJYx2lWiUpyZCTRPgnErw5vFVRYrW_ja944aFrDMGDkL7dMEmUGO-MM5w98 Aug 04 10:32:56.998787 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Domain-Id: None Aug 04 10:32:56.998787 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Domain-Name: None Aug 04 10:32:56.998787 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Identity-Status: Confirmed Aug 04 10:32:56.998787 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Is-Admin-Project: True Aug 04 10:32:56.998787 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Project-Domain-Id: default Aug 04 10:32:56.998787 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Project-Domain-Name: Default Aug 04 10:32:56.998787 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Project-Id: c95096b8b71b4441836e289040285c19 Aug 04 10:32:56.998787 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-644414039 Aug 04 10:32:56.998787 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Role: reader,member Aug 04 10:32:56.998787 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Roles: reader,member Aug 04 10:32:56.999910 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/c95096b8b71b4441836e289040285c19"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/c95096b8b71b4441836e289040285c19"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.121:8080", "publicURL": "http://10.222.0.121:8080/v1/AUTH_c95096b8b71b4441836e289040285c19"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2/c95096b8b71b4441836e289040285c19"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:9696/networking"}]}] Aug 04 10:32:56.999910 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Tenant: tempest-VolumesSnapshotsTestJSON-644414039 Aug 04 10:32:56.999910 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Tenant-Id: c95096b8b71b4441836e289040285c19 Aug 04 10:32:56.999910 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-644414039 Aug 04 10:32:56.999910 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-User: tempest-VolumesSnapshotsTestJSON-644414039-project Aug 04 10:32:56.999910 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-User-Domain-Id: default Aug 04 10:32:56.999910 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-User-Domain-Name: Default Aug 04 10:32:56.999910 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-User-Id: 2ac28f9efd59480c8c6f5385e5945b25 Aug 04 10:32:56.999910 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-User-Name: tempest-VolumesSnapshotsTestJSON-644414039-project Aug 04 10:32:56.999910 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: method: Aug 04 10:32:56.999910 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: exception: Volume b6b2670d-0db9-4734-a655-c372604f3b35 could not be found. Aug 04 10:32:56.999910 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: action_args: {'id': 'b6b2670d-0db9-4734-a655-c372604f3b35'} Aug 04 10:32:56.999910 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 10:32:57.000756 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:32:57.000756 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 10:32:57.000756 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 10:32:57.000756 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 04 10:32:57.000756 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 04 10:32:57.000756 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 04 10:32:57.000756 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 04 10:32:57.000756 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 04 10:32:57.000756 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 04 10:32:57.000756 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 04 10:32:57.000756 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 04 10:32:57.000756 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 10:32:57.000756 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 10:32:57.000756 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 10:32:57.000756 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 10:32:57.000756 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b6b2670d-0db9-4734-a655-c372604f3b35 could not be found. (HTTP 404) (Request-ID: req-000d5971-4c80-4b77-992a-7824c98b4c69) Aug 04 10:32:57.000756 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Aug 04 10:32:57.000756 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:32:57.000756 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Aug 04 10:32:57.001732 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:32:57.001732 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 04 10:32:57.001732 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 04 10:32:57.001732 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 04 10:32:57.001732 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 04 10:32:57.001732 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 04 10:32:57.001732 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 04 10:32:57.001732 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 04 10:32:57.001732 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 04 10:32:57.001732 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 10:32:57.001732 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 10:32:57.001732 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 04 10:32:57.001732 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 04 10:32:57.001732 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 04 10:32:57.001732 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 04 10:32:57.001732 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 04 10:32:57.001732 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 04 10:32:57.001732 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 04 10:32:57.001732 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 04 10:32:57.002708 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 10:32:57.002708 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 10:32:57.002708 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 10:32:57.002708 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 10:32:57.002708 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b6b2670d-0db9-4734-a655-c372604f3b35 could not be found. Aug 04 10:32:57.002708 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Aug 04 10:32:57.002708 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:32:57.002708 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Aug 04 10:32:57.002708 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:32:57.002708 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:32:57.002708 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:32:57.002708 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 10:32:57.002708 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 10:32:57.002708 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 10:32:57.002708 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 10:32:57.002708 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 10:32:57.002708 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 10:32:57.002708 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 04 10:32:57.002708 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 10:32:57.005142 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b6b2670d-0db9-4734-a655-c372604f3b35 could not be found. Aug 04 10:32:57.005142 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Aug 04 10:32:57.005142 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:32:57.005142 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Aug 04 10:32:57.005142 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:32:57.005142 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:32:57.005142 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:32:57.005142 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 10:32:57.005142 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 10:32:57.005142 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b6b2670d-0db9-4734-a655-c372604f3b35 could not be found. Aug 04 10:32:57.005142 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Aug 04 10:32:57.007565 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-f37c4ed2-b625-4c1c-8f90-f12ed1510a07 tempest-VolumesSnapshotsTestJSON-644414039 tempest-VolumesSnapshotsTestJSON-644414039-project] Returning 404 to user: Volume b6b2670d-0db9-4734-a655-c372604f3b35 could not be found. {{(pid=124457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 10:32:57.008895 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-f37c4ed2-b625-4c1c-8f90-f12ed1510a07 tempest-VolumesSnapshotsTestJSON-644414039 tempest-VolumesSnapshotsTestJSON-644414039-project] 10.222.0.121 "GET /compute/v2.1/os-volumes/b6b2670d-0db9-4734-a655-c372604f3b35" status: 404 len: 109 microversion: 2.1 time: 0.073819 Aug 04 10:32:57.009776 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 20/30] 10.222.0.121 () {58 vars in 1250 bytes} [Thu Aug 4 10:32:56 2022] GET /compute/v2.1/os-volumes/b6b2670d-0db9-4734-a655-c372604f3b35 => generated 109 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 10:32:57.022287 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-5ee1922e-6069-4720-8ffb-662cfd9de86b tempest-VolumesSnapshotsTestJSON-644414039 tempest-VolumesSnapshotsTestJSON-644414039-project] Calling method '.version_select at 0x7f6756cdba60>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:32:57.120715 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.wsgi [None req-5ee1922e-6069-4720-8ffb-662cfd9de86b tempest-VolumesSnapshotsTestJSON-644414039 tempest-VolumesSnapshotsTestJSON-644414039-project] HTTP exception thrown: Volume b6b2670d-0db9-4734-a655-c372604f3b35 could not be found. Aug 04 10:32:57.123051 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-5ee1922e-6069-4720-8ffb-662cfd9de86b tempest-VolumesSnapshotsTestJSON-644414039 tempest-VolumesSnapshotsTestJSON-644414039-project] Request method failure captured: Aug 04 10:32:57.123051 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: request: DELETE /compute/v2.1/os-volumes/b6b2670d-0db9-4734-a655-c372604f3b35 HTTP/1.1 Aug 04 10:32:57.123051 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: Accept: application/json Aug 04 10:32:57.123051 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: Accept-Encoding: identity Aug 04 10:32:57.123051 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: Connection: close Aug 04 10:32:57.123051 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: Content-Length: 0 Aug 04 10:32:57.123051 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: Content-Type: application/json Aug 04 10:32:57.123051 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: Host: 10.222.0.121 Aug 04 10:32:57.123051 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: Openstack-System-Scope: None Aug 04 10:32:57.123051 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: User-Agent: python-urllib3/1.26.11 Aug 04 10:32:57.123051 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Auth-Token: gAAAAABi66BG712SAknd2t0AlBQ0uCXWe9fdIgVV17BxrI4vjci6lCga_wXnkpHg3oGhGfwuH1Sx36YNwOJsJ2vfQGLmBecSf7oVDQPElnNWABSS-Nlj7wW3X-qAfJYx2lWiUpyZCTRPgnErw5vFVRYrW_ja944aFrDMGDkL7dMEmUGO-MM5w98 Aug 04 10:32:57.123051 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Domain-Id: None Aug 04 10:32:57.123051 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Domain-Name: None Aug 04 10:32:57.123051 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Identity-Status: Confirmed Aug 04 10:32:57.123051 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Is-Admin-Project: True Aug 04 10:32:57.123051 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Project-Domain-Id: default Aug 04 10:32:57.123051 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Project-Domain-Name: Default Aug 04 10:32:57.123051 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Project-Id: c95096b8b71b4441836e289040285c19 Aug 04 10:32:57.123051 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-644414039 Aug 04 10:32:57.123051 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Role: reader,member Aug 04 10:32:57.123051 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Roles: reader,member Aug 04 10:32:57.124227 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/c95096b8b71b4441836e289040285c19"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/c95096b8b71b4441836e289040285c19"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.121:8080", "publicURL": "http://10.222.0.121:8080/v1/AUTH_c95096b8b71b4441836e289040285c19"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2/c95096b8b71b4441836e289040285c19"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:9696/networking"}]}] Aug 04 10:32:57.124227 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Tenant: tempest-VolumesSnapshotsTestJSON-644414039 Aug 04 10:32:57.124227 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Tenant-Id: c95096b8b71b4441836e289040285c19 Aug 04 10:32:57.124227 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-644414039 Aug 04 10:32:57.124227 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-User: tempest-VolumesSnapshotsTestJSON-644414039-project Aug 04 10:32:57.124227 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-User-Domain-Id: default Aug 04 10:32:57.124227 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-User-Domain-Name: Default Aug 04 10:32:57.124227 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-User-Id: 2ac28f9efd59480c8c6f5385e5945b25 Aug 04 10:32:57.124227 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-User-Name: tempest-VolumesSnapshotsTestJSON-644414039-project Aug 04 10:32:57.124227 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: method: Aug 04 10:32:57.124227 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: exception: Volume b6b2670d-0db9-4734-a655-c372604f3b35 could not be found. Aug 04 10:32:57.124227 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: action_args: {'id': 'b6b2670d-0db9-4734-a655-c372604f3b35'} Aug 04 10:32:57.124227 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 10:32:57.125071 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:32:57.125071 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 10:32:57.125071 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 10:32:57.125071 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 04 10:32:57.125071 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 04 10:32:57.125071 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 04 10:32:57.125071 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 04 10:32:57.125071 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 04 10:32:57.125071 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 04 10:32:57.125071 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 04 10:32:57.125071 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 04 10:32:57.125071 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 10:32:57.125071 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 10:32:57.125071 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 10:32:57.125071 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 10:32:57.125071 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b6b2670d-0db9-4734-a655-c372604f3b35 could not be found. (HTTP 404) (Request-ID: req-c3fef70f-260f-42eb-9b0f-f2de3489f744) Aug 04 10:32:57.125071 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Aug 04 10:32:57.125071 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:32:57.125071 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Aug 04 10:32:57.126264 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:32:57.126264 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 04 10:32:57.126264 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 04 10:32:57.126264 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 04 10:32:57.126264 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 04 10:32:57.126264 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 04 10:32:57.126264 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 04 10:32:57.126264 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 04 10:32:57.126264 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 04 10:32:57.126264 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 10:32:57.126264 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 10:32:57.126264 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 04 10:32:57.126264 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 04 10:32:57.126264 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 04 10:32:57.126264 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 04 10:32:57.126264 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 04 10:32:57.126264 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 04 10:32:57.126264 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 04 10:32:57.126264 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 04 10:32:57.129646 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 10:32:57.129646 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 10:32:57.129646 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 10:32:57.129646 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 10:32:57.129646 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b6b2670d-0db9-4734-a655-c372604f3b35 could not be found. Aug 04 10:32:57.129646 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Aug 04 10:32:57.129646 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:32:57.129646 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Aug 04 10:32:57.129646 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:32:57.129646 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:32:57.129646 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:32:57.129646 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 10:32:57.129646 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 10:32:57.129646 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 10:32:57.129646 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 10:32:57.129646 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 10:32:57.129646 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 10:32:57.129646 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 04 10:32:57.129646 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 10:32:57.133033 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b6b2670d-0db9-4734-a655-c372604f3b35 could not be found. Aug 04 10:32:57.133033 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Aug 04 10:32:57.133033 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:32:57.133033 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Aug 04 10:32:57.133033 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:32:57.133033 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:32:57.133033 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:32:57.133033 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 10:32:57.133033 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 10:32:57.133033 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b6b2670d-0db9-4734-a655-c372604f3b35 could not be found. Aug 04 10:32:57.133033 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Aug 04 10:32:57.133033 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-5ee1922e-6069-4720-8ffb-662cfd9de86b tempest-VolumesSnapshotsTestJSON-644414039 tempest-VolumesSnapshotsTestJSON-644414039-project] Returning 404 to user: Volume b6b2670d-0db9-4734-a655-c372604f3b35 could not be found. {{(pid=124457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 10:32:57.135310 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-5ee1922e-6069-4720-8ffb-662cfd9de86b tempest-VolumesSnapshotsTestJSON-644414039 tempest-VolumesSnapshotsTestJSON-644414039-project] 10.222.0.121 "DELETE /compute/v2.1/os-volumes/b6b2670d-0db9-4734-a655-c372604f3b35" status: 404 len: 109 microversion: 2.1 time: 0.117183 Aug 04 10:32:57.135310 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 21/31] 10.222.0.121 () {58 vars in 1253 bytes} [Thu Aug 4 10:32:57 2022] DELETE /compute/v2.1/os-volumes/b6b2670d-0db9-4734-a655-c372604f3b35 => generated 109 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 10:32:57.143685 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-37ec672c-a97f-48a7-96d8-d7ecdc8a3e5b tempest-VolumesSnapshotsTestJSON-644414039 tempest-VolumesSnapshotsTestJSON-644414039-project] Calling method '.version_select at 0x7f6756cce670>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:32:57.193970 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.wsgi [None req-37ec672c-a97f-48a7-96d8-d7ecdc8a3e5b tempest-VolumesSnapshotsTestJSON-644414039 tempest-VolumesSnapshotsTestJSON-644414039-project] HTTP exception thrown: Volume b6b2670d-0db9-4734-a655-c372604f3b35 could not be found. Aug 04 10:32:57.196487 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-37ec672c-a97f-48a7-96d8-d7ecdc8a3e5b tempest-VolumesSnapshotsTestJSON-644414039 tempest-VolumesSnapshotsTestJSON-644414039-project] Request method failure captured: Aug 04 10:32:57.196487 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: request: GET /compute/v2.1/os-volumes/b6b2670d-0db9-4734-a655-c372604f3b35 HTTP/1.1 Aug 04 10:32:57.196487 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: Accept: application/json Aug 04 10:32:57.196487 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: Accept-Encoding: identity Aug 04 10:32:57.196487 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: Connection: close Aug 04 10:32:57.196487 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: Content-Length: 0 Aug 04 10:32:57.196487 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: Content-Type: application/json Aug 04 10:32:57.196487 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: Host: 10.222.0.121 Aug 04 10:32:57.196487 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: Openstack-System-Scope: None Aug 04 10:32:57.196487 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: User-Agent: python-urllib3/1.26.11 Aug 04 10:32:57.196487 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Auth-Token: gAAAAABi66BG712SAknd2t0AlBQ0uCXWe9fdIgVV17BxrI4vjci6lCga_wXnkpHg3oGhGfwuH1Sx36YNwOJsJ2vfQGLmBecSf7oVDQPElnNWABSS-Nlj7wW3X-qAfJYx2lWiUpyZCTRPgnErw5vFVRYrW_ja944aFrDMGDkL7dMEmUGO-MM5w98 Aug 04 10:32:57.196487 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Domain-Id: None Aug 04 10:32:57.196487 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Domain-Name: None Aug 04 10:32:57.196487 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Identity-Status: Confirmed Aug 04 10:32:57.196487 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Is-Admin-Project: True Aug 04 10:32:57.196487 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Project-Domain-Id: default Aug 04 10:32:57.196487 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Project-Domain-Name: Default Aug 04 10:32:57.196487 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Project-Id: c95096b8b71b4441836e289040285c19 Aug 04 10:32:57.196487 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-644414039 Aug 04 10:32:57.196487 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Role: reader,member Aug 04 10:32:57.196487 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Roles: reader,member Aug 04 10:32:57.197693 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/c95096b8b71b4441836e289040285c19"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/c95096b8b71b4441836e289040285c19"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.121:8080", "publicURL": "http://10.222.0.121:8080/v1/AUTH_c95096b8b71b4441836e289040285c19"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2/c95096b8b71b4441836e289040285c19"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:9696/networking"}]}] Aug 04 10:32:57.197693 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Tenant: tempest-VolumesSnapshotsTestJSON-644414039 Aug 04 10:32:57.197693 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Tenant-Id: c95096b8b71b4441836e289040285c19 Aug 04 10:32:57.197693 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-644414039 Aug 04 10:32:57.197693 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-User: tempest-VolumesSnapshotsTestJSON-644414039-project Aug 04 10:32:57.197693 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-User-Domain-Id: default Aug 04 10:32:57.197693 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-User-Domain-Name: Default Aug 04 10:32:57.197693 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-User-Id: 2ac28f9efd59480c8c6f5385e5945b25 Aug 04 10:32:57.197693 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-User-Name: tempest-VolumesSnapshotsTestJSON-644414039-project Aug 04 10:32:57.197693 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: method: Aug 04 10:32:57.197693 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: exception: Volume b6b2670d-0db9-4734-a655-c372604f3b35 could not be found. Aug 04 10:32:57.197693 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: action_args: {'id': 'b6b2670d-0db9-4734-a655-c372604f3b35'} Aug 04 10:32:57.197693 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 10:32:57.198542 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:32:57.198542 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 10:32:57.198542 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 10:32:57.198542 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 04 10:32:57.198542 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 04 10:32:57.198542 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 04 10:32:57.198542 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 04 10:32:57.198542 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 04 10:32:57.198542 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 04 10:32:57.198542 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 04 10:32:57.198542 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 04 10:32:57.198542 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 10:32:57.198542 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 10:32:57.198542 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 10:32:57.198542 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 10:32:57.198542 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b6b2670d-0db9-4734-a655-c372604f3b35 could not be found. (HTTP 404) (Request-ID: req-dc9b8399-f195-42b5-9ed5-0598f61704e6) Aug 04 10:32:57.198542 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Aug 04 10:32:57.198542 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:32:57.198542 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Aug 04 10:32:57.199489 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:32:57.199489 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 04 10:32:57.199489 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 04 10:32:57.199489 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 04 10:32:57.199489 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 04 10:32:57.199489 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 04 10:32:57.199489 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 04 10:32:57.199489 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 04 10:32:57.199489 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 04 10:32:57.199489 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 10:32:57.199489 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 10:32:57.199489 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 04 10:32:57.199489 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 04 10:32:57.199489 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 04 10:32:57.199489 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 04 10:32:57.199489 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 04 10:32:57.199489 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 04 10:32:57.199489 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 04 10:32:57.199489 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 04 10:32:57.200476 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 10:32:57.200476 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 10:32:57.200476 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 10:32:57.200476 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 10:32:57.200476 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b6b2670d-0db9-4734-a655-c372604f3b35 could not be found. Aug 04 10:32:57.200476 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Aug 04 10:32:57.200476 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:32:57.200476 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Aug 04 10:32:57.200476 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:32:57.200476 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:32:57.200476 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:32:57.200476 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 10:32:57.200476 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 10:32:57.200476 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 10:32:57.200476 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 10:32:57.200476 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 10:32:57.200476 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 10:32:57.200476 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 04 10:32:57.200476 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 10:32:57.202024 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b6b2670d-0db9-4734-a655-c372604f3b35 could not be found. Aug 04 10:32:57.202024 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Aug 04 10:32:57.202024 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:32:57.202024 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Aug 04 10:32:57.202024 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:32:57.202024 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:32:57.202024 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:32:57.202024 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 10:32:57.202024 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 10:32:57.202024 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b6b2670d-0db9-4734-a655-c372604f3b35 could not be found. Aug 04 10:32:57.202024 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Aug 04 10:32:57.202024 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-37ec672c-a97f-48a7-96d8-d7ecdc8a3e5b tempest-VolumesSnapshotsTestJSON-644414039 tempest-VolumesSnapshotsTestJSON-644414039-project] Returning 404 to user: Volume b6b2670d-0db9-4734-a655-c372604f3b35 could not be found. {{(pid=124457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 10:32:57.202024 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-37ec672c-a97f-48a7-96d8-d7ecdc8a3e5b tempest-VolumesSnapshotsTestJSON-644414039 tempest-VolumesSnapshotsTestJSON-644414039-project] 10.222.0.121 "GET /compute/v2.1/os-volumes/b6b2670d-0db9-4734-a655-c372604f3b35" status: 404 len: 109 microversion: 2.1 time: 0.061443 Aug 04 10:32:57.202024 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 22/32] 10.222.0.121 () {58 vars in 1250 bytes} [Thu Aug 4 10:32:57 2022] GET /compute/v2.1/os-volumes/b6b2670d-0db9-4734-a655-c372604f3b35 => generated 109 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 10:32:57.507663 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-caa05aac-8489-4d84-8bf4-ae2fb9007d60 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Action: 'create', calling method: .version_select at 0x7f6756cdb430>, body: {"keypair": {"name": "tempest-keypair-1939723963", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHW/XjMeq0Iaztr6ETR9hZXLLGeYjQ/Ix2+8B00D1oKMp6RSsJ+jg/I2lSYWatXUbSNj3xy1jRnAjMMOatDmKC3gD5PS4kT0zQXKdzQlA3tnuElsrAUc33SdW94u25xJ2Q=="}} {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:32:57.588361 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.quota [None req-caa05aac-8489-4d84-8bf4-ae2fb9007d60 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Getting quotas for project 051b6a3defca48d7b4f8bb6705f89f20. Resources: {'key_pairs'} {{(pid=124456) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 10:32:57.600219 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.quota [None req-caa05aac-8489-4d84-8bf4-ae2fb9007d60 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Getting quotas for user 41a38b5af1654f44bc6cb5832c2e8e87 and project 051b6a3defca48d7b4f8bb6705f89f20. Resources: {'key_pairs'} {{(pid=124456) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 10:32:57.667824 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-caa05aac-8489-4d84-8bf4-ae2fb9007d60 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] 10.222.0.121 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.921478 Aug 04 10:32:57.678739 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 11/33] 10.222.0.121 () {60 vars in 1164 bytes} [Thu Aug 4 10:32:56 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:32:59.225017 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-2a02abb3-7a1f-46a2-be1d-7c3247cac015 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1362564376", "imageRef": "46724bb5-955f-4f3f-bd6a-b561fdde55e3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5c01f911-dc6f-48de-b8e0-5f0ee7d072b9"}], "security_groups": [{"name": "tempest-securitygroup--935896228"}], "key_name": "tempest-keypair-597370449", "user_data": "}} {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:32:59.806847 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.network.neutron [None req-2a02abb3-7a1f-46a2-be1d-7c3247cac015 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] validate_networks() for [('5c01f911-dc6f-48de-b8e0-5f0ee7d072b9', None, None, None, None, None)] {{(pid=124457) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 10:33:01.835361 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-bc7795d0-2338-47bb-9f56-5051cf696cc0 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-122186522", "imageRef": "46724bb5-955f-4f3f-bd6a-b561fdde55e3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:33:02.051259 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.network.neutron [None req-bc7795d0-2338-47bb-9f56-5051cf696cc0 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] validate_networks() for [('9ac3f175-1782-4c6f-8b51-6c5067c45651', None, None, None, None, None)] {{(pid=124456) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 10:33:04.319694 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.virt.hardware [None req-2a02abb3-7a1f-46a2-be1d-7c3247cac015 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Flavor limits 0:0:0 {{(pid=124457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 10:33:04.320250 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.virt.hardware [None req-2a02abb3-7a1f-46a2-be1d-7c3247cac015 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Image limits 0:0:0 {{(pid=124457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 10:33:04.320616 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.virt.hardware [None req-2a02abb3-7a1f-46a2-be1d-7c3247cac015 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Flavor pref 0:0:0 {{(pid=124457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 10:33:04.321023 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.virt.hardware [None req-2a02abb3-7a1f-46a2-be1d-7c3247cac015 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Image pref 0:0:0 {{(pid=124457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 10:33:04.321736 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.virt.hardware [None req-2a02abb3-7a1f-46a2-be1d-7c3247cac015 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 10:33:04.357536 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-2a02abb3-7a1f-46a2-be1d-7c3247cac015 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:04.359331 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-2a02abb3-7a1f-46a2-be1d-7c3247cac015 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:04.362129 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-2a02abb3-7a1f-46a2-be1d-7c3247cac015 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:04.362980 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-2a02abb3-7a1f-46a2-be1d-7c3247cac015 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:04.416738 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.quota [None req-2a02abb3-7a1f-46a2-be1d-7c3247cac015 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Getting quotas for project 6f46ab11dd0b428486c673afc14b5b63. Resources: {'ram', 'instances', 'cores'} {{(pid=124457) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 10:33:04.426733 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.quota [None req-2a02abb3-7a1f-46a2-be1d-7c3247cac015 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Getting quotas for user 3aa2e2a5a6ed4c5c9db91269266dd30b and project 6f46ab11dd0b428486c673afc14b5b63. Resources: {'ram', 'instances', 'cores'} {{(pid=124457) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 10:33:04.447261 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-2a02abb3-7a1f-46a2-be1d-7c3247cac015 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Going to run 1 instances... {{(pid=124457) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 10:33:04.456670 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-2a02abb3-7a1f-46a2-be1d-7c3247cac015 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] [instance: 81259012-5f3b-44f6-b979-39119f14929b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='46724bb5-955f-4f3f-bd6a-b561fdde55e3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124457) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 10:33:04.690214 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-2a02abb3-7a1f-46a2-be1d-7c3247cac015 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] 10.222.0.121 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 5.463271 Aug 04 10:33:04.690214 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 23/34] 10.222.0.121 () {60 vars in 1152 bytes} [Thu Aug 4 10:32:59 2022] POST /compute/v2.1/servers => generated 403 bytes in 5465 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 04 10:33:05.039320 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.virt.hardware [None req-bc7795d0-2338-47bb-9f56-5051cf696cc0 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Flavor limits 0:0:0 {{(pid=124456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 10:33:05.040061 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.virt.hardware [None req-bc7795d0-2338-47bb-9f56-5051cf696cc0 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Image limits 0:0:0 {{(pid=124456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 10:33:05.040552 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.virt.hardware [None req-bc7795d0-2338-47bb-9f56-5051cf696cc0 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Flavor pref 0:0:0 {{(pid=124456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 10:33:05.040993 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.virt.hardware [None req-bc7795d0-2338-47bb-9f56-5051cf696cc0 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Image pref 0:0:0 {{(pid=124456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 10:33:05.041405 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.virt.hardware [None req-bc7795d0-2338-47bb-9f56-5051cf696cc0 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 10:33:05.059642 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-bc7795d0-2338-47bb-9f56-5051cf696cc0 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:05.061316 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-bc7795d0-2338-47bb-9f56-5051cf696cc0 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:05.062836 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-bc7795d0-2338-47bb-9f56-5051cf696cc0 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:05.064114 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-bc7795d0-2338-47bb-9f56-5051cf696cc0 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:05.101738 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.quota [None req-bc7795d0-2338-47bb-9f56-5051cf696cc0 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Getting quotas for project 7121bd118a2549c39332cfdb7edaa92f. Resources: {'ram', 'instances', 'cores'} {{(pid=124456) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 10:33:05.111520 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.quota [None req-bc7795d0-2338-47bb-9f56-5051cf696cc0 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Getting quotas for user 3170dc3323f54512bc8819c8efa86b0f and project 7121bd118a2549c39332cfdb7edaa92f. Resources: {'ram', 'instances', 'cores'} {{(pid=124456) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 10:33:05.141578 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-bc7795d0-2338-47bb-9f56-5051cf696cc0 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Going to run 1 instances... {{(pid=124456) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 10:33:05.146571 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-bc7795d0-2338-47bb-9f56-5051cf696cc0 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] [instance: 9b09b542-5b10-4244-88af-cb6de23588d8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='46724bb5-955f-4f3f-bd6a-b561fdde55e3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124456) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 10:33:05.261280 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-bc7795d0-2338-47bb-9f56-5051cf696cc0 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] 10.222.0.121 "POST /compute/v2.1/servers" status: 202 len: 385 microversion: 2.1 time: 3.994986 Aug 04 10:33:05.262236 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 12/35] 10.222.0.121 () {60 vars in 1152 bytes} [Thu Aug 4 10:33:01 2022] POST /compute/v2.1/servers => generated 385 bytes in 3997 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Aug 04 10:33:05.315123 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-14592699-c35c-468d-9a0b-b85781fe9bef tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-948819574", "imageRef": "46724bb5-955f-4f3f-bd6a-b561fdde55e3", "flavorRef": "452", "networks": [{"uuid": "60b371be-6128-452c-be35-d23ddf5aafbf"}]}} {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:33:05.406183 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.network.neutron [None req-14592699-c35c-468d-9a0b-b85781fe9bef tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] validate_networks() for [('60b371be-6128-452c-be35-d23ddf5aafbf', None, None, None, None, None)] {{(pid=124457) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 10:33:05.754677 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-e7b71a51-37ed-4a11-90c5-54a02a98734a tempest-VolumesGetTestJSON-757648928 tempest-VolumesGetTestJSON-757648928-project] Action: 'create', calling method: .version_select at 0x7f6756400dc0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-801617688", "metadata": {"Type": "work"}}} {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:33:06.084510 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.virt.hardware [None req-14592699-c35c-468d-9a0b-b85781fe9bef tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Flavor limits 0:0:0 {{(pid=124457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 10:33:06.084950 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.virt.hardware [None req-14592699-c35c-468d-9a0b-b85781fe9bef tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Image limits 0:0:0 {{(pid=124457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 10:33:06.085499 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.virt.hardware [None req-14592699-c35c-468d-9a0b-b85781fe9bef tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Flavor pref 0:0:0 {{(pid=124457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 10:33:06.086104 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.virt.hardware [None req-14592699-c35c-468d-9a0b-b85781fe9bef tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Image pref 0:0:0 {{(pid=124457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 10:33:06.086696 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.virt.hardware [None req-14592699-c35c-468d-9a0b-b85781fe9bef tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 10:33:06.112858 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-14592699-c35c-468d-9a0b-b85781fe9bef tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:06.113340 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-14592699-c35c-468d-9a0b-b85781fe9bef tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:06.123059 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-14592699-c35c-468d-9a0b-b85781fe9bef tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:06.123679 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-14592699-c35c-468d-9a0b-b85781fe9bef tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:06.281212 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.quota [None req-14592699-c35c-468d-9a0b-b85781fe9bef tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Getting quotas for project c167faad577d47dfaf0d010a3f983fe3. Resources: {'ram', 'instances', 'cores'} {{(pid=124457) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 10:33:06.308383 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.quota [None req-14592699-c35c-468d-9a0b-b85781fe9bef tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Getting quotas for user 9520a49687b24281b78f08d43cb27dc3 and project c167faad577d47dfaf0d010a3f983fe3. Resources: {'ram', 'instances', 'cores'} {{(pid=124457) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 10:33:06.340512 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-14592699-c35c-468d-9a0b-b85781fe9bef tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Going to run 1 instances... {{(pid=124457) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 10:33:06.343559 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-14592699-c35c-468d-9a0b-b85781fe9bef tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] [instance: cabceac5-859e-4c28-86c2-aa9b63953009] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='46724bb5-955f-4f3f-bd6a-b561fdde55e3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124457) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 10:33:06.432603 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-14592699-c35c-468d-9a0b-b85781fe9bef tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] 10.222.0.121 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 1.737877 Aug 04 10:33:06.434589 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 24/36] 10.222.0.121 () {60 vars in 1152 bytes} [Thu Aug 4 10:33:04 2022] POST /compute/v2.1/servers => generated 382 bytes in 1751 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 04 10:33:06.441308 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-b5108e50-5fa8-4ba7-9db6-e48167f732c5 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:33:06.442676 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-b5108e50-5fa8-4ba7-9db6-e48167f732c5 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] [instance: 81259012-5f3b-44f6-b979-39119f14929b] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:33:06.756563 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-e7b71a51-37ed-4a11-90c5-54a02a98734a tempest-VolumesGetTestJSON-757648928 tempest-VolumesGetTestJSON-757648928-project] 10.222.0.121 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 1.492748 Aug 04 10:33:06.758332 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 13/37] 10.222.0.121 () {60 vars in 1161 bytes} [Thu Aug 4 10:33:05 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 1495 msecs (HTTP/1.1 200) 10 headers in 449 bytes (1 switches on core 0) Aug 04 10:33:06.764712 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-d9f782b9-3533-4c5d-9588-96dc9063bbae tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1671305972", "imageRef": "46724bb5-955f-4f3f-bd6a-b561fdde55e3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ddbd5a12-fb68-4b76-a245-c2162d57f8f9"}], "security_groups": [{"name": "tempest-securitygroup--697872651"}], "key_name": "tempest-keypair-1939723963", "user_data": "}} {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:33:06.831418 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-b5108e50-5fa8-4ba7-9db6-e48167f732c5 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa2e2a5a6ed4c5c9db91269266dd30b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f46ab11dd0b428486c673afc14b5b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:33:06.872565 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-b5108e50-5fa8-4ba7-9db6-e48167f732c5 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] 10.222.0.121 "GET /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b" status: 200 len: 1241 microversion: 2.1 time: 0.436231 Aug 04 10:33:06.900514 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 25/38] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:33:06 2022] GET /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b => generated 1241 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:33:06.920168 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-20594ada-88f8-4030-a2fc-a3f52ed5a427 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:33:06.920919 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-20594ada-88f8-4030-a2fc-a3f52ed5a427 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] [instance: 9b09b542-5b10-4244-88af-cb6de23588d8] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:33:07.076488 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-20594ada-88f8-4030-a2fc-a3f52ed5a427 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3170dc3323f54512bc8819c8efa86b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7121bd118a2549c39332cfdb7edaa92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:33:07.091234 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-20594ada-88f8-4030-a2fc-a3f52ed5a427 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] 10.222.0.121 "GET /compute/v2.1/servers/9b09b542-5b10-4244-88af-cb6de23588d8" status: 200 len: 1225 microversion: 2.1 time: 0.186805 Aug 04 10:33:07.110979 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 26/39] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:33:06 2022] GET /compute/v2.1/servers/9b09b542-5b10-4244-88af-cb6de23588d8 => generated 1225 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:33:07.117148 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.network.neutron [None req-d9f782b9-3533-4c5d-9588-96dc9063bbae tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] validate_networks() for [('ddbd5a12-fb68-4b76-a245-c2162d57f8f9', None, None, None, None, None)] {{(pid=124456) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 10:33:07.132252 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-6e80118c-1ebe-46fa-a19a-2e84903c6c9f tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:33:07.146736 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-6e80118c-1ebe-46fa-a19a-2e84903c6c9f tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] [instance: cabceac5-859e-4c28-86c2-aa9b63953009] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:33:07.562074 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-6e80118c-1ebe-46fa-a19a-2e84903c6c9f tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9520a49687b24281b78f08d43cb27dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c167faad577d47dfaf0d010a3f983fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:33:07.578471 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-6e80118c-1ebe-46fa-a19a-2e84903c6c9f tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] 10.222.0.121 "GET /compute/v2.1/servers/cabceac5-859e-4c28-86c2-aa9b63953009" status: 200 len: 1218 microversion: 2.1 time: 0.462809 Aug 04 10:33:07.596345 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 27/40] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:33:07 2022] GET /compute/v2.1/servers/cabceac5-859e-4c28-86c2-aa9b63953009 => generated 1218 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:33:07.605808 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-2146d027-a320-486d-846d-43ed8c4c024f tempest-VolumesGetTestJSON-757648928 tempest-VolumesGetTestJSON-757648928-project] Calling method '.version_select at 0x7f6755bad670>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:33:07.698760 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-2146d027-a320-486d-846d-43ed8c4c024f tempest-VolumesGetTestJSON-757648928 tempest-VolumesGetTestJSON-757648928-project] 10.222.0.121 "GET /compute/v2.1/os-volumes/f283e7c6-e77c-4bc2-a359-c77071dc30d9" status: 200 len: 352 microversion: 2.1 time: 0.100402 Aug 04 10:33:07.700298 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 28/41] 10.222.0.121 () {58 vars in 1250 bytes} [Thu Aug 4 10:33:07 2022] GET /compute/v2.1/os-volumes/f283e7c6-e77c-4bc2-a359-c77071dc30d9 => generated 352 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:33:07.706906 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-0ecfe32e-9760-4a2d-9080-1d61dd940d27 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-457503661", "imageRef": "46724bb5-955f-4f3f-bd6a-b561fdde55e3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:33:07.799429 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.network.neutron [None req-0ecfe32e-9760-4a2d-9080-1d61dd940d27 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] validate_networks() for [('9ac3f175-1782-4c6f-8b51-6c5067c45651', None, None, None, None, None)] {{(pid=124457) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 10:33:08.577941 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.virt.hardware [None req-d9f782b9-3533-4c5d-9588-96dc9063bbae tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Flavor limits 0:0:0 {{(pid=124456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 10:33:08.579554 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.virt.hardware [None req-d9f782b9-3533-4c5d-9588-96dc9063bbae tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Image limits 0:0:0 {{(pid=124456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 10:33:08.580341 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.virt.hardware [None req-d9f782b9-3533-4c5d-9588-96dc9063bbae tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Flavor pref 0:0:0 {{(pid=124456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 10:33:08.580987 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.virt.hardware [None req-d9f782b9-3533-4c5d-9588-96dc9063bbae tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Image pref 0:0:0 {{(pid=124456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 10:33:08.581545 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.virt.hardware [None req-d9f782b9-3533-4c5d-9588-96dc9063bbae tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 10:33:08.606194 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-d9f782b9-3533-4c5d-9588-96dc9063bbae tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:08.608633 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-d9f782b9-3533-4c5d-9588-96dc9063bbae tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:08.611347 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-d9f782b9-3533-4c5d-9588-96dc9063bbae tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:08.613318 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-d9f782b9-3533-4c5d-9588-96dc9063bbae tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:08.725229 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.quota [None req-d9f782b9-3533-4c5d-9588-96dc9063bbae tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Getting quotas for project 051b6a3defca48d7b4f8bb6705f89f20. Resources: {'ram', 'instances', 'cores'} {{(pid=124456) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 10:33:08.754025 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.quota [None req-d9f782b9-3533-4c5d-9588-96dc9063bbae tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Getting quotas for user 41a38b5af1654f44bc6cb5832c2e8e87 and project 051b6a3defca48d7b4f8bb6705f89f20. Resources: {'ram', 'instances', 'cores'} {{(pid=124456) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 10:33:08.818377 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-d9f782b9-3533-4c5d-9588-96dc9063bbae tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Going to run 1 instances... {{(pid=124456) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 10:33:08.833898 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-d9f782b9-3533-4c5d-9588-96dc9063bbae tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] [instance: c6dec6e8-e2f9-4c57-8326-19fc989b5c6e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='46724bb5-955f-4f3f-bd6a-b561fdde55e3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124456) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 10:33:08.963481 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-d9f782b9-3533-4c5d-9588-96dc9063bbae tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] 10.222.0.121 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 2.203835 Aug 04 10:33:08.967033 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 14/42] 10.222.0.121 () {60 vars in 1152 bytes} [Thu Aug 4 10:33:06 2022] POST /compute/v2.1/servers => generated 403 bytes in 2208 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 04 10:33:08.983129 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-3ebb7330-c2b7-4363-916e-51a46732451c tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:33:08.988328 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-3ebb7330-c2b7-4363-916e-51a46732451c tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] [instance: 81259012-5f3b-44f6-b979-39119f14929b] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:33:09.040994 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-3ebb7330-c2b7-4363-916e-51a46732451c tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:09.042769 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-3ebb7330-c2b7-4363-916e-51a46732451c tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:09.044010 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-3ebb7330-c2b7-4363-916e-51a46732451c tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:09.044891 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-3ebb7330-c2b7-4363-916e-51a46732451c tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:09.071627 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.virt.hardware [None req-0ecfe32e-9760-4a2d-9080-1d61dd940d27 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Flavor limits 0:0:0 {{(pid=124457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 10:33:09.072845 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.virt.hardware [None req-0ecfe32e-9760-4a2d-9080-1d61dd940d27 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Image limits 0:0:0 {{(pid=124457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 10:33:09.074243 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.virt.hardware [None req-0ecfe32e-9760-4a2d-9080-1d61dd940d27 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Flavor pref 0:0:0 {{(pid=124457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 10:33:09.074832 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.virt.hardware [None req-0ecfe32e-9760-4a2d-9080-1d61dd940d27 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Image pref 0:0:0 {{(pid=124457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 10:33:09.075449 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.virt.hardware [None req-0ecfe32e-9760-4a2d-9080-1d61dd940d27 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 10:33:09.093533 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-0ecfe32e-9760-4a2d-9080-1d61dd940d27 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:09.098038 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-0ecfe32e-9760-4a2d-9080-1d61dd940d27 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:09.102511 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-0ecfe32e-9760-4a2d-9080-1d61dd940d27 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:09.103759 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-0ecfe32e-9760-4a2d-9080-1d61dd940d27 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:09.160567 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.quota [None req-0ecfe32e-9760-4a2d-9080-1d61dd940d27 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Getting quotas for project 7121bd118a2549c39332cfdb7edaa92f. Resources: {'ram', 'instances', 'cores'} {{(pid=124457) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 10:33:09.170640 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.quota [None req-0ecfe32e-9760-4a2d-9080-1d61dd940d27 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Getting quotas for user 3170dc3323f54512bc8819c8efa86b0f and project 7121bd118a2549c39332cfdb7edaa92f. Resources: {'ram', 'instances', 'cores'} {{(pid=124457) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 10:33:09.217070 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-0ecfe32e-9760-4a2d-9080-1d61dd940d27 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Going to run 1 instances... {{(pid=124457) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 10:33:09.220481 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-0ecfe32e-9760-4a2d-9080-1d61dd940d27 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] [instance: 2583b630-2f89-45ba-b781-c0b7c206d61e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='46724bb5-955f-4f3f-bd6a-b561fdde55e3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124457) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 10:33:09.337329 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-0ecfe32e-9760-4a2d-9080-1d61dd940d27 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] 10.222.0.121 "POST /compute/v2.1/servers" status: 202 len: 385 microversion: 2.1 time: 1.635231 Aug 04 10:33:09.338373 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 29/43] 10.222.0.121 () {60 vars in 1152 bytes} [Thu Aug 4 10:33:07 2022] POST /compute/v2.1/servers => generated 385 bytes in 1637 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 04 10:33:09.344653 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-3bf5a6cb-0fb5-479a-afae-27947a9cbc6b tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:33:09.345674 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-3bf5a6cb-0fb5-479a-afae-27947a9cbc6b tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] [instance: cabceac5-859e-4c28-86c2-aa9b63953009] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:33:09.354866 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-3bf5a6cb-0fb5-479a-afae-27947a9cbc6b tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:09.355495 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-3bf5a6cb-0fb5-479a-afae-27947a9cbc6b tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:09.357678 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-3bf5a6cb-0fb5-479a-afae-27947a9cbc6b tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:09.358912 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-3bf5a6cb-0fb5-479a-afae-27947a9cbc6b tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:09.473280 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-3ebb7330-c2b7-4363-916e-51a46732451c tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa2e2a5a6ed4c5c9db91269266dd30b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f46ab11dd0b428486c673afc14b5b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:33:09.531891 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-3ebb7330-c2b7-4363-916e-51a46732451c tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] 10.222.0.121 "GET /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b" status: 200 len: 1293 microversion: 2.1 time: 0.555743 Aug 04 10:33:09.533399 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 15/44] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:33:08 2022] GET /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b => generated 1293 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:33:09.550849 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-c398e63c-a5db-47f5-a3f3-249ffe389692 tempest-VolumesGetTestJSON-757648928 tempest-VolumesGetTestJSON-757648928-project] Calling method '.version_select at 0x7f67553b2160>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:33:09.586449 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-3bf5a6cb-0fb5-479a-afae-27947a9cbc6b tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9520a49687b24281b78f08d43cb27dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c167faad577d47dfaf0d010a3f983fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:33:09.607677 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-3bf5a6cb-0fb5-479a-afae-27947a9cbc6b tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] 10.222.0.121 "GET /compute/v2.1/servers/cabceac5-859e-4c28-86c2-aa9b63953009" status: 200 len: 1270 microversion: 2.1 time: 0.267540 Aug 04 10:33:09.608776 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 30/45] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:33:09 2022] GET /compute/v2.1/servers/cabceac5-859e-4c28-86c2-aa9b63953009 => generated 1270 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:33:09.614298 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-32b3e63d-a0a0-48dd-86aa-2281d75358ba tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:33:09.615007 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-32b3e63d-a0a0-48dd-86aa-2281d75358ba tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] [instance: c6dec6e8-e2f9-4c57-8326-19fc989b5c6e] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:33:09.702444 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-c398e63c-a5db-47f5-a3f3-249ffe389692 tempest-VolumesGetTestJSON-757648928 tempest-VolumesGetTestJSON-757648928-project] 10.222.0.121 "GET /compute/v2.1/os-volumes/f283e7c6-e77c-4bc2-a359-c77071dc30d9" status: 200 len: 353 microversion: 2.1 time: 0.167626 Aug 04 10:33:09.703348 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 16/46] 10.222.0.121 () {58 vars in 1250 bytes} [Thu Aug 4 10:33:09 2022] GET /compute/v2.1/os-volumes/f283e7c6-e77c-4bc2-a359-c77071dc30d9 => generated 353 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:33:09.708510 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-31348740-8f6b-4b5a-8372-ffcb09be7829 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:33:09.709268 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-31348740-8f6b-4b5a-8372-ffcb09be7829 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] [instance: 2583b630-2f89-45ba-b781-c0b7c206d61e] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:33:09.729715 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-32b3e63d-a0a0-48dd-86aa-2281d75358ba tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a38b5af1654f44bc6cb5832c2e8e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051b6a3defca48d7b4f8bb6705f89f20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:33:09.737644 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-32b3e63d-a0a0-48dd-86aa-2281d75358ba tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] 10.222.0.121 "GET /compute/v2.1/servers/c6dec6e8-e2f9-4c57-8326-19fc989b5c6e" status: 200 len: 1246 microversion: 2.1 time: 0.127625 Aug 04 10:33:09.739600 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 31/47] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:33:09 2022] GET /compute/v2.1/servers/c6dec6e8-e2f9-4c57-8326-19fc989b5c6e => generated 1246 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:33:09.759246 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-042fa1fb-70e0-4e56-9844-d4f5f1f1baac tempest-VolumesGetTestJSON-757648928 tempest-VolumesGetTestJSON-757648928-project] Calling method '.version_select at 0x7f6755aca700>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:33:09.891670 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-31348740-8f6b-4b5a-8372-ffcb09be7829 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3170dc3323f54512bc8819c8efa86b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7121bd118a2549c39332cfdb7edaa92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:33:09.922956 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-31348740-8f6b-4b5a-8372-ffcb09be7829 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] 10.222.0.121 "GET /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e" status: 200 len: 1225 microversion: 2.1 time: 0.214829 Aug 04 10:33:09.927449 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 17/48] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:33:09 2022] GET /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e => generated 1225 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:33:09.954837 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-042fa1fb-70e0-4e56-9844-d4f5f1f1baac tempest-VolumesGetTestJSON-757648928 tempest-VolumesGetTestJSON-757648928-project] 10.222.0.121 "GET /compute/v2.1/os-volumes/f283e7c6-e77c-4bc2-a359-c77071dc30d9" status: 200 len: 353 microversion: 2.1 time: 0.212126 Aug 04 10:33:09.955878 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 32/49] 10.222.0.121 () {58 vars in 1250 bytes} [Thu Aug 4 10:33:09 2022] GET /compute/v2.1/os-volumes/f283e7c6-e77c-4bc2-a359-c77071dc30d9 => generated 353 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:33:09.978531 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-35a4b0ba-738c-4942-aee2-320c5a49f31f tempest-VolumesGetTestJSON-757648928 tempest-VolumesGetTestJSON-757648928-project] Calling method '.version_select at 0x7f6756400b80>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:33:10.222809 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-35a4b0ba-738c-4942-aee2-320c5a49f31f tempest-VolumesGetTestJSON-757648928 tempest-VolumesGetTestJSON-757648928-project] 10.222.0.121 "DELETE /compute/v2.1/os-volumes/f283e7c6-e77c-4bc2-a359-c77071dc30d9" status: 202 len: 0 microversion: 2.1 time: 0.248147 Aug 04 10:33:10.227467 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 18/50] 10.222.0.121 () {58 vars in 1253 bytes} [Thu Aug 4 10:33:09 2022] DELETE /compute/v2.1/os-volumes/f283e7c6-e77c-4bc2-a359-c77071dc30d9 => generated 0 bytes in 254 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 10:33:10.233601 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-cbf0e681-8ea2-4626-806e-d423a457eb48 tempest-VolumesGetTestJSON-757648928 tempest-VolumesGetTestJSON-757648928-project] Calling method '.version_select at 0x7f6755ad8670>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:33:10.572290 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-04691f16-8cef-4a86-873d-3146230cc520 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:33:10.573076 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-04691f16-8cef-4a86-873d-3146230cc520 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] [instance: 81259012-5f3b-44f6-b979-39119f14929b] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:33:10.596284 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-04691f16-8cef-4a86-873d-3146230cc520 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:10.596816 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-04691f16-8cef-4a86-873d-3146230cc520 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:10.598893 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-04691f16-8cef-4a86-873d-3146230cc520 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:10.600861 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-04691f16-8cef-4a86-873d-3146230cc520 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:10.731507 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.wsgi [None req-cbf0e681-8ea2-4626-806e-d423a457eb48 tempest-VolumesGetTestJSON-757648928 tempest-VolumesGetTestJSON-757648928-project] HTTP exception thrown: Volume f283e7c6-e77c-4bc2-a359-c77071dc30d9 could not be found. Aug 04 10:33:10.733728 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-cbf0e681-8ea2-4626-806e-d423a457eb48 tempest-VolumesGetTestJSON-757648928 tempest-VolumesGetTestJSON-757648928-project] Request method failure captured: Aug 04 10:33:10.733728 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: request: GET /compute/v2.1/os-volumes/f283e7c6-e77c-4bc2-a359-c77071dc30d9 HTTP/1.1 Aug 04 10:33:10.733728 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: Accept: application/json Aug 04 10:33:10.733728 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: Accept-Encoding: identity Aug 04 10:33:10.733728 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: Connection: close Aug 04 10:33:10.733728 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: Content-Length: 0 Aug 04 10:33:10.733728 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: Content-Type: application/json Aug 04 10:33:10.733728 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: Host: 10.222.0.121 Aug 04 10:33:10.733728 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: Openstack-System-Scope: None Aug 04 10:33:10.733728 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: User-Agent: python-urllib3/1.26.11 Aug 04 10:33:10.733728 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Auth-Token: gAAAAABi66BfrEHuJJNvY1yV3nrHcASkEUO5Ftg454nf2t26OOsPcfdN3Xm92g_NYpKcZkdigDeWzAtBvgpsC5XGvnM1CVCrcjfmSSME6t88XBDzE3hRCjhoaFnOGYWpJfPQbw1E3vIbKEWnHjQlkFhhRj_xBa0bfeKkfLxUGHQHMv2SRocRD_E Aug 04 10:33:10.733728 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Domain-Id: None Aug 04 10:33:10.733728 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Domain-Name: None Aug 04 10:33:10.733728 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Identity-Status: Confirmed Aug 04 10:33:10.733728 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Is-Admin-Project: True Aug 04 10:33:10.733728 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Project-Domain-Id: default Aug 04 10:33:10.733728 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Project-Domain-Name: Default Aug 04 10:33:10.733728 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Project-Id: 9f9794c4379f4aa5a930a8dd20be7628 Aug 04 10:33:10.733728 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Project-Name: tempest-VolumesGetTestJSON-757648928 Aug 04 10:33:10.733728 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Role: reader,member Aug 04 10:33:10.733728 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Roles: reader,member Aug 04 10:33:10.735114 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/9f9794c4379f4aa5a930a8dd20be7628"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/9f9794c4379f4aa5a930a8dd20be7628"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.121:8080", "publicURL": "http://10.222.0.121:8080/v1/AUTH_9f9794c4379f4aa5a930a8dd20be7628"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2/9f9794c4379f4aa5a930a8dd20be7628"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:9696/networking"}]}] Aug 04 10:33:10.735114 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Tenant: tempest-VolumesGetTestJSON-757648928 Aug 04 10:33:10.735114 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Tenant-Id: 9f9794c4379f4aa5a930a8dd20be7628 Aug 04 10:33:10.735114 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Tenant-Name: tempest-VolumesGetTestJSON-757648928 Aug 04 10:33:10.735114 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-User: tempest-VolumesGetTestJSON-757648928-project Aug 04 10:33:10.735114 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-User-Domain-Id: default Aug 04 10:33:10.735114 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-User-Domain-Name: Default Aug 04 10:33:10.735114 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-User-Id: 0a08d4bc8dde46748c82dd3a5409f230 Aug 04 10:33:10.735114 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-User-Name: tempest-VolumesGetTestJSON-757648928-project Aug 04 10:33:10.735114 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: method: Aug 04 10:33:10.735114 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: exception: Volume f283e7c6-e77c-4bc2-a359-c77071dc30d9 could not be found. Aug 04 10:33:10.735114 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: action_args: {'id': 'f283e7c6-e77c-4bc2-a359-c77071dc30d9'} Aug 04 10:33:10.735114 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 10:33:10.735804 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:33:10.735804 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 10:33:10.735804 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 10:33:10.735804 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 04 10:33:10.735804 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 04 10:33:10.735804 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 04 10:33:10.735804 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 04 10:33:10.735804 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 04 10:33:10.735804 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 04 10:33:10.735804 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 04 10:33:10.735804 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 04 10:33:10.735804 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 10:33:10.735804 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 10:33:10.735804 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 10:33:10.735804 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 10:33:10.735804 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f283e7c6-e77c-4bc2-a359-c77071dc30d9 could not be found. (HTTP 404) (Request-ID: req-f92d7894-c950-4c24-851f-7171665f6a5b) Aug 04 10:33:10.735804 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Aug 04 10:33:10.735804 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:33:10.735804 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Aug 04 10:33:10.736825 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:33:10.736825 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 04 10:33:10.736825 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 04 10:33:10.736825 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 04 10:33:10.736825 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 04 10:33:10.736825 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 04 10:33:10.736825 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 04 10:33:10.736825 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 04 10:33:10.736825 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 04 10:33:10.736825 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 10:33:10.736825 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 10:33:10.736825 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 04 10:33:10.736825 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 04 10:33:10.736825 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 04 10:33:10.736825 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 04 10:33:10.736825 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 04 10:33:10.736825 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 04 10:33:10.736825 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 04 10:33:10.736825 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 04 10:33:10.738448 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 10:33:10.738448 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 10:33:10.738448 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 10:33:10.738448 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 10:33:10.738448 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f283e7c6-e77c-4bc2-a359-c77071dc30d9 could not be found. Aug 04 10:33:10.738448 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Aug 04 10:33:10.738448 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:33:10.738448 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Aug 04 10:33:10.738448 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:33:10.738448 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:33:10.738448 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:33:10.738448 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 10:33:10.738448 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 10:33:10.738448 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 10:33:10.738448 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 10:33:10.738448 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 10:33:10.738448 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 10:33:10.738448 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 04 10:33:10.738448 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 10:33:10.740595 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f283e7c6-e77c-4bc2-a359-c77071dc30d9 could not be found. Aug 04 10:33:10.740595 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Aug 04 10:33:10.740595 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:33:10.740595 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Aug 04 10:33:10.740595 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:33:10.740595 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:33:10.740595 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:33:10.740595 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 10:33:10.740595 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 10:33:10.740595 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f283e7c6-e77c-4bc2-a359-c77071dc30d9 could not be found. Aug 04 10:33:10.740595 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Aug 04 10:33:10.743473 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-cbf0e681-8ea2-4626-806e-d423a457eb48 tempest-VolumesGetTestJSON-757648928 tempest-VolumesGetTestJSON-757648928-project] Returning 404 to user: Volume f283e7c6-e77c-4bc2-a359-c77071dc30d9 could not be found. {{(pid=124457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 10:33:10.754994 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-cbf0e681-8ea2-4626-806e-d423a457eb48 tempest-VolumesGetTestJSON-757648928 tempest-VolumesGetTestJSON-757648928-project] 10.222.0.121 "GET /compute/v2.1/os-volumes/f283e7c6-e77c-4bc2-a359-c77071dc30d9" status: 404 len: 109 microversion: 2.1 time: 0.515647 Aug 04 10:33:10.756962 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 33/51] 10.222.0.121 () {58 vars in 1250 bytes} [Thu Aug 4 10:33:10 2022] GET /compute/v2.1/os-volumes/f283e7c6-e77c-4bc2-a359-c77071dc30d9 => generated 109 bytes in 529 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 10:33:10.767259 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-e0a8957e-900a-4147-99ba-df70c3aacfeb tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:33:10.768142 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-e0a8957e-900a-4147-99ba-df70c3aacfeb tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] [instance: cabceac5-859e-4c28-86c2-aa9b63953009] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:33:10.800462 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-e0a8957e-900a-4147-99ba-df70c3aacfeb tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:10.801287 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-e0a8957e-900a-4147-99ba-df70c3aacfeb tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:10.803671 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-e0a8957e-900a-4147-99ba-df70c3aacfeb tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:10.806432 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-e0a8957e-900a-4147-99ba-df70c3aacfeb tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:11.454834 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-e0a8957e-900a-4147-99ba-df70c3aacfeb tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9520a49687b24281b78f08d43cb27dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c167faad577d47dfaf0d010a3f983fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:33:11.466554 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-04691f16-8cef-4a86-873d-3146230cc520 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa2e2a5a6ed4c5c9db91269266dd30b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f46ab11dd0b428486c673afc14b5b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:33:11.478641 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-e0a8957e-900a-4147-99ba-df70c3aacfeb tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] 10.222.0.121 "GET /compute/v2.1/servers/cabceac5-859e-4c28-86c2-aa9b63953009" status: 200 len: 1288 microversion: 2.1 time: 0.718193 Aug 04 10:33:11.479288 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 34/52] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:33:10 2022] GET /compute/v2.1/servers/cabceac5-859e-4c28-86c2-aa9b63953009 => generated 1288 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:33:11.499324 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-4583d3bd-75e7-4d0f-b833-847cee758d2b tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:33:11.501888 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-4583d3bd-75e7-4d0f-b833-847cee758d2b tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] [instance: c6dec6e8-e2f9-4c57-8326-19fc989b5c6e] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:33:11.535264 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-04691f16-8cef-4a86-873d-3146230cc520 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] 10.222.0.121 "GET /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b" status: 200 len: 1301 microversion: 2.1 time: 0.972955 Aug 04 10:33:11.536373 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-4583d3bd-75e7-4d0f-b833-847cee758d2b tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:11.536842 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-4583d3bd-75e7-4d0f-b833-847cee758d2b tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:11.537669 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-4583d3bd-75e7-4d0f-b833-847cee758d2b tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:11.538133 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-4583d3bd-75e7-4d0f-b833-847cee758d2b tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:11.539586 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 19/53] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:33:10 2022] GET /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b => generated 1301 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:33:11.546849 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-237d7e20-2979-462f-b8ec-60ea90360473 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:33:11.547706 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-237d7e20-2979-462f-b8ec-60ea90360473 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] [instance: 2583b630-2f89-45ba-b781-c0b7c206d61e] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:33:11.588438 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-237d7e20-2979-462f-b8ec-60ea90360473 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:11.589248 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-237d7e20-2979-462f-b8ec-60ea90360473 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:11.590689 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-237d7e20-2979-462f-b8ec-60ea90360473 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:11.591713 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-237d7e20-2979-462f-b8ec-60ea90360473 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:11.860500 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-4583d3bd-75e7-4d0f-b833-847cee758d2b tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a38b5af1654f44bc6cb5832c2e8e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051b6a3defca48d7b4f8bb6705f89f20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:33:11.867253 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-237d7e20-2979-462f-b8ec-60ea90360473 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3170dc3323f54512bc8819c8efa86b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7121bd118a2549c39332cfdb7edaa92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:33:11.875893 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-237d7e20-2979-462f-b8ec-60ea90360473 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] 10.222.0.121 "GET /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e" status: 200 len: 1221 microversion: 2.1 time: 0.334766 Aug 04 10:33:11.880162 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 20/54] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:33:11 2022] GET /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e => generated 1221 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:33:11.881269 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-4583d3bd-75e7-4d0f-b833-847cee758d2b tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] 10.222.0.121 "GET /compute/v2.1/servers/c6dec6e8-e2f9-4c57-8326-19fc989b5c6e" status: 200 len: 1298 microversion: 2.1 time: 0.398293 Aug 04 10:33:11.901785 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 35/55] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:33:11 2022] GET /compute/v2.1/servers/c6dec6e8-e2f9-4c57-8326-19fc989b5c6e => generated 1298 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:33:12.509869 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-e623ddef-9bd0-4b80-98ed-87cfce060cb9 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:33:12.522687 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-e623ddef-9bd0-4b80-98ed-87cfce060cb9 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] [instance: cabceac5-859e-4c28-86c2-aa9b63953009] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:33:12.539257 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-e623ddef-9bd0-4b80-98ed-87cfce060cb9 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:12.540022 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-e623ddef-9bd0-4b80-98ed-87cfce060cb9 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:12.544243 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-e623ddef-9bd0-4b80-98ed-87cfce060cb9 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:12.544916 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-e623ddef-9bd0-4b80-98ed-87cfce060cb9 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:12.574140 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-c48fbba9-e63a-4bda-8f1e-4cfa3a0356b2 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:33:12.575690 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-c48fbba9-e63a-4bda-8f1e-4cfa3a0356b2 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] [instance: 81259012-5f3b-44f6-b979-39119f14929b] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:33:12.604993 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-c48fbba9-e63a-4bda-8f1e-4cfa3a0356b2 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:12.605464 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-c48fbba9-e63a-4bda-8f1e-4cfa3a0356b2 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:12.606278 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-c48fbba9-e63a-4bda-8f1e-4cfa3a0356b2 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:12.621748 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-c48fbba9-e63a-4bda-8f1e-4cfa3a0356b2 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:12.734124 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-e623ddef-9bd0-4b80-98ed-87cfce060cb9 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9520a49687b24281b78f08d43cb27dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c167faad577d47dfaf0d010a3f983fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:33:12.748323 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-e623ddef-9bd0-4b80-98ed-87cfce060cb9 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] 10.222.0.121 "GET /compute/v2.1/servers/cabceac5-859e-4c28-86c2-aa9b63953009" status: 200 len: 1276 microversion: 2.1 time: 0.242140 Aug 04 10:33:12.749216 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 21/56] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:33:12 2022] GET /compute/v2.1/servers/cabceac5-859e-4c28-86c2-aa9b63953009 => generated 1276 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:33:12.908309 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-29cbf394-3219-44c6-a7a1-0f5a9fc80c2e tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:33:12.909647 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-29cbf394-3219-44c6-a7a1-0f5a9fc80c2e tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] [instance: c6dec6e8-e2f9-4c57-8326-19fc989b5c6e] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:33:12.945755 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-29cbf394-3219-44c6-a7a1-0f5a9fc80c2e tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:12.947821 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-29cbf394-3219-44c6-a7a1-0f5a9fc80c2e tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:12.950531 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-29cbf394-3219-44c6-a7a1-0f5a9fc80c2e tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:12.951734 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-29cbf394-3219-44c6-a7a1-0f5a9fc80c2e tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:13.044947 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-c48fbba9-e63a-4bda-8f1e-4cfa3a0356b2 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa2e2a5a6ed4c5c9db91269266dd30b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f46ab11dd0b428486c673afc14b5b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:33:13.069742 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-c48fbba9-e63a-4bda-8f1e-4cfa3a0356b2 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] 10.222.0.121 "GET /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b" status: 200 len: 1299 microversion: 2.1 time: 0.501620 Aug 04 10:33:13.071062 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 36/57] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:33:12 2022] GET /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b => generated 1299 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 10:33:13.082922 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-f37fa5f8-f062-4261-bcc2-85799c6f20b8 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:33:13.090222 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-f37fa5f8-f062-4261-bcc2-85799c6f20b8 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] [instance: 2583b630-2f89-45ba-b781-c0b7c206d61e] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:33:13.107135 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-f37fa5f8-f062-4261-bcc2-85799c6f20b8 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:13.107936 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-f37fa5f8-f062-4261-bcc2-85799c6f20b8 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:13.109148 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-f37fa5f8-f062-4261-bcc2-85799c6f20b8 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:13.115010 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-f37fa5f8-f062-4261-bcc2-85799c6f20b8 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:13.462511 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-29cbf394-3219-44c6-a7a1-0f5a9fc80c2e tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a38b5af1654f44bc6cb5832c2e8e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051b6a3defca48d7b4f8bb6705f89f20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:33:13.473202 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-29cbf394-3219-44c6-a7a1-0f5a9fc80c2e tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] 10.222.0.121 "GET /compute/v2.1/servers/c6dec6e8-e2f9-4c57-8326-19fc989b5c6e" status: 200 len: 1298 microversion: 2.1 time: 0.572502 Aug 04 10:33:13.478967 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 22/58] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:33:12 2022] GET /compute/v2.1/servers/c6dec6e8-e2f9-4c57-8326-19fc989b5c6e => generated 1298 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:33:13.595118 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-f37fa5f8-f062-4261-bcc2-85799c6f20b8 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3170dc3323f54512bc8819c8efa86b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7121bd118a2549c39332cfdb7edaa92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:33:13.609286 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-f37fa5f8-f062-4261-bcc2-85799c6f20b8 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] 10.222.0.121 "GET /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e" status: 200 len: 1221 microversion: 2.1 time: 0.532194 Aug 04 10:33:13.612167 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 37/59] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:33:13 2022] GET /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e => generated 1221 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:33:13.774654 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-8d5d01db-51f7-45eb-97b3-a59e66f6d425 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:33:13.775309 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-8d5d01db-51f7-45eb-97b3-a59e66f6d425 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] [instance: cabceac5-859e-4c28-86c2-aa9b63953009] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:33:13.809222 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-8d5d01db-51f7-45eb-97b3-a59e66f6d425 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:13.809732 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-8d5d01db-51f7-45eb-97b3-a59e66f6d425 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:13.813747 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-8d5d01db-51f7-45eb-97b3-a59e66f6d425 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:13.814224 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-8d5d01db-51f7-45eb-97b3-a59e66f6d425 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:13.925629 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-8d5d01db-51f7-45eb-97b3-a59e66f6d425 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9520a49687b24281b78f08d43cb27dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c167faad577d47dfaf0d010a3f983fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:33:13.949320 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-8d5d01db-51f7-45eb-97b3-a59e66f6d425 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] 10.222.0.121 "GET /compute/v2.1/servers/cabceac5-859e-4c28-86c2-aa9b63953009" status: 200 len: 1276 microversion: 2.1 time: 0.178516 Aug 04 10:33:13.950325 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 23/60] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:33:13 2022] GET /compute/v2.1/servers/cabceac5-859e-4c28-86c2-aa9b63953009 => generated 1276 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:33:14.115116 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-fc80e40a-e53c-47bb-a0ec-ce5d002a0324 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:33:14.115984 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-fc80e40a-e53c-47bb-a0ec-ce5d002a0324 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] [instance: 81259012-5f3b-44f6-b979-39119f14929b] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:33:14.123219 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-fc80e40a-e53c-47bb-a0ec-ce5d002a0324 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:14.124431 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-fc80e40a-e53c-47bb-a0ec-ce5d002a0324 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:14.125731 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-fc80e40a-e53c-47bb-a0ec-ce5d002a0324 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:14.126374 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-fc80e40a-e53c-47bb-a0ec-ce5d002a0324 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:14.342866 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-fc80e40a-e53c-47bb-a0ec-ce5d002a0324 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa2e2a5a6ed4c5c9db91269266dd30b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f46ab11dd0b428486c673afc14b5b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:33:14.353534 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-fc80e40a-e53c-47bb-a0ec-ce5d002a0324 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] 10.222.0.121 "GET /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b" status: 200 len: 1366 microversion: 2.1 time: 0.243422 Aug 04 10:33:14.354251 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 38/61] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:33:14 2022] GET /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b => generated 1366 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:33:14.514767 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-79c500a9-9909-4050-b2d1-d8167e026389 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:33:14.515396 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-79c500a9-9909-4050-b2d1-d8167e026389 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] [instance: c6dec6e8-e2f9-4c57-8326-19fc989b5c6e] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:33:14.521956 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-79c500a9-9909-4050-b2d1-d8167e026389 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:14.522412 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-79c500a9-9909-4050-b2d1-d8167e026389 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:14.523153 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-79c500a9-9909-4050-b2d1-d8167e026389 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:14.523756 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-79c500a9-9909-4050-b2d1-d8167e026389 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:14.589439 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-79c500a9-9909-4050-b2d1-d8167e026389 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a38b5af1654f44bc6cb5832c2e8e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051b6a3defca48d7b4f8bb6705f89f20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:33:14.597621 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-79c500a9-9909-4050-b2d1-d8167e026389 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] 10.222.0.121 "GET /compute/v2.1/servers/c6dec6e8-e2f9-4c57-8326-19fc989b5c6e" status: 200 len: 1298 microversion: 2.1 time: 0.086709 Aug 04 10:33:14.598388 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 24/62] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:33:14 2022] GET /compute/v2.1/servers/c6dec6e8-e2f9-4c57-8326-19fc989b5c6e => generated 1298 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:33:14.632196 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-37764bb0-ccf6-46b5-a1e5-ea36b3ea7142 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:33:14.633413 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-37764bb0-ccf6-46b5-a1e5-ea36b3ea7142 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] [instance: 2583b630-2f89-45ba-b781-c0b7c206d61e] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:33:14.640327 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-37764bb0-ccf6-46b5-a1e5-ea36b3ea7142 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:14.640791 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-37764bb0-ccf6-46b5-a1e5-ea36b3ea7142 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:14.641586 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-37764bb0-ccf6-46b5-a1e5-ea36b3ea7142 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:14.642193 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-37764bb0-ccf6-46b5-a1e5-ea36b3ea7142 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:14.711402 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-37764bb0-ccf6-46b5-a1e5-ea36b3ea7142 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3170dc3323f54512bc8819c8efa86b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7121bd118a2549c39332cfdb7edaa92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:33:14.722727 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-37764bb0-ccf6-46b5-a1e5-ea36b3ea7142 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] 10.222.0.121 "GET /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e" status: 200 len: 1221 microversion: 2.1 time: 0.094526 Aug 04 10:33:14.736190 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 39/63] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:33:14 2022] GET /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e => generated 1221 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:33:14.973724 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-1e1aff14-f3f4-451c-80a8-a29030475578 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:33:14.974343 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-1e1aff14-f3f4-451c-80a8-a29030475578 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] [instance: cabceac5-859e-4c28-86c2-aa9b63953009] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:33:14.981046 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-1e1aff14-f3f4-451c-80a8-a29030475578 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:14.981681 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-1e1aff14-f3f4-451c-80a8-a29030475578 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:14.982614 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-1e1aff14-f3f4-451c-80a8-a29030475578 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:14.983361 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-1e1aff14-f3f4-451c-80a8-a29030475578 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:15.053260 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-1e1aff14-f3f4-451c-80a8-a29030475578 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9520a49687b24281b78f08d43cb27dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c167faad577d47dfaf0d010a3f983fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:33:15.061452 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-1e1aff14-f3f4-451c-80a8-a29030475578 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] 10.222.0.121 "GET /compute/v2.1/servers/cabceac5-859e-4c28-86c2-aa9b63953009" status: 200 len: 1276 microversion: 2.1 time: 0.091547 Aug 04 10:33:15.062613 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 25/64] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:33:14 2022] GET /compute/v2.1/servers/cabceac5-859e-4c28-86c2-aa9b63953009 => generated 1276 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:33:15.379590 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-467aa9a2-d6ad-48e9-80cc-0ec0d18c5099 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:33:15.380248 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-467aa9a2-d6ad-48e9-80cc-0ec0d18c5099 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] [instance: 81259012-5f3b-44f6-b979-39119f14929b] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:33:15.392145 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-467aa9a2-d6ad-48e9-80cc-0ec0d18c5099 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:15.394754 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-467aa9a2-d6ad-48e9-80cc-0ec0d18c5099 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:15.395702 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-467aa9a2-d6ad-48e9-80cc-0ec0d18c5099 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:15.396483 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-467aa9a2-d6ad-48e9-80cc-0ec0d18c5099 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:15.621360 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-21506fa3-d643-4d7e-839e-c63efd15bef0 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:33:15.623146 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-21506fa3-d643-4d7e-839e-c63efd15bef0 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] [instance: c6dec6e8-e2f9-4c57-8326-19fc989b5c6e] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:33:15.636477 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-21506fa3-d643-4d7e-839e-c63efd15bef0 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:15.637447 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-21506fa3-d643-4d7e-839e-c63efd15bef0 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:15.639302 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-21506fa3-d643-4d7e-839e-c63efd15bef0 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:15.641740 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-21506fa3-d643-4d7e-839e-c63efd15bef0 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:15.674060 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-467aa9a2-d6ad-48e9-80cc-0ec0d18c5099 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa2e2a5a6ed4c5c9db91269266dd30b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f46ab11dd0b428486c673afc14b5b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:33:15.688396 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-467aa9a2-d6ad-48e9-80cc-0ec0d18c5099 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] 10.222.0.121 "GET /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b" status: 200 len: 1366 microversion: 2.1 time: 0.313871 Aug 04 10:33:15.689357 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 40/65] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:33:15 2022] GET /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b => generated 1366 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:33:15.747239 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-632f1e00-36b6-428a-897a-a2836f969c3e tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:33:15.747930 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-632f1e00-36b6-428a-897a-a2836f969c3e tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] [instance: 2583b630-2f89-45ba-b781-c0b7c206d61e] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:33:15.762226 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-632f1e00-36b6-428a-897a-a2836f969c3e tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:15.763670 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-632f1e00-36b6-428a-897a-a2836f969c3e tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:15.771582 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-632f1e00-36b6-428a-897a-a2836f969c3e tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:15.773707 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-632f1e00-36b6-428a-897a-a2836f969c3e tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:15.811047 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-21506fa3-d643-4d7e-839e-c63efd15bef0 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a38b5af1654f44bc6cb5832c2e8e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051b6a3defca48d7b4f8bb6705f89f20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:33:15.823433 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-21506fa3-d643-4d7e-839e-c63efd15bef0 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] 10.222.0.121 "GET /compute/v2.1/servers/c6dec6e8-e2f9-4c57-8326-19fc989b5c6e" status: 200 len: 1298 microversion: 2.1 time: 0.208137 Aug 04 10:33:15.842191 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 26/66] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:33:15 2022] GET /compute/v2.1/servers/c6dec6e8-e2f9-4c57-8326-19fc989b5c6e => generated 1298 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:33:15.895281 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-632f1e00-36b6-428a-897a-a2836f969c3e tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3170dc3323f54512bc8819c8efa86b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7121bd118a2549c39332cfdb7edaa92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:33:15.905242 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-632f1e00-36b6-428a-897a-a2836f969c3e tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] 10.222.0.121 "GET /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e" status: 200 len: 1277 microversion: 2.1 time: 0.162058 Aug 04 10:33:15.905898 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 41/67] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:33:15 2022] GET /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e => generated 1277 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 10:33:16.084326 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-263e2429-23e4-40dc-8197-883b032d26ae tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:33:16.085784 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-263e2429-23e4-40dc-8197-883b032d26ae tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] [instance: cabceac5-859e-4c28-86c2-aa9b63953009] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:33:16.093614 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-263e2429-23e4-40dc-8197-883b032d26ae tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:16.095672 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-263e2429-23e4-40dc-8197-883b032d26ae tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:16.098828 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-263e2429-23e4-40dc-8197-883b032d26ae tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:16.099781 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-263e2429-23e4-40dc-8197-883b032d26ae tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:16.283218 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-263e2429-23e4-40dc-8197-883b032d26ae tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9520a49687b24281b78f08d43cb27dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c167faad577d47dfaf0d010a3f983fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:33:16.298409 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-263e2429-23e4-40dc-8197-883b032d26ae tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] 10.222.0.121 "GET /compute/v2.1/servers/cabceac5-859e-4c28-86c2-aa9b63953009" status: 200 len: 1276 microversion: 2.1 time: 0.218415 Aug 04 10:33:16.304048 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 27/68] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:33:16 2022] GET /compute/v2.1/servers/cabceac5-859e-4c28-86c2-aa9b63953009 => generated 1276 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:33:16.710683 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-b9b2c993-42e3-4b97-9b41-6252d230a31d tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:33:16.712213 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-b9b2c993-42e3-4b97-9b41-6252d230a31d tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] [instance: 81259012-5f3b-44f6-b979-39119f14929b] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:33:16.722251 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-b9b2c993-42e3-4b97-9b41-6252d230a31d tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:16.724343 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-b9b2c993-42e3-4b97-9b41-6252d230a31d tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:16.727327 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-b9b2c993-42e3-4b97-9b41-6252d230a31d tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:16.728440 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-b9b2c993-42e3-4b97-9b41-6252d230a31d tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:16.869022 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-a81fd9da-0822-4058-be61-ff9b72afa616 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:33:16.869848 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-a81fd9da-0822-4058-be61-ff9b72afa616 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] [instance: c6dec6e8-e2f9-4c57-8326-19fc989b5c6e] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:33:16.903090 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-a81fd9da-0822-4058-be61-ff9b72afa616 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:16.907160 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-a81fd9da-0822-4058-be61-ff9b72afa616 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:16.909113 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-a81fd9da-0822-4058-be61-ff9b72afa616 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:16.913773 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-a81fd9da-0822-4058-be61-ff9b72afa616 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:16.990638 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-b9b2c993-42e3-4b97-9b41-6252d230a31d tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa2e2a5a6ed4c5c9db91269266dd30b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f46ab11dd0b428486c673afc14b5b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:33:17.001499 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-b9b2c993-42e3-4b97-9b41-6252d230a31d tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] 10.222.0.121 "GET /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b" status: 200 len: 1366 microversion: 2.1 time: 0.295116 Aug 04 10:33:17.016010 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 42/69] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:33:16 2022] GET /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b => generated 1366 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:33:17.016010 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-954389e3-b5ca-437b-abfe-388e7e98befa tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:33:17.016010 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-954389e3-b5ca-437b-abfe-388e7e98befa tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] [instance: 2583b630-2f89-45ba-b781-c0b7c206d61e] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:33:17.018740 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-954389e3-b5ca-437b-abfe-388e7e98befa tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:17.019489 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-954389e3-b5ca-437b-abfe-388e7e98befa tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:17.020524 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-954389e3-b5ca-437b-abfe-388e7e98befa tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:17.021294 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-954389e3-b5ca-437b-abfe-388e7e98befa tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:17.168499 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-a81fd9da-0822-4058-be61-ff9b72afa616 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a38b5af1654f44bc6cb5832c2e8e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051b6a3defca48d7b4f8bb6705f89f20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:33:17.200449 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-a81fd9da-0822-4058-be61-ff9b72afa616 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] 10.222.0.121 "GET /compute/v2.1/servers/c6dec6e8-e2f9-4c57-8326-19fc989b5c6e" status: 200 len: 1306 microversion: 2.1 time: 0.330805 Aug 04 10:33:17.201907 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 28/70] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:33:16 2022] GET /compute/v2.1/servers/c6dec6e8-e2f9-4c57-8326-19fc989b5c6e => generated 1306 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:33:17.243463 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-954389e3-b5ca-437b-abfe-388e7e98befa tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3170dc3323f54512bc8819c8efa86b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7121bd118a2549c39332cfdb7edaa92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:33:17.267441 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-954389e3-b5ca-437b-abfe-388e7e98befa tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] 10.222.0.121 "GET /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e" status: 200 len: 1277 microversion: 2.1 time: 0.263055 Aug 04 10:33:17.269496 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 43/71] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:33:17 2022] GET /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e => generated 1277 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:33:17.328230 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-1ac2f5e4-0199-475a-b27d-0ff90d9b6bf3 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:33:17.329586 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-1ac2f5e4-0199-475a-b27d-0ff90d9b6bf3 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] [instance: cabceac5-859e-4c28-86c2-aa9b63953009] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:33:17.346027 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-1ac2f5e4-0199-475a-b27d-0ff90d9b6bf3 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:17.348089 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-1ac2f5e4-0199-475a-b27d-0ff90d9b6bf3 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:17.350507 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-1ac2f5e4-0199-475a-b27d-0ff90d9b6bf3 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:17.351429 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-1ac2f5e4-0199-475a-b27d-0ff90d9b6bf3 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:17.921962 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-1ac2f5e4-0199-475a-b27d-0ff90d9b6bf3 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9520a49687b24281b78f08d43cb27dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c167faad577d47dfaf0d010a3f983fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:33:17.942211 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-1ac2f5e4-0199-475a-b27d-0ff90d9b6bf3 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] 10.222.0.121 "GET /compute/v2.1/servers/cabceac5-859e-4c28-86c2-aa9b63953009" status: 200 len: 1318 microversion: 2.1 time: 0.620418 Aug 04 10:33:17.944507 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 29/72] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:33:17 2022] GET /compute/v2.1/servers/cabceac5-859e-4c28-86c2-aa9b63953009 => generated 1318 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:33:18.041438 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-b69582bc-84e2-4761-867e-8e90d1b46bf6 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:33:18.043110 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-b69582bc-84e2-4761-867e-8e90d1b46bf6 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] [instance: 81259012-5f3b-44f6-b979-39119f14929b] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:33:18.056983 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-b69582bc-84e2-4761-867e-8e90d1b46bf6 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:18.058387 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-b69582bc-84e2-4761-867e-8e90d1b46bf6 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:18.061520 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-b69582bc-84e2-4761-867e-8e90d1b46bf6 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:18.072984 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-b69582bc-84e2-4761-867e-8e90d1b46bf6 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:18.226859 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-d0f7daff-cb4e-4133-b3f8-8e012ff3b39e tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:33:18.228624 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-d0f7daff-cb4e-4133-b3f8-8e012ff3b39e tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] [instance: c6dec6e8-e2f9-4c57-8326-19fc989b5c6e] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:33:18.244496 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-d0f7daff-cb4e-4133-b3f8-8e012ff3b39e tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:18.253543 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-d0f7daff-cb4e-4133-b3f8-8e012ff3b39e tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:18.254735 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-d0f7daff-cb4e-4133-b3f8-8e012ff3b39e tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:18.257559 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-d0f7daff-cb4e-4133-b3f8-8e012ff3b39e tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:18.667353 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG dbcounter [-] [124456] Writing DB stats nova_cell0:SELECT=4 {{(pid=124456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:33:18.676652 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-d0f7daff-cb4e-4133-b3f8-8e012ff3b39e tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a38b5af1654f44bc6cb5832c2e8e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051b6a3defca48d7b4f8bb6705f89f20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:33:18.690596 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-d0f7daff-cb4e-4133-b3f8-8e012ff3b39e tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] 10.222.0.121 "GET /compute/v2.1/servers/c6dec6e8-e2f9-4c57-8326-19fc989b5c6e" status: 200 len: 1316 microversion: 2.1 time: 0.467907 Aug 04 10:33:18.709576 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 30/73] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:33:18 2022] GET /compute/v2.1/servers/c6dec6e8-e2f9-4c57-8326-19fc989b5c6e => generated 1316 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 10:33:18.726325 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-51efeec7-dc3f-4e53-b1b3-de76441611e7 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:33:18.730401 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-51efeec7-dc3f-4e53-b1b3-de76441611e7 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] [instance: 2583b630-2f89-45ba-b781-c0b7c206d61e] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:33:18.739441 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-b69582bc-84e2-4761-867e-8e90d1b46bf6 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa2e2a5a6ed4c5c9db91269266dd30b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f46ab11dd0b428486c673afc14b5b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:33:18.748842 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-51efeec7-dc3f-4e53-b1b3-de76441611e7 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:18.750987 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-51efeec7-dc3f-4e53-b1b3-de76441611e7 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:18.751908 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-51efeec7-dc3f-4e53-b1b3-de76441611e7 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:18.753241 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-51efeec7-dc3f-4e53-b1b3-de76441611e7 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:18.762798 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-b69582bc-84e2-4761-867e-8e90d1b46bf6 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] 10.222.0.121 "GET /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b" status: 200 len: 1366 microversion: 2.1 time: 0.726670 Aug 04 10:33:18.775481 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 44/74] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:33:18 2022] GET /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b => generated 1366 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:33:18.890867 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-51efeec7-dc3f-4e53-b1b3-de76441611e7 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3170dc3323f54512bc8819c8efa86b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7121bd118a2549c39332cfdb7edaa92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:33:18.901212 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-51efeec7-dc3f-4e53-b1b3-de76441611e7 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] 10.222.0.121 "GET /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e" status: 200 len: 1285 microversion: 2.1 time: 0.189829 Aug 04 10:33:18.914775 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 31/75] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:33:18 2022] GET /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e => generated 1285 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:33:18.968643 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-0bba991b-c4ae-4187-aa8a-2f513561993a tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:33:18.969316 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-0bba991b-c4ae-4187-aa8a-2f513561993a tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] [instance: cabceac5-859e-4c28-86c2-aa9b63953009] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:33:18.980542 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-0bba991b-c4ae-4187-aa8a-2f513561993a tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:18.981002 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-0bba991b-c4ae-4187-aa8a-2f513561993a tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:18.981804 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-0bba991b-c4ae-4187-aa8a-2f513561993a tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:18.982253 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-0bba991b-c4ae-4187-aa8a-2f513561993a tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:19.126294 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG dbcounter [-] [124457] Writing DB stats nova_cell0:SELECT=6 {{(pid=124457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:33:19.167878 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-0bba991b-c4ae-4187-aa8a-2f513561993a tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9520a49687b24281b78f08d43cb27dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c167faad577d47dfaf0d010a3f983fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:33:19.180427 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-0bba991b-c4ae-4187-aa8a-2f513561993a tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] 10.222.0.121 "GET /compute/v2.1/servers/cabceac5-859e-4c28-86c2-aa9b63953009" status: 200 len: 1318 microversion: 2.1 time: 0.216823 Aug 04 10:33:19.193248 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 45/76] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:33:18 2022] GET /compute/v2.1/servers/cabceac5-859e-4c28-86c2-aa9b63953009 => generated 1318 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:33:19.714468 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-3cf7e434-8bc5-46e5-b574-1655ec763c51 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:33:19.715087 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-3cf7e434-8bc5-46e5-b574-1655ec763c51 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] [instance: c6dec6e8-e2f9-4c57-8326-19fc989b5c6e] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:33:19.718335 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG dbcounter [-] [124456] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=8 {{(pid=124456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:33:19.722738 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-3cf7e434-8bc5-46e5-b574-1655ec763c51 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:19.723195 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-3cf7e434-8bc5-46e5-b574-1655ec763c51 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:19.724026 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-3cf7e434-8bc5-46e5-b574-1655ec763c51 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:19.724479 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-3cf7e434-8bc5-46e5-b574-1655ec763c51 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:19.793774 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-3cf7e434-8bc5-46e5-b574-1655ec763c51 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a38b5af1654f44bc6cb5832c2e8e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051b6a3defca48d7b4f8bb6705f89f20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:33:19.795052 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-0c3ce711-983a-434f-bf4c-18f6d31d56c5 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:33:19.795697 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-0c3ce711-983a-434f-bf4c-18f6d31d56c5 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] [instance: 81259012-5f3b-44f6-b979-39119f14929b] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:33:19.797755 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG dbcounter [-] [124457] Writing DB stats nova_cell0:SELECT=26 {{(pid=124457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:33:19.803707 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-0c3ce711-983a-434f-bf4c-18f6d31d56c5 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:19.804386 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-0c3ce711-983a-434f-bf4c-18f6d31d56c5 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:19.805405 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-0c3ce711-983a-434f-bf4c-18f6d31d56c5 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:19.805844 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-0c3ce711-983a-434f-bf4c-18f6d31d56c5 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:19.810355 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-3cf7e434-8bc5-46e5-b574-1655ec763c51 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] 10.222.0.121 "GET /compute/v2.1/servers/c6dec6e8-e2f9-4c57-8326-19fc989b5c6e" status: 200 len: 1316 microversion: 2.1 time: 0.099149 Aug 04 10:33:19.812006 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 32/77] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:33:19 2022] GET /compute/v2.1/servers/c6dec6e8-e2f9-4c57-8326-19fc989b5c6e => generated 1316 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:33:19.928542 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-30d6af16-c357-4436-a615-3d6ee02f762d tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:33:19.929507 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-30d6af16-c357-4436-a615-3d6ee02f762d tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] [instance: 2583b630-2f89-45ba-b781-c0b7c206d61e] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:33:19.931892 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG dbcounter [-] [124456] Writing DB stats nova_cell0:SELECT=22 {{(pid=124456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:33:19.939677 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-30d6af16-c357-4436-a615-3d6ee02f762d tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:19.940362 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-30d6af16-c357-4436-a615-3d6ee02f762d tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:19.941399 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-30d6af16-c357-4436-a615-3d6ee02f762d tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:19.941967 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-30d6af16-c357-4436-a615-3d6ee02f762d tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:19.981935 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-0c3ce711-983a-434f-bf4c-18f6d31d56c5 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa2e2a5a6ed4c5c9db91269266dd30b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f46ab11dd0b428486c673afc14b5b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:33:19.990397 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-0c3ce711-983a-434f-bf4c-18f6d31d56c5 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] 10.222.0.121 "GET /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b" status: 200 len: 1366 microversion: 2.1 time: 0.199279 Aug 04 10:33:19.991216 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 46/78] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:33:19 2022] GET /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b => generated 1366 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:33:20.020494 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-30d6af16-c357-4436-a615-3d6ee02f762d tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3170dc3323f54512bc8819c8efa86b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7121bd118a2549c39332cfdb7edaa92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:33:20.024035 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG dbcounter [-] [124456] Writing DB stats nova_cell1:SELECT=100 {{(pid=124456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:33:20.028843 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-30d6af16-c357-4436-a615-3d6ee02f762d tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] 10.222.0.121 "GET /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e" status: 200 len: 1285 microversion: 2.1 time: 0.107987 Aug 04 10:33:20.029363 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 33/79] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:33:19 2022] GET /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e => generated 1285 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:33:20.217063 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-01a19dbb-a03a-4e1c-9c44-2ea923891dba tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:33:20.217801 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-01a19dbb-a03a-4e1c-9c44-2ea923891dba tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] [instance: cabceac5-859e-4c28-86c2-aa9b63953009] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:33:20.224588 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-01a19dbb-a03a-4e1c-9c44-2ea923891dba tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:20.225053 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-01a19dbb-a03a-4e1c-9c44-2ea923891dba tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:20.225860 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-01a19dbb-a03a-4e1c-9c44-2ea923891dba tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:20.226306 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-01a19dbb-a03a-4e1c-9c44-2ea923891dba tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:20.367814 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-01a19dbb-a03a-4e1c-9c44-2ea923891dba tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9520a49687b24281b78f08d43cb27dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c167faad577d47dfaf0d010a3f983fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:33:20.375632 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-01a19dbb-a03a-4e1c-9c44-2ea923891dba tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] 10.222.0.121 "GET /compute/v2.1/servers/cabceac5-859e-4c28-86c2-aa9b63953009" status: 200 len: 1318 microversion: 2.1 time: 0.162899 Aug 04 10:33:20.376248 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 47/80] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:33:20 2022] GET /compute/v2.1/servers/cabceac5-859e-4c28-86c2-aa9b63953009 => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:33:20.833127 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-873d9089-2f13-4c51-8902-b079dda35e28 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:33:20.833768 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-873d9089-2f13-4c51-8902-b079dda35e28 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] [instance: c6dec6e8-e2f9-4c57-8326-19fc989b5c6e] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:33:20.840329 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-873d9089-2f13-4c51-8902-b079dda35e28 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:20.840713 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-873d9089-2f13-4c51-8902-b079dda35e28 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:20.841510 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-873d9089-2f13-4c51-8902-b079dda35e28 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:20.841974 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-873d9089-2f13-4c51-8902-b079dda35e28 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:20.909855 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-873d9089-2f13-4c51-8902-b079dda35e28 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a38b5af1654f44bc6cb5832c2e8e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051b6a3defca48d7b4f8bb6705f89f20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:33:20.917902 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-873d9089-2f13-4c51-8902-b079dda35e28 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] 10.222.0.121 "GET /compute/v2.1/servers/c6dec6e8-e2f9-4c57-8326-19fc989b5c6e" status: 200 len: 1316 microversion: 2.1 time: 0.089185 Aug 04 10:33:20.918498 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 34/81] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:33:20 2022] GET /compute/v2.1/servers/c6dec6e8-e2f9-4c57-8326-19fc989b5c6e => generated 1316 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:33:21.012638 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-3e34c458-7bf0-4e7f-96f9-a0b6ec9e1366 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:33:21.013635 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-3e34c458-7bf0-4e7f-96f9-a0b6ec9e1366 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] [instance: 81259012-5f3b-44f6-b979-39119f14929b] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:33:21.020824 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-3e34c458-7bf0-4e7f-96f9-a0b6ec9e1366 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:21.021284 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-3e34c458-7bf0-4e7f-96f9-a0b6ec9e1366 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:21.022055 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-3e34c458-7bf0-4e7f-96f9-a0b6ec9e1366 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:21.022764 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-3e34c458-7bf0-4e7f-96f9-a0b6ec9e1366 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:21.043242 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG dbcounter [-] [124457] Writing DB stats nova_cell1:SELECT=100 {{(pid=124457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:33:21.052421 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-5907776c-2d0a-485c-9fff-386c4e53954a tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:33:21.053819 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-5907776c-2d0a-485c-9fff-386c4e53954a tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] [instance: 2583b630-2f89-45ba-b781-c0b7c206d61e] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:33:21.061695 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-5907776c-2d0a-485c-9fff-386c4e53954a tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:21.062261 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-5907776c-2d0a-485c-9fff-386c4e53954a tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:21.063143 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-5907776c-2d0a-485c-9fff-386c4e53954a tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:21.063669 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-5907776c-2d0a-485c-9fff-386c4e53954a tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:21.151382 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-5907776c-2d0a-485c-9fff-386c4e53954a tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3170dc3323f54512bc8819c8efa86b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7121bd118a2549c39332cfdb7edaa92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:33:21.161158 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-5907776c-2d0a-485c-9fff-386c4e53954a tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] 10.222.0.121 "GET /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e" status: 200 len: 1285 microversion: 2.1 time: 0.113519 Aug 04 10:33:21.162072 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 35/82] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:33:21 2022] GET /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e => generated 1285 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:33:21.202731 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-3e34c458-7bf0-4e7f-96f9-a0b6ec9e1366 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa2e2a5a6ed4c5c9db91269266dd30b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f46ab11dd0b428486c673afc14b5b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:33:21.211274 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-3e34c458-7bf0-4e7f-96f9-a0b6ec9e1366 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] 10.222.0.121 "GET /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b" status: 200 len: 1366 microversion: 2.1 time: 0.202577 Aug 04 10:33:21.211873 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 48/83] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:33:21 2022] GET /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b => generated 1366 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:33:21.397584 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-cc780808-2bf9-4627-8004-c5810e19dc1f tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:33:21.398227 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-cc780808-2bf9-4627-8004-c5810e19dc1f tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] [instance: cabceac5-859e-4c28-86c2-aa9b63953009] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:33:21.405793 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-cc780808-2bf9-4627-8004-c5810e19dc1f tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:21.406257 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-cc780808-2bf9-4627-8004-c5810e19dc1f tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:21.407125 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-cc780808-2bf9-4627-8004-c5810e19dc1f tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:21.407576 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-cc780808-2bf9-4627-8004-c5810e19dc1f tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:21.560817 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-cc780808-2bf9-4627-8004-c5810e19dc1f tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9520a49687b24281b78f08d43cb27dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c167faad577d47dfaf0d010a3f983fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:33:21.575260 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-cc780808-2bf9-4627-8004-c5810e19dc1f tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] 10.222.0.121 "GET /compute/v2.1/servers/cabceac5-859e-4c28-86c2-aa9b63953009" status: 200 len: 1318 microversion: 2.1 time: 0.181648 Aug 04 10:33:21.575910 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 36/84] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:33:21 2022] GET /compute/v2.1/servers/cabceac5-859e-4c28-86c2-aa9b63953009 => generated 1318 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:33:21.941852 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-d1514050-4212-4726-b287-77857214c456 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:33:21.942597 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-d1514050-4212-4726-b287-77857214c456 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] [instance: c6dec6e8-e2f9-4c57-8326-19fc989b5c6e] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:33:21.946278 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG dbcounter [-] [124457] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=124457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:33:21.950851 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-d1514050-4212-4726-b287-77857214c456 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:21.951314 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-d1514050-4212-4726-b287-77857214c456 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:21.952243 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-d1514050-4212-4726-b287-77857214c456 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:21.957711 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-d1514050-4212-4726-b287-77857214c456 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:22.038511 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-d1514050-4212-4726-b287-77857214c456 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a38b5af1654f44bc6cb5832c2e8e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051b6a3defca48d7b4f8bb6705f89f20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:33:22.046714 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-d1514050-4212-4726-b287-77857214c456 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] 10.222.0.121 "GET /compute/v2.1/servers/c6dec6e8-e2f9-4c57-8326-19fc989b5c6e" status: 200 len: 1316 microversion: 2.1 time: 0.109899 Aug 04 10:33:22.047440 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 49/85] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:33:21 2022] GET /compute/v2.1/servers/c6dec6e8-e2f9-4c57-8326-19fc989b5c6e => generated 1316 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:33:22.183506 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-0ecaa14a-6c29-4a28-8eb4-b8feed266a23 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:33:22.184190 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-0ecaa14a-6c29-4a28-8eb4-b8feed266a23 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] [instance: 2583b630-2f89-45ba-b781-c0b7c206d61e] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:33:22.191057 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-0ecaa14a-6c29-4a28-8eb4-b8feed266a23 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:22.191858 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-0ecaa14a-6c29-4a28-8eb4-b8feed266a23 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:22.192666 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-0ecaa14a-6c29-4a28-8eb4-b8feed266a23 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:22.193294 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-0ecaa14a-6c29-4a28-8eb4-b8feed266a23 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:22.238656 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-c887e697-0cc7-42cc-89ea-2ef73f459433 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:33:22.244243 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-c887e697-0cc7-42cc-89ea-2ef73f459433 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] [instance: 81259012-5f3b-44f6-b979-39119f14929b] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:33:22.251798 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-c887e697-0cc7-42cc-89ea-2ef73f459433 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:22.252309 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-c887e697-0cc7-42cc-89ea-2ef73f459433 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:22.253089 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-c887e697-0cc7-42cc-89ea-2ef73f459433 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:22.253706 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-c887e697-0cc7-42cc-89ea-2ef73f459433 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:22.270193 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-0ecaa14a-6c29-4a28-8eb4-b8feed266a23 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3170dc3323f54512bc8819c8efa86b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7121bd118a2549c39332cfdb7edaa92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:33:22.280997 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-0ecaa14a-6c29-4a28-8eb4-b8feed266a23 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] 10.222.0.121 "GET /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e" status: 200 len: 1285 microversion: 2.1 time: 0.101379 Aug 04 10:33:22.284452 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 37/86] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:33:22 2022] GET /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e => generated 1285 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:33:22.413100 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-c887e697-0cc7-42cc-89ea-2ef73f459433 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa2e2a5a6ed4c5c9db91269266dd30b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f46ab11dd0b428486c673afc14b5b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:33:22.422414 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-c887e697-0cc7-42cc-89ea-2ef73f459433 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] 10.222.0.121 "GET /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b" status: 200 len: 1366 microversion: 2.1 time: 0.191883 Aug 04 10:33:22.423044 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 50/87] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:33:22 2022] GET /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b => generated 1366 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:33:22.597368 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-621a682d-9b30-4bae-bab9-542f682778a8 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:33:22.598042 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-621a682d-9b30-4bae-bab9-542f682778a8 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] [instance: cabceac5-859e-4c28-86c2-aa9b63953009] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:33:22.605512 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-621a682d-9b30-4bae-bab9-542f682778a8 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:22.605967 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-621a682d-9b30-4bae-bab9-542f682778a8 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:22.606762 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-621a682d-9b30-4bae-bab9-542f682778a8 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:22.607208 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-621a682d-9b30-4bae-bab9-542f682778a8 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:22.759744 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-621a682d-9b30-4bae-bab9-542f682778a8 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9520a49687b24281b78f08d43cb27dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c167faad577d47dfaf0d010a3f983fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:33:22.771674 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-621a682d-9b30-4bae-bab9-542f682778a8 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] 10.222.0.121 "GET /compute/v2.1/servers/cabceac5-859e-4c28-86c2-aa9b63953009" status: 200 len: 1318 microversion: 2.1 time: 0.178227 Aug 04 10:33:22.772395 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 38/88] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:33:22 2022] GET /compute/v2.1/servers/cabceac5-859e-4c28-86c2-aa9b63953009 => generated 1318 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:33:23.073392 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-b01fac19-5e65-473b-9987-15b960e3e4c4 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:33:23.074070 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-b01fac19-5e65-473b-9987-15b960e3e4c4 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] [instance: c6dec6e8-e2f9-4c57-8326-19fc989b5c6e] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:33:23.080880 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-b01fac19-5e65-473b-9987-15b960e3e4c4 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:23.081334 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-b01fac19-5e65-473b-9987-15b960e3e4c4 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:23.082128 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-b01fac19-5e65-473b-9987-15b960e3e4c4 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:23.082572 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-b01fac19-5e65-473b-9987-15b960e3e4c4 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:23.150078 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-b01fac19-5e65-473b-9987-15b960e3e4c4 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a38b5af1654f44bc6cb5832c2e8e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051b6a3defca48d7b4f8bb6705f89f20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:33:23.158466 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-b01fac19-5e65-473b-9987-15b960e3e4c4 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] 10.222.0.121 "GET /compute/v2.1/servers/c6dec6e8-e2f9-4c57-8326-19fc989b5c6e" status: 200 len: 1316 microversion: 2.1 time: 0.089045 Aug 04 10:33:23.159298 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 51/89] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:33:23 2022] GET /compute/v2.1/servers/c6dec6e8-e2f9-4c57-8326-19fc989b5c6e => generated 1316 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 10:33:23.302352 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-3ec97374-ff6e-4f01-8ed2-c486e06c0f97 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:33:23.303020 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-3ec97374-ff6e-4f01-8ed2-c486e06c0f97 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] [instance: 2583b630-2f89-45ba-b781-c0b7c206d61e] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:33:23.310611 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-3ec97374-ff6e-4f01-8ed2-c486e06c0f97 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:23.311022 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-3ec97374-ff6e-4f01-8ed2-c486e06c0f97 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:23.311832 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-3ec97374-ff6e-4f01-8ed2-c486e06c0f97 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:23.312543 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-3ec97374-ff6e-4f01-8ed2-c486e06c0f97 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:23.384341 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-3ec97374-ff6e-4f01-8ed2-c486e06c0f97 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3170dc3323f54512bc8819c8efa86b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7121bd118a2549c39332cfdb7edaa92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:33:23.393022 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-3ec97374-ff6e-4f01-8ed2-c486e06c0f97 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] 10.222.0.121 "GET /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e" status: 200 len: 1285 microversion: 2.1 time: 0.094718 Aug 04 10:33:23.393599 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 39/90] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:33:23 2022] GET /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e => generated 1285 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:33:23.444563 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-4b075e46-d3bd-4e95-99a4-0ef8ab5a7e34 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:33:23.445082 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-4b075e46-d3bd-4e95-99a4-0ef8ab5a7e34 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] [instance: 81259012-5f3b-44f6-b979-39119f14929b] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:33:23.451709 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-4b075e46-d3bd-4e95-99a4-0ef8ab5a7e34 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:23.452191 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-4b075e46-d3bd-4e95-99a4-0ef8ab5a7e34 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:23.452980 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-4b075e46-d3bd-4e95-99a4-0ef8ab5a7e34 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:23.453485 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-4b075e46-d3bd-4e95-99a4-0ef8ab5a7e34 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:23.604104 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-4b075e46-d3bd-4e95-99a4-0ef8ab5a7e34 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa2e2a5a6ed4c5c9db91269266dd30b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f46ab11dd0b428486c673afc14b5b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:33:23.613012 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-4b075e46-d3bd-4e95-99a4-0ef8ab5a7e34 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] 10.222.0.121 "GET /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b" status: 200 len: 1366 microversion: 2.1 time: 0.172647 Aug 04 10:33:23.613643 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 52/91] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:33:23 2022] GET /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b => generated 1366 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:33:23.796612 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-aa015782-3e1d-4c03-a760-8f7defe92b47 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:33:23.797417 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-aa015782-3e1d-4c03-a760-8f7defe92b47 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] [instance: cabceac5-859e-4c28-86c2-aa9b63953009] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:33:23.809954 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-aa015782-3e1d-4c03-a760-8f7defe92b47 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:23.810776 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-aa015782-3e1d-4c03-a760-8f7defe92b47 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:23.812238 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-aa015782-3e1d-4c03-a760-8f7defe92b47 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:23.813019 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-aa015782-3e1d-4c03-a760-8f7defe92b47 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:23.991608 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-aa015782-3e1d-4c03-a760-8f7defe92b47 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9520a49687b24281b78f08d43cb27dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c167faad577d47dfaf0d010a3f983fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:33:24.006887 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-aa015782-3e1d-4c03-a760-8f7defe92b47 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] 10.222.0.121 "GET /compute/v2.1/servers/cabceac5-859e-4c28-86c2-aa9b63953009" status: 200 len: 1318 microversion: 2.1 time: 0.214991 Aug 04 10:33:24.013363 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 40/92] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:33:23 2022] GET /compute/v2.1/servers/cabceac5-859e-4c28-86c2-aa9b63953009 => generated 1318 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:33:24.181542 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-4bb1efe9-1e1f-466c-bdf9-72f499e067a7 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:33:24.182337 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-4bb1efe9-1e1f-466c-bdf9-72f499e067a7 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] [instance: c6dec6e8-e2f9-4c57-8326-19fc989b5c6e] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:33:24.190716 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-4bb1efe9-1e1f-466c-bdf9-72f499e067a7 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:24.191521 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-4bb1efe9-1e1f-466c-bdf9-72f499e067a7 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:24.192959 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-4bb1efe9-1e1f-466c-bdf9-72f499e067a7 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:24.193715 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-4bb1efe9-1e1f-466c-bdf9-72f499e067a7 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:24.270306 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-4bb1efe9-1e1f-466c-bdf9-72f499e067a7 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a38b5af1654f44bc6cb5832c2e8e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051b6a3defca48d7b4f8bb6705f89f20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:33:24.278877 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-4bb1efe9-1e1f-466c-bdf9-72f499e067a7 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] 10.222.0.121 "GET /compute/v2.1/servers/c6dec6e8-e2f9-4c57-8326-19fc989b5c6e" status: 200 len: 1316 microversion: 2.1 time: 0.101245 Aug 04 10:33:24.279874 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 53/93] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:33:24 2022] GET /compute/v2.1/servers/c6dec6e8-e2f9-4c57-8326-19fc989b5c6e => generated 1316 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:33:24.414552 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-ee227706-5359-435b-918e-c42782e05b73 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:33:24.415041 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-ee227706-5359-435b-918e-c42782e05b73 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] [instance: 2583b630-2f89-45ba-b781-c0b7c206d61e] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:33:24.423249 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-ee227706-5359-435b-918e-c42782e05b73 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:24.423784 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-ee227706-5359-435b-918e-c42782e05b73 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:24.424795 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-ee227706-5359-435b-918e-c42782e05b73 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:24.425455 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-ee227706-5359-435b-918e-c42782e05b73 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:24.493055 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-ee227706-5359-435b-918e-c42782e05b73 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3170dc3323f54512bc8819c8efa86b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7121bd118a2549c39332cfdb7edaa92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:33:24.501684 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-ee227706-5359-435b-918e-c42782e05b73 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] 10.222.0.121 "GET /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e" status: 200 len: 1285 microversion: 2.1 time: 0.091238 Aug 04 10:33:24.502287 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 41/94] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:33:24 2022] GET /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e => generated 1285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:33:24.635685 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-319e4324-dc62-482d-b201-6c0ee5350acd tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:33:24.636323 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-319e4324-dc62-482d-b201-6c0ee5350acd tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] [instance: 81259012-5f3b-44f6-b979-39119f14929b] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:33:24.643139 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-319e4324-dc62-482d-b201-6c0ee5350acd tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:24.643598 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-319e4324-dc62-482d-b201-6c0ee5350acd tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:24.644424 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-319e4324-dc62-482d-b201-6c0ee5350acd tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:24.644853 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-319e4324-dc62-482d-b201-6c0ee5350acd tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:24.809143 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-319e4324-dc62-482d-b201-6c0ee5350acd tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa2e2a5a6ed4c5c9db91269266dd30b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f46ab11dd0b428486c673afc14b5b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:33:24.817319 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-319e4324-dc62-482d-b201-6c0ee5350acd tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] 10.222.0.121 "GET /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b" status: 200 len: 1366 microversion: 2.1 time: 0.185786 Aug 04 10:33:24.817915 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 54/95] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:33:24 2022] GET /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b => generated 1366 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:33:25.044221 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-6d295a9a-a031-4d1a-bf0a-76227ae3f22c tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:33:25.044856 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-6d295a9a-a031-4d1a-bf0a-76227ae3f22c tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] [instance: cabceac5-859e-4c28-86c2-aa9b63953009] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:33:25.051494 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-6d295a9a-a031-4d1a-bf0a-76227ae3f22c tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:25.052125 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-6d295a9a-a031-4d1a-bf0a-76227ae3f22c tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:25.052914 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-6d295a9a-a031-4d1a-bf0a-76227ae3f22c tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:25.053231 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-6d295a9a-a031-4d1a-bf0a-76227ae3f22c tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:25.209191 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-6d295a9a-a031-4d1a-bf0a-76227ae3f22c tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9520a49687b24281b78f08d43cb27dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c167faad577d47dfaf0d010a3f983fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:33:25.217408 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-6d295a9a-a031-4d1a-bf0a-76227ae3f22c tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] 10.222.0.121 "GET /compute/v2.1/servers/cabceac5-859e-4c28-86c2-aa9b63953009" status: 200 len: 1318 microversion: 2.1 time: 0.177232 Aug 04 10:33:25.218007 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 42/96] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:33:25 2022] GET /compute/v2.1/servers/cabceac5-859e-4c28-86c2-aa9b63953009 => generated 1318 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:33:25.307433 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-e36ec115-c95c-49a7-9259-c751d05b0a6b tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:33:25.308341 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-e36ec115-c95c-49a7-9259-c751d05b0a6b tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] [instance: c6dec6e8-e2f9-4c57-8326-19fc989b5c6e] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:33:25.317324 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-e36ec115-c95c-49a7-9259-c751d05b0a6b tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:25.317867 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-e36ec115-c95c-49a7-9259-c751d05b0a6b tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:25.318764 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-e36ec115-c95c-49a7-9259-c751d05b0a6b tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:25.319546 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-e36ec115-c95c-49a7-9259-c751d05b0a6b tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:25.399537 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-e36ec115-c95c-49a7-9259-c751d05b0a6b tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a38b5af1654f44bc6cb5832c2e8e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051b6a3defca48d7b4f8bb6705f89f20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:33:25.407895 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-e36ec115-c95c-49a7-9259-c751d05b0a6b tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] 10.222.0.121 "GET /compute/v2.1/servers/c6dec6e8-e2f9-4c57-8326-19fc989b5c6e" status: 200 len: 1316 microversion: 2.1 time: 0.104553 Aug 04 10:33:25.408783 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 55/97] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:33:25 2022] GET /compute/v2.1/servers/c6dec6e8-e2f9-4c57-8326-19fc989b5c6e => generated 1316 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:33:25.523756 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-ab5cabfe-ed3e-468d-b8a6-dd4e898e68c6 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:33:25.524440 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-ab5cabfe-ed3e-468d-b8a6-dd4e898e68c6 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] [instance: 2583b630-2f89-45ba-b781-c0b7c206d61e] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:33:25.531253 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-ab5cabfe-ed3e-468d-b8a6-dd4e898e68c6 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:25.531817 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-ab5cabfe-ed3e-468d-b8a6-dd4e898e68c6 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:25.532935 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-ab5cabfe-ed3e-468d-b8a6-dd4e898e68c6 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:25.533459 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-ab5cabfe-ed3e-468d-b8a6-dd4e898e68c6 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:25.607011 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-ab5cabfe-ed3e-468d-b8a6-dd4e898e68c6 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3170dc3323f54512bc8819c8efa86b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7121bd118a2549c39332cfdb7edaa92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:33:25.615453 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-ab5cabfe-ed3e-468d-b8a6-dd4e898e68c6 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] 10.222.0.121 "GET /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e" status: 200 len: 1285 microversion: 2.1 time: 0.095978 Aug 04 10:33:25.616030 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 43/98] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:33:25 2022] GET /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e => generated 1285 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:33:25.842980 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-23bd62ac-8345-46aa-b8b9-9c527da1e044 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:33:25.843490 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-23bd62ac-8345-46aa-b8b9-9c527da1e044 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] [instance: 81259012-5f3b-44f6-b979-39119f14929b] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:33:25.850486 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-23bd62ac-8345-46aa-b8b9-9c527da1e044 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:25.850984 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-23bd62ac-8345-46aa-b8b9-9c527da1e044 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:25.851784 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-23bd62ac-8345-46aa-b8b9-9c527da1e044 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:25.852357 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-23bd62ac-8345-46aa-b8b9-9c527da1e044 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:26.007432 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-23bd62ac-8345-46aa-b8b9-9c527da1e044 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa2e2a5a6ed4c5c9db91269266dd30b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f46ab11dd0b428486c673afc14b5b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:33:26.015904 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-23bd62ac-8345-46aa-b8b9-9c527da1e044 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] 10.222.0.121 "GET /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b" status: 200 len: 1366 microversion: 2.1 time: 0.177596 Aug 04 10:33:26.016755 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 56/99] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:33:25 2022] GET /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b => generated 1366 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:33:26.261955 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-792f9b58-9cca-4208-96a3-92b314c20029 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:33:26.262685 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-792f9b58-9cca-4208-96a3-92b314c20029 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] [instance: cabceac5-859e-4c28-86c2-aa9b63953009] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:33:26.269966 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-792f9b58-9cca-4208-96a3-92b314c20029 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:26.270422 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-792f9b58-9cca-4208-96a3-92b314c20029 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:26.271221 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-792f9b58-9cca-4208-96a3-92b314c20029 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:26.271668 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-792f9b58-9cca-4208-96a3-92b314c20029 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:26.424090 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-792f9b58-9cca-4208-96a3-92b314c20029 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9520a49687b24281b78f08d43cb27dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c167faad577d47dfaf0d010a3f983fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:33:26.432411 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-19fb4a96-0ba3-4c26-8662-79f54ce0c718 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:33:26.433511 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-792f9b58-9cca-4208-96a3-92b314c20029 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] 10.222.0.121 "GET /compute/v2.1/servers/cabceac5-859e-4c28-86c2-aa9b63953009" status: 200 len: 1318 microversion: 2.1 time: 0.190346 Aug 04 10:33:26.433599 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-19fb4a96-0ba3-4c26-8662-79f54ce0c718 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] [instance: c6dec6e8-e2f9-4c57-8326-19fc989b5c6e] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:33:26.437383 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 44/100] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:33:26 2022] GET /compute/v2.1/servers/cabceac5-859e-4c28-86c2-aa9b63953009 => generated 1318 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:33:26.447188 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-19fb4a96-0ba3-4c26-8662-79f54ce0c718 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:26.447688 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-19fb4a96-0ba3-4c26-8662-79f54ce0c718 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:26.448676 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-19fb4a96-0ba3-4c26-8662-79f54ce0c718 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:26.449431 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-19fb4a96-0ba3-4c26-8662-79f54ce0c718 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:26.525622 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-19fb4a96-0ba3-4c26-8662-79f54ce0c718 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a38b5af1654f44bc6cb5832c2e8e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051b6a3defca48d7b4f8bb6705f89f20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:33:26.534102 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-19fb4a96-0ba3-4c26-8662-79f54ce0c718 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] 10.222.0.121 "GET /compute/v2.1/servers/c6dec6e8-e2f9-4c57-8326-19fc989b5c6e" status: 200 len: 1316 microversion: 2.1 time: 0.107642 Aug 04 10:33:26.534905 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 57/101] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:33:26 2022] GET /compute/v2.1/servers/c6dec6e8-e2f9-4c57-8326-19fc989b5c6e => generated 1316 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:33:26.638379 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-aed59e44-0ab0-41b8-a9dd-6cb278421f93 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:33:26.639258 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-aed59e44-0ab0-41b8-a9dd-6cb278421f93 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] [instance: 2583b630-2f89-45ba-b781-c0b7c206d61e] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:33:26.646678 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-aed59e44-0ab0-41b8-a9dd-6cb278421f93 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:26.647091 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-aed59e44-0ab0-41b8-a9dd-6cb278421f93 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:26.647970 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-aed59e44-0ab0-41b8-a9dd-6cb278421f93 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:26.648981 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-aed59e44-0ab0-41b8-a9dd-6cb278421f93 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:26.722956 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-aed59e44-0ab0-41b8-a9dd-6cb278421f93 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3170dc3323f54512bc8819c8efa86b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7121bd118a2549c39332cfdb7edaa92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:33:26.735489 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-aed59e44-0ab0-41b8-a9dd-6cb278421f93 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] 10.222.0.121 "GET /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e" status: 200 len: 1285 microversion: 2.1 time: 0.101386 Aug 04 10:33:26.736478 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 45/102] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:33:26 2022] GET /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e => generated 1285 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:33:27.038847 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-1c362066-1918-427a-8616-dba4f3bdb62e tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:33:27.039385 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-1c362066-1918-427a-8616-dba4f3bdb62e tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] [instance: 81259012-5f3b-44f6-b979-39119f14929b] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:33:27.046249 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-1c362066-1918-427a-8616-dba4f3bdb62e tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:27.046709 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-1c362066-1918-427a-8616-dba4f3bdb62e tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:27.047703 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-1c362066-1918-427a-8616-dba4f3bdb62e tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:27.048192 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-1c362066-1918-427a-8616-dba4f3bdb62e tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:27.194582 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-1c362066-1918-427a-8616-dba4f3bdb62e tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa2e2a5a6ed4c5c9db91269266dd30b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f46ab11dd0b428486c673afc14b5b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:33:27.202463 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-1c362066-1918-427a-8616-dba4f3bdb62e tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] 10.222.0.121 "GET /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b" status: 200 len: 1366 microversion: 2.1 time: 0.168086 Aug 04 10:33:27.203196 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 58/103] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:33:27 2022] GET /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b => generated 1366 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:33:27.455519 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-f18c4703-5e91-453c-b5c6-b714f8c2a79b tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:33:27.456433 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-f18c4703-5e91-453c-b5c6-b714f8c2a79b tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] [instance: cabceac5-859e-4c28-86c2-aa9b63953009] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:33:27.463472 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-f18c4703-5e91-453c-b5c6-b714f8c2a79b tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:27.464362 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-f18c4703-5e91-453c-b5c6-b714f8c2a79b tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:27.465230 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-f18c4703-5e91-453c-b5c6-b714f8c2a79b tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:27.465751 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-f18c4703-5e91-453c-b5c6-b714f8c2a79b tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:27.555246 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-67d6de3f-3944-4d79-b1be-a3fe16a4be5e tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:33:27.555872 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-67d6de3f-3944-4d79-b1be-a3fe16a4be5e tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] [instance: c6dec6e8-e2f9-4c57-8326-19fc989b5c6e] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:33:27.562632 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-67d6de3f-3944-4d79-b1be-a3fe16a4be5e tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:27.563147 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-67d6de3f-3944-4d79-b1be-a3fe16a4be5e tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:27.563969 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-67d6de3f-3944-4d79-b1be-a3fe16a4be5e tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:27.564437 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-67d6de3f-3944-4d79-b1be-a3fe16a4be5e tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:27.650376 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-67d6de3f-3944-4d79-b1be-a3fe16a4be5e tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a38b5af1654f44bc6cb5832c2e8e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051b6a3defca48d7b4f8bb6705f89f20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:33:27.652053 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-f18c4703-5e91-453c-b5c6-b714f8c2a79b tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9520a49687b24281b78f08d43cb27dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c167faad577d47dfaf0d010a3f983fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:33:27.658294 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-67d6de3f-3944-4d79-b1be-a3fe16a4be5e tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] 10.222.0.121 "GET /compute/v2.1/servers/c6dec6e8-e2f9-4c57-8326-19fc989b5c6e" status: 200 len: 1316 microversion: 2.1 time: 0.107013 Aug 04 10:33:27.659722 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 59/104] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:33:27 2022] GET /compute/v2.1/servers/c6dec6e8-e2f9-4c57-8326-19fc989b5c6e => generated 1316 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 10:33:27.662207 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-f18c4703-5e91-453c-b5c6-b714f8c2a79b tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] 10.222.0.121 "GET /compute/v2.1/servers/cabceac5-859e-4c28-86c2-aa9b63953009" status: 200 len: 1318 microversion: 2.1 time: 0.210999 Aug 04 10:33:27.662830 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 46/105] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:33:27 2022] GET /compute/v2.1/servers/cabceac5-859e-4c28-86c2-aa9b63953009 => generated 1318 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:33:27.768482 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-fa3d6b8d-a94c-45c0-bde3-ecbc369c348a tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:33:27.770666 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-fa3d6b8d-a94c-45c0-bde3-ecbc369c348a tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] [instance: 2583b630-2f89-45ba-b781-c0b7c206d61e] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:33:27.785998 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-fa3d6b8d-a94c-45c0-bde3-ecbc369c348a tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:27.787028 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-fa3d6b8d-a94c-45c0-bde3-ecbc369c348a tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:27.788869 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-fa3d6b8d-a94c-45c0-bde3-ecbc369c348a tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:27.789864 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-fa3d6b8d-a94c-45c0-bde3-ecbc369c348a tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:27.893717 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-fa3d6b8d-a94c-45c0-bde3-ecbc369c348a tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3170dc3323f54512bc8819c8efa86b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7121bd118a2549c39332cfdb7edaa92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:33:27.911210 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-fa3d6b8d-a94c-45c0-bde3-ecbc369c348a tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] 10.222.0.121 "GET /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e" status: 200 len: 1295 microversion: 2.1 time: 0.153962 Aug 04 10:33:27.916423 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 60/106] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:33:27 2022] GET /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e => generated 1295 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:33:28.228293 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-06dfb94b-f097-4110-a68d-3e97b1718111 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:33:28.229520 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-06dfb94b-f097-4110-a68d-3e97b1718111 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] [instance: 81259012-5f3b-44f6-b979-39119f14929b] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:33:28.239989 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-06dfb94b-f097-4110-a68d-3e97b1718111 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:28.241368 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-06dfb94b-f097-4110-a68d-3e97b1718111 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:28.243451 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-06dfb94b-f097-4110-a68d-3e97b1718111 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:28.244902 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-06dfb94b-f097-4110-a68d-3e97b1718111 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:28.685420 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-90c79de7-1a3e-48e9-9a2a-323d08e8cfe8 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:33:28.686412 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-90c79de7-1a3e-48e9-9a2a-323d08e8cfe8 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] [instance: c6dec6e8-e2f9-4c57-8326-19fc989b5c6e] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:33:28.702801 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-90c79de7-1a3e-48e9-9a2a-323d08e8cfe8 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:28.704643 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-90c79de7-1a3e-48e9-9a2a-323d08e8cfe8 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:28.708548 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-90c79de7-1a3e-48e9-9a2a-323d08e8cfe8 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:28.714770 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-90c79de7-1a3e-48e9-9a2a-323d08e8cfe8 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:28.970113 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-90c79de7-1a3e-48e9-9a2a-323d08e8cfe8 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a38b5af1654f44bc6cb5832c2e8e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051b6a3defca48d7b4f8bb6705f89f20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:33:28.986433 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-90c79de7-1a3e-48e9-9a2a-323d08e8cfe8 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] 10.222.0.121 "GET /compute/v2.1/servers/c6dec6e8-e2f9-4c57-8326-19fc989b5c6e" status: 200 len: 1304 microversion: 2.1 time: 0.306265 Aug 04 10:33:28.988263 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 61/107] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:33:28 2022] GET /compute/v2.1/servers/c6dec6e8-e2f9-4c57-8326-19fc989b5c6e => generated 1304 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 10:33:28.996221 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-a0ac1f07-5d0a-4117-be66-40c520f6e415 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:33:28.997917 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-a0ac1f07-5d0a-4117-be66-40c520f6e415 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] [instance: cabceac5-859e-4c28-86c2-aa9b63953009] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:33:29.006392 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-a0ac1f07-5d0a-4117-be66-40c520f6e415 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:29.007340 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-a0ac1f07-5d0a-4117-be66-40c520f6e415 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:29.009406 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-a0ac1f07-5d0a-4117-be66-40c520f6e415 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:29.010006 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-a0ac1f07-5d0a-4117-be66-40c520f6e415 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:29.120058 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-06dfb94b-f097-4110-a68d-3e97b1718111 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa2e2a5a6ed4c5c9db91269266dd30b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f46ab11dd0b428486c673afc14b5b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:33:29.131593 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-06dfb94b-f097-4110-a68d-3e97b1718111 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] 10.222.0.121 "GET /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b" status: 200 len: 1366 microversion: 2.1 time: 0.910024 Aug 04 10:33:29.146797 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 47/108] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:33:28 2022] GET /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b => generated 1366 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:33:29.152627 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-933c8fc4-05b0-4e32-896e-6bb2f1eb550e tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:33:29.153753 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-933c8fc4-05b0-4e32-896e-6bb2f1eb550e tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] [instance: 2583b630-2f89-45ba-b781-c0b7c206d61e] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:33:29.163208 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-933c8fc4-05b0-4e32-896e-6bb2f1eb550e tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:29.164146 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-933c8fc4-05b0-4e32-896e-6bb2f1eb550e tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:29.166826 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-933c8fc4-05b0-4e32-896e-6bb2f1eb550e tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:29.168082 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-933c8fc4-05b0-4e32-896e-6bb2f1eb550e tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:29.362603 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-933c8fc4-05b0-4e32-896e-6bb2f1eb550e tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3170dc3323f54512bc8819c8efa86b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7121bd118a2549c39332cfdb7edaa92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:33:29.380628 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-933c8fc4-05b0-4e32-896e-6bb2f1eb550e tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] 10.222.0.121 "GET /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e" status: 200 len: 1283 microversion: 2.1 time: 0.232117 Aug 04 10:33:29.381238 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 48/109] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:33:29 2022] GET /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e => generated 1283 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:33:29.453822 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-a0ac1f07-5d0a-4117-be66-40c520f6e415 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9520a49687b24281b78f08d43cb27dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c167faad577d47dfaf0d010a3f983fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:33:29.464001 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-a0ac1f07-5d0a-4117-be66-40c520f6e415 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] 10.222.0.121 "GET /compute/v2.1/servers/cabceac5-859e-4c28-86c2-aa9b63953009" status: 200 len: 1318 microversion: 2.1 time: 0.474405 Aug 04 10:33:29.465047 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 62/110] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:33:28 2022] GET /compute/v2.1/servers/cabceac5-859e-4c28-86c2-aa9b63953009 => generated 1318 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:33:29.587516 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [req-18d44014-df07-452c-8b52-6deb084b91f5 req-2c9edb6c-71b8-4d70-8e66-ea090ae992b2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "81259012-5f3b-44f6-b979-39119f14929b", "tag": "79122914-2885-4d97-bea8-a589e38d68d8"}]} {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:33:29.603506 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [req-18d44014-df07-452c-8b52-6deb084b91f5 req-2c9edb6c-71b8-4d70-8e66-ea090ae992b2 service nova] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:29.603973 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [req-18d44014-df07-452c-8b52-6deb084b91f5 req-2c9edb6c-71b8-4d70-8e66-ea090ae992b2 service nova] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:29.630715 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.compute.server_external_events [req-18d44014-df07-452c-8b52-6deb084b91f5 req-2c9edb6c-71b8-4d70-8e66-ea090ae992b2 service nova] Creating event network-changed:79122914-2885-4d97-bea8-a589e38d68d8 for instance 81259012-5f3b-44f6-b979-39119f14929b on hv-cinder-85200 Aug 04 10:33:29.631439 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [req-18d44014-df07-452c-8b52-6deb084b91f5 req-2c9edb6c-71b8-4d70-8e66-ea090ae992b2 service nova] Acquired lock "compute-rpcapi-router" {{(pid=124456) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Aug 04 10:33:29.633444 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-1f7ca2f3-e94f-4cbc-ac75-80416d68dced None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:29.634245 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-1f7ca2f3-e94f-4cbc-ac75-80416d68dced None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:29.635632 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-1f7ca2f3-e94f-4cbc-ac75-80416d68dced None None] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:29.636356 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-1f7ca2f3-e94f-4cbc-ac75-80416d68dced None None] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:29.651188 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.compute.rpcapi [None req-1f7ca2f3-e94f-4cbc-ac75-80416d68dced None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 04 10:33:29.652628 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-1f7ca2f3-e94f-4cbc-ac75-80416d68dced None None] Releasing lock "compute-rpcapi-router" {{(pid=124456) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Aug 04 10:33:29.675485 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-1f7ca2f3-e94f-4cbc-ac75-80416d68dced None None] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.182905 Aug 04 10:33:29.677532 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 49/111] 10.222.0.121 () {64 vars in 1322 bytes} [Thu Aug 4 10:33:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:33:30.010836 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-dc285915-9982-46f0-b0dc-9e70fa51e93e tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:33:30.011436 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-dc285915-9982-46f0-b0dc-9e70fa51e93e tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] [instance: c6dec6e8-e2f9-4c57-8326-19fc989b5c6e] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:33:30.019591 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-dc285915-9982-46f0-b0dc-9e70fa51e93e tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:30.020050 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-dc285915-9982-46f0-b0dc-9e70fa51e93e tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:30.021054 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-dc285915-9982-46f0-b0dc-9e70fa51e93e tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:30.021490 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-dc285915-9982-46f0-b0dc-9e70fa51e93e tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:30.160686 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-54f56317-e771-47ed-b5fc-982643300329 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:33:30.161970 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-54f56317-e771-47ed-b5fc-982643300329 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] [instance: 81259012-5f3b-44f6-b979-39119f14929b] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:33:30.174024 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-54f56317-e771-47ed-b5fc-982643300329 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:30.174705 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-54f56317-e771-47ed-b5fc-982643300329 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:30.175790 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-54f56317-e771-47ed-b5fc-982643300329 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:30.176406 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-54f56317-e771-47ed-b5fc-982643300329 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:30.498574 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-dc285915-9982-46f0-b0dc-9e70fa51e93e tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a38b5af1654f44bc6cb5832c2e8e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051b6a3defca48d7b4f8bb6705f89f20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:33:30.507277 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-dc285915-9982-46f0-b0dc-9e70fa51e93e tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] 10.222.0.121 "GET /compute/v2.1/servers/c6dec6e8-e2f9-4c57-8326-19fc989b5c6e" status: 200 len: 1371 microversion: 2.1 time: 0.500701 Aug 04 10:33:30.507876 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 63/112] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:33:30 2022] GET /compute/v2.1/servers/c6dec6e8-e2f9-4c57-8326-19fc989b5c6e => generated 1371 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:33:30.534188 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-54f56317-e771-47ed-b5fc-982643300329 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa2e2a5a6ed4c5c9db91269266dd30b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f46ab11dd0b428486c673afc14b5b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:33:30.542552 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG dbcounter [-] [124456] Writing DB stats nova_cell1:SELECT=100 {{(pid=124456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:33:30.578113 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-54f56317-e771-47ed-b5fc-982643300329 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] 10.222.0.121 "GET /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b" status: 200 len: 1366 microversion: 2.1 time: 0.425254 Aug 04 10:33:30.588468 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 50/113] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:33:30 2022] GET /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b => generated 1366 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 10:33:30.599094 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-7c37441b-1f5f-4a9b-b2c7-b667b5ff9dfe tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:33:30.600758 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-7c37441b-1f5f-4a9b-b2c7-b667b5ff9dfe tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] [instance: 2583b630-2f89-45ba-b781-c0b7c206d61e] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:33:30.612341 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-7c37441b-1f5f-4a9b-b2c7-b667b5ff9dfe tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:30.613525 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-7c37441b-1f5f-4a9b-b2c7-b667b5ff9dfe tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:30.615246 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-7c37441b-1f5f-4a9b-b2c7-b667b5ff9dfe tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:30.616454 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-7c37441b-1f5f-4a9b-b2c7-b667b5ff9dfe tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:30.619448 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [req-958d164b-d6c7-4d72-bb6f-a4edb2509ef4 req-f377f477-8773-46f5-a02a-af053fc757ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cabceac5-859e-4c28-86c2-aa9b63953009", "tag": "a3861873-99d9-49b7-9745-14f9834dfd57"}]} {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:33:30.635419 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [req-958d164b-d6c7-4d72-bb6f-a4edb2509ef4 req-f377f477-8773-46f5-a02a-af053fc757ec service nova] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:30.636222 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [req-958d164b-d6c7-4d72-bb6f-a4edb2509ef4 req-f377f477-8773-46f5-a02a-af053fc757ec service nova] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:30.663364 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.compute.server_external_events [req-958d164b-d6c7-4d72-bb6f-a4edb2509ef4 req-f377f477-8773-46f5-a02a-af053fc757ec service nova] Creating event network-changed:a3861873-99d9-49b7-9745-14f9834dfd57 for instance cabceac5-859e-4c28-86c2-aa9b63953009 on hv-cinder-85200 Aug 04 10:33:30.663990 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [req-958d164b-d6c7-4d72-bb6f-a4edb2509ef4 req-f377f477-8773-46f5-a02a-af053fc757ec service nova] Acquired lock "compute-rpcapi-router" {{(pid=124457) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Aug 04 10:33:30.665207 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-69e0adaa-01c8-4546-b015-e16139b4cd0f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:30.665674 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-69e0adaa-01c8-4546-b015-e16139b4cd0f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:30.666484 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-69e0adaa-01c8-4546-b015-e16139b4cd0f None None] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:30.666928 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-69e0adaa-01c8-4546-b015-e16139b4cd0f None None] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:30.676503 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.compute.rpcapi [None req-69e0adaa-01c8-4546-b015-e16139b4cd0f None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 04 10:33:30.677476 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-69e0adaa-01c8-4546-b015-e16139b4cd0f None None] Releasing lock "compute-rpcapi-router" {{(pid=124457) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Aug 04 10:33:30.703851 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-69e0adaa-01c8-4546-b015-e16139b4cd0f None None] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.194264 Aug 04 10:33:30.704572 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 64/114] 10.222.0.121 () {64 vars in 1322 bytes} [Thu Aug 4 10:33:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:33:30.711843 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-e2ef7c4e-25b8-43be-ad95-0811b4ece19b tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:33:30.712669 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-e2ef7c4e-25b8-43be-ad95-0811b4ece19b tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] [instance: cabceac5-859e-4c28-86c2-aa9b63953009] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:33:30.720080 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-e2ef7c4e-25b8-43be-ad95-0811b4ece19b tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:30.720544 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-e2ef7c4e-25b8-43be-ad95-0811b4ece19b tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:30.721322 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-e2ef7c4e-25b8-43be-ad95-0811b4ece19b tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:30.722242 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-e2ef7c4e-25b8-43be-ad95-0811b4ece19b tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:30.747275 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG dbcounter [-] [124457] Writing DB stats nova_cell1:SELECT=100 {{(pid=124457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:33:30.877976 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-7c37441b-1f5f-4a9b-b2c7-b667b5ff9dfe tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3170dc3323f54512bc8819c8efa86b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7121bd118a2549c39332cfdb7edaa92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:33:30.886410 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-7c37441b-1f5f-4a9b-b2c7-b667b5ff9dfe tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] 10.222.0.121 "GET /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e" status: 200 len: 1325 microversion: 2.1 time: 0.295803 Aug 04 10:33:30.887517 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 51/115] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:33:30 2022] GET /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e => generated 1325 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:33:30.915192 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-e2ef7c4e-25b8-43be-ad95-0811b4ece19b tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9520a49687b24281b78f08d43cb27dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c167faad577d47dfaf0d010a3f983fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:33:30.931648 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-e2ef7c4e-25b8-43be-ad95-0811b4ece19b tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] 10.222.0.121 "GET /compute/v2.1/servers/cabceac5-859e-4c28-86c2-aa9b63953009" status: 200 len: 1318 microversion: 2.1 time: 0.225487 Aug 04 10:33:30.932331 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 65/116] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:33:30 2022] GET /compute/v2.1/servers/cabceac5-859e-4c28-86c2-aa9b63953009 => generated 1318 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:33:31.535011 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-5d039ce0-492e-45ce-bacb-022de81b984d tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:33:31.536202 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-5d039ce0-492e-45ce-bacb-022de81b984d tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] [instance: c6dec6e8-e2f9-4c57-8326-19fc989b5c6e] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:33:31.543848 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-5d039ce0-492e-45ce-bacb-022de81b984d tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:31.544543 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-5d039ce0-492e-45ce-bacb-022de81b984d tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:31.545450 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-5d039ce0-492e-45ce-bacb-022de81b984d tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:31.545971 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-5d039ce0-492e-45ce-bacb-022de81b984d tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:31.610205 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-28cdfd9c-b787-4c9e-ad76-93a8e135976a tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:33:31.610989 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-28cdfd9c-b787-4c9e-ad76-93a8e135976a tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] [instance: 81259012-5f3b-44f6-b979-39119f14929b] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:33:31.618262 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-28cdfd9c-b787-4c9e-ad76-93a8e135976a tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:31.618711 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-28cdfd9c-b787-4c9e-ad76-93a8e135976a tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:31.619530 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-28cdfd9c-b787-4c9e-ad76-93a8e135976a tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:31.619977 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-28cdfd9c-b787-4c9e-ad76-93a8e135976a tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:31.775651 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-5d039ce0-492e-45ce-bacb-022de81b984d tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a38b5af1654f44bc6cb5832c2e8e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051b6a3defca48d7b4f8bb6705f89f20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:33:31.784895 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-5d039ce0-492e-45ce-bacb-022de81b984d tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] 10.222.0.121 "GET /compute/v2.1/servers/c6dec6e8-e2f9-4c57-8326-19fc989b5c6e" status: 200 len: 1371 microversion: 2.1 time: 0.253855 Aug 04 10:33:31.785700 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 52/117] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:33:31 2022] GET /compute/v2.1/servers/c6dec6e8-e2f9-4c57-8326-19fc989b5c6e => generated 1371 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:33:31.810019 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-28cdfd9c-b787-4c9e-ad76-93a8e135976a tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa2e2a5a6ed4c5c9db91269266dd30b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f46ab11dd0b428486c673afc14b5b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:33:31.818321 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-28cdfd9c-b787-4c9e-ad76-93a8e135976a tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] 10.222.0.121 "GET /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b" status: 200 len: 1366 microversion: 2.1 time: 0.212422 Aug 04 10:33:31.818923 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 66/118] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:33:31 2022] GET /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b => generated 1366 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 10:33:31.908842 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-9dd83849-ebb2-4e25-8bcf-c0015f7cdba5 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:33:31.909691 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-9dd83849-ebb2-4e25-8bcf-c0015f7cdba5 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] [instance: 2583b630-2f89-45ba-b781-c0b7c206d61e] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:33:31.919155 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-9dd83849-ebb2-4e25-8bcf-c0015f7cdba5 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:31.919620 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-9dd83849-ebb2-4e25-8bcf-c0015f7cdba5 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:31.920491 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-9dd83849-ebb2-4e25-8bcf-c0015f7cdba5 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:31.920937 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-9dd83849-ebb2-4e25-8bcf-c0015f7cdba5 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:31.966997 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-babf5ea2-31ad-4500-ba1f-c36b7cc2d696 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:33:31.967673 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-babf5ea2-31ad-4500-ba1f-c36b7cc2d696 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] [instance: cabceac5-859e-4c28-86c2-aa9b63953009] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:33:31.974811 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-babf5ea2-31ad-4500-ba1f-c36b7cc2d696 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:31.975271 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-babf5ea2-31ad-4500-ba1f-c36b7cc2d696 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:31.976110 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-babf5ea2-31ad-4500-ba1f-c36b7cc2d696 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:31.976649 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-babf5ea2-31ad-4500-ba1f-c36b7cc2d696 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:32.143278 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-9dd83849-ebb2-4e25-8bcf-c0015f7cdba5 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3170dc3323f54512bc8819c8efa86b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7121bd118a2549c39332cfdb7edaa92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:33:32.151764 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-9dd83849-ebb2-4e25-8bcf-c0015f7cdba5 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] 10.222.0.121 "GET /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e" status: 200 len: 1325 microversion: 2.1 time: 0.248408 Aug 04 10:33:32.152406 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 53/119] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:33:31 2022] GET /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e => generated 1325 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 10:33:32.185108 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-babf5ea2-31ad-4500-ba1f-c36b7cc2d696 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9520a49687b24281b78f08d43cb27dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c167faad577d47dfaf0d010a3f983fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:33:32.194128 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-babf5ea2-31ad-4500-ba1f-c36b7cc2d696 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] 10.222.0.121 "GET /compute/v2.1/servers/cabceac5-859e-4c28-86c2-aa9b63953009" status: 200 len: 1318 microversion: 2.1 time: 0.231146 Aug 04 10:33:32.194745 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 67/120] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:33:31 2022] GET /compute/v2.1/servers/cabceac5-859e-4c28-86c2-aa9b63953009 => generated 1318 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:33:32.744261 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [req-2644d199-fb6e-48bd-8d0b-6406e28f4cc3 req-026ac510-b7b2-4452-8a2d-b3b5ecdcc2d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b09b542-5b10-4244-88af-cb6de23588d8", "tag": "d8ed119b-b3f2-4fd9-99a2-09f4903e50d6"}]} {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:33:32.755335 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [req-2644d199-fb6e-48bd-8d0b-6406e28f4cc3 req-026ac510-b7b2-4452-8a2d-b3b5ecdcc2d4 service nova] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:32.755787 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [req-2644d199-fb6e-48bd-8d0b-6406e28f4cc3 req-026ac510-b7b2-4452-8a2d-b3b5ecdcc2d4 service nova] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:32.768114 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.compute.server_external_events [req-2644d199-fb6e-48bd-8d0b-6406e28f4cc3 req-026ac510-b7b2-4452-8a2d-b3b5ecdcc2d4 service nova] Creating event network-changed:d8ed119b-b3f2-4fd9-99a2-09f4903e50d6 for instance 9b09b542-5b10-4244-88af-cb6de23588d8 on hv-cinder-85200 Aug 04 10:33:32.773784 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [req-2644d199-fb6e-48bd-8d0b-6406e28f4cc3 req-026ac510-b7b2-4452-8a2d-b3b5ecdcc2d4 service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033441 Aug 04 10:33:32.774727 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 54/121] 10.222.0.121 () {64 vars in 1322 bytes} [Thu Aug 4 10:33:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:33:32.807224 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-fe84f7c0-4c7b-44d8-bf18-c01f7acb6c59 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:33:32.808478 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-fe84f7c0-4c7b-44d8-bf18-c01f7acb6c59 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] [instance: c6dec6e8-e2f9-4c57-8326-19fc989b5c6e] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:33:32.816269 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-fe84f7c0-4c7b-44d8-bf18-c01f7acb6c59 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:32.816740 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-fe84f7c0-4c7b-44d8-bf18-c01f7acb6c59 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:32.817569 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-fe84f7c0-4c7b-44d8-bf18-c01f7acb6c59 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:32.818021 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-fe84f7c0-4c7b-44d8-bf18-c01f7acb6c59 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:32.844858 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-62fcfea4-9050-4dc3-a581-de2e2477b29b tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:33:32.850260 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-62fcfea4-9050-4dc3-a581-de2e2477b29b tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] [instance: 81259012-5f3b-44f6-b979-39119f14929b] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:33:32.860062 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-62fcfea4-9050-4dc3-a581-de2e2477b29b tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:32.861394 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-62fcfea4-9050-4dc3-a581-de2e2477b29b tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:32.862574 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-62fcfea4-9050-4dc3-a581-de2e2477b29b tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:32.863218 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-62fcfea4-9050-4dc3-a581-de2e2477b29b tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:33.068106 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-fe84f7c0-4c7b-44d8-bf18-c01f7acb6c59 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a38b5af1654f44bc6cb5832c2e8e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051b6a3defca48d7b4f8bb6705f89f20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:33:33.070625 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-62fcfea4-9050-4dc3-a581-de2e2477b29b tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa2e2a5a6ed4c5c9db91269266dd30b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f46ab11dd0b428486c673afc14b5b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:33:33.077039 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-fe84f7c0-4c7b-44d8-bf18-c01f7acb6c59 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] 10.222.0.121 "GET /compute/v2.1/servers/c6dec6e8-e2f9-4c57-8326-19fc989b5c6e" status: 200 len: 1371 microversion: 2.1 time: 0.274550 Aug 04 10:33:33.078615 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 68/122] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:33:32 2022] GET /compute/v2.1/servers/c6dec6e8-e2f9-4c57-8326-19fc989b5c6e => generated 1371 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:33:33.079873 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-62fcfea4-9050-4dc3-a581-de2e2477b29b tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] 10.222.0.121 "GET /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b" status: 200 len: 1366 microversion: 2.1 time: 0.239889 Aug 04 10:33:33.080482 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 55/123] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:33:32 2022] GET /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b => generated 1366 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:33:33.148931 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [req-de6fa8ef-1cc1-4f19-8f67-96ec1d7c69fc req-0b5395ed-fa46-447c-be4e-cab58ef9c498 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c6dec6e8-e2f9-4c57-8326-19fc989b5c6e", "tag": "03bbc55a-5c71-4f8b-8a66-c3b18135d94a"}]} {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:33:33.160916 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [req-de6fa8ef-1cc1-4f19-8f67-96ec1d7c69fc req-0b5395ed-fa46-447c-be4e-cab58ef9c498 service nova] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:33.161990 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [req-de6fa8ef-1cc1-4f19-8f67-96ec1d7c69fc req-0b5395ed-fa46-447c-be4e-cab58ef9c498 service nova] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:33.176060 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-79f7cc6d-7bc3-497a-8df2-9ecdb30243ee tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:33:33.176909 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-79f7cc6d-7bc3-497a-8df2-9ecdb30243ee tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] [instance: 2583b630-2f89-45ba-b781-c0b7c206d61e] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:33:33.187497 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-79f7cc6d-7bc3-497a-8df2-9ecdb30243ee tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:33.193296 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-79f7cc6d-7bc3-497a-8df2-9ecdb30243ee tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:33.194201 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-79f7cc6d-7bc3-497a-8df2-9ecdb30243ee tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:33.194798 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-79f7cc6d-7bc3-497a-8df2-9ecdb30243ee tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:33.201938 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.compute.server_external_events [req-de6fa8ef-1cc1-4f19-8f67-96ec1d7c69fc req-0b5395ed-fa46-447c-be4e-cab58ef9c498 service nova] Creating event network-changed:03bbc55a-5c71-4f8b-8a66-c3b18135d94a for instance c6dec6e8-e2f9-4c57-8326-19fc989b5c6e on hv-cinder-85200 Aug 04 10:33:33.214116 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [req-de6fa8ef-1cc1-4f19-8f67-96ec1d7c69fc req-0b5395ed-fa46-447c-be4e-cab58ef9c498 service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071128 Aug 04 10:33:33.214727 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 69/124] 10.222.0.121 () {64 vars in 1322 bytes} [Thu Aug 4 10:33:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:33:33.223438 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-dff93f3d-53d0-4aec-acb7-e483b8a70bce tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:33:33.226699 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-dff93f3d-53d0-4aec-acb7-e483b8a70bce tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] [instance: cabceac5-859e-4c28-86c2-aa9b63953009] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:33:33.236665 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-dff93f3d-53d0-4aec-acb7-e483b8a70bce tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:33.237750 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-dff93f3d-53d0-4aec-acb7-e483b8a70bce tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:33.239061 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-dff93f3d-53d0-4aec-acb7-e483b8a70bce tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:33.239640 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-dff93f3d-53d0-4aec-acb7-e483b8a70bce tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:33.791699 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-79f7cc6d-7bc3-497a-8df2-9ecdb30243ee tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3170dc3323f54512bc8819c8efa86b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7121bd118a2549c39332cfdb7edaa92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:33:33.822583 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-dff93f3d-53d0-4aec-acb7-e483b8a70bce tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9520a49687b24281b78f08d43cb27dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c167faad577d47dfaf0d010a3f983fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:33:33.825101 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-79f7cc6d-7bc3-497a-8df2-9ecdb30243ee tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] 10.222.0.121 "GET /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e" status: 200 len: 1325 microversion: 2.1 time: 0.654742 Aug 04 10:33:33.827617 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 56/125] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:33:33 2022] GET /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e => generated 1325 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 10:33:33.841930 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-dff93f3d-53d0-4aec-acb7-e483b8a70bce tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] 10.222.0.121 "GET /compute/v2.1/servers/cabceac5-859e-4c28-86c2-aa9b63953009" status: 200 len: 1318 microversion: 2.1 time: 0.625698 Aug 04 10:33:33.843416 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 70/126] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:33:33 2022] GET /compute/v2.1/servers/cabceac5-859e-4c28-86c2-aa9b63953009 => generated 1318 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:33:34.106620 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-4cefc747-21cb-46f7-91ab-a3fad18f141a tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:33:34.109369 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-4cefc747-21cb-46f7-91ab-a3fad18f141a tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] [instance: 81259012-5f3b-44f6-b979-39119f14929b] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:33:34.114286 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-a01fd7bc-816b-45eb-a239-ed0aa1a1bdad tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:33:34.115593 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-a01fd7bc-816b-45eb-a239-ed0aa1a1bdad tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] [instance: c6dec6e8-e2f9-4c57-8326-19fc989b5c6e] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:33:34.121641 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-4cefc747-21cb-46f7-91ab-a3fad18f141a tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:34.122677 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-4cefc747-21cb-46f7-91ab-a3fad18f141a tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:34.123985 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-4cefc747-21cb-46f7-91ab-a3fad18f141a tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:34.125101 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-4cefc747-21cb-46f7-91ab-a3fad18f141a tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:34.134540 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-a01fd7bc-816b-45eb-a239-ed0aa1a1bdad tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:34.134540 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-a01fd7bc-816b-45eb-a239-ed0aa1a1bdad tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:34.135032 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-a01fd7bc-816b-45eb-a239-ed0aa1a1bdad tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:34.137554 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-a01fd7bc-816b-45eb-a239-ed0aa1a1bdad tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:34.510950 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-4cefc747-21cb-46f7-91ab-a3fad18f141a tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa2e2a5a6ed4c5c9db91269266dd30b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f46ab11dd0b428486c673afc14b5b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:33:34.520155 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-4cefc747-21cb-46f7-91ab-a3fad18f141a tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] 10.222.0.121 "GET /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b" status: 200 len: 1366 microversion: 2.1 time: 0.420303 Aug 04 10:33:34.521827 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-a01fd7bc-816b-45eb-a239-ed0aa1a1bdad tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a38b5af1654f44bc6cb5832c2e8e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051b6a3defca48d7b4f8bb6705f89f20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:33:34.531582 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-a01fd7bc-816b-45eb-a239-ed0aa1a1bdad tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] 10.222.0.121 "GET /compute/v2.1/servers/c6dec6e8-e2f9-4c57-8326-19fc989b5c6e" status: 200 len: 1371 microversion: 2.1 time: 0.430710 Aug 04 10:33:34.534097 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 71/127] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:33:34 2022] GET /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b => generated 1366 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:33:34.537151 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 57/128] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:33:34 2022] GET /compute/v2.1/servers/c6dec6e8-e2f9-4c57-8326-19fc989b5c6e => generated 1371 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:33:34.788578 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [req-02a3addc-077b-49b6-831c-c71fd477442e req-a8dbc944-c597-4193-96a9-117694391920 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2583b630-2f89-45ba-b781-c0b7c206d61e", "tag": "c85208ac-5355-452e-8834-f5f341168cc4"}]} {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:33:34.798996 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [req-02a3addc-077b-49b6-831c-c71fd477442e req-a8dbc944-c597-4193-96a9-117694391920 service nova] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:34.799452 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [req-02a3addc-077b-49b6-831c-c71fd477442e req-a8dbc944-c597-4193-96a9-117694391920 service nova] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:34.811820 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.compute.server_external_events [req-02a3addc-077b-49b6-831c-c71fd477442e req-a8dbc944-c597-4193-96a9-117694391920 service nova] Creating event network-changed:c85208ac-5355-452e-8834-f5f341168cc4 for instance 2583b630-2f89-45ba-b781-c0b7c206d61e on hv-cinder-85200 Aug 04 10:33:34.817234 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [req-02a3addc-077b-49b6-831c-c71fd477442e req-a8dbc944-c597-4193-96a9-117694391920 service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032561 Aug 04 10:33:34.817853 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 72/129] 10.222.0.121 () {64 vars in 1322 bytes} [Thu Aug 4 10:33:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:33:34.860202 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-7850678f-b91c-42fa-bc56-6bb701af1f47 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:33:34.861408 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-7850678f-b91c-42fa-bc56-6bb701af1f47 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] [instance: 2583b630-2f89-45ba-b781-c0b7c206d61e] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:33:34.865131 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-dd08d03b-83f4-4f3a-b2b3-790a7dc29c82 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:33:34.865877 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-dd08d03b-83f4-4f3a-b2b3-790a7dc29c82 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] [instance: cabceac5-859e-4c28-86c2-aa9b63953009] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:33:34.867938 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-7850678f-b91c-42fa-bc56-6bb701af1f47 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:34.868508 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-7850678f-b91c-42fa-bc56-6bb701af1f47 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:34.869390 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-7850678f-b91c-42fa-bc56-6bb701af1f47 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:34.869856 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-7850678f-b91c-42fa-bc56-6bb701af1f47 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:34.872622 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-dd08d03b-83f4-4f3a-b2b3-790a7dc29c82 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:34.873084 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-dd08d03b-83f4-4f3a-b2b3-790a7dc29c82 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:34.873882 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-dd08d03b-83f4-4f3a-b2b3-790a7dc29c82 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:34.874311 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-dd08d03b-83f4-4f3a-b2b3-790a7dc29c82 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:35.086590 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-7850678f-b91c-42fa-bc56-6bb701af1f47 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3170dc3323f54512bc8819c8efa86b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7121bd118a2549c39332cfdb7edaa92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:33:35.090403 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-dd08d03b-83f4-4f3a-b2b3-790a7dc29c82 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9520a49687b24281b78f08d43cb27dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c167faad577d47dfaf0d010a3f983fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:33:35.097353 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-7850678f-b91c-42fa-bc56-6bb701af1f47 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] 10.222.0.121 "GET /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e" status: 200 len: 1325 microversion: 2.1 time: 0.241153 Aug 04 10:33:35.097957 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 58/130] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:33:34 2022] GET /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e => generated 1325 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:33:35.099582 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-dd08d03b-83f4-4f3a-b2b3-790a7dc29c82 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] 10.222.0.121 "GET /compute/v2.1/servers/cabceac5-859e-4c28-86c2-aa9b63953009" status: 200 len: 1318 microversion: 2.1 time: 0.238692 Aug 04 10:33:35.101695 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 73/131] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:33:34 2022] GET /compute/v2.1/servers/cabceac5-859e-4c28-86c2-aa9b63953009 => generated 1318 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 10:33:35.542684 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-e04ec216-ba64-435a-a4a1-66077fdbf860 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:33:35.543309 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-e04ec216-ba64-435a-a4a1-66077fdbf860 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] [instance: 81259012-5f3b-44f6-b979-39119f14929b] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:33:35.550503 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-e04ec216-ba64-435a-a4a1-66077fdbf860 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:35.550961 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-e04ec216-ba64-435a-a4a1-66077fdbf860 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:35.551767 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-e04ec216-ba64-435a-a4a1-66077fdbf860 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:35.552271 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-e04ec216-ba64-435a-a4a1-66077fdbf860 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:35.560024 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-214d78e3-c3fa-4b36-91b7-5e22d6ee96af tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:33:35.560024 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-214d78e3-c3fa-4b36-91b7-5e22d6ee96af tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] [instance: c6dec6e8-e2f9-4c57-8326-19fc989b5c6e] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:33:35.563007 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-214d78e3-c3fa-4b36-91b7-5e22d6ee96af tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:35.563557 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-214d78e3-c3fa-4b36-91b7-5e22d6ee96af tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:35.564464 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-214d78e3-c3fa-4b36-91b7-5e22d6ee96af tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:35.565259 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-214d78e3-c3fa-4b36-91b7-5e22d6ee96af tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:35.773447 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-214d78e3-c3fa-4b36-91b7-5e22d6ee96af tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a38b5af1654f44bc6cb5832c2e8e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051b6a3defca48d7b4f8bb6705f89f20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:33:35.776770 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-e04ec216-ba64-435a-a4a1-66077fdbf860 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa2e2a5a6ed4c5c9db91269266dd30b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f46ab11dd0b428486c673afc14b5b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:33:35.781345 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-214d78e3-c3fa-4b36-91b7-5e22d6ee96af tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] 10.222.0.121 "GET /compute/v2.1/servers/c6dec6e8-e2f9-4c57-8326-19fc989b5c6e" status: 200 len: 1371 microversion: 2.1 time: 0.230492 Aug 04 10:33:35.782007 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 74/132] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:33:35 2022] GET /compute/v2.1/servers/c6dec6e8-e2f9-4c57-8326-19fc989b5c6e => generated 1371 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:33:35.784702 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-e04ec216-ba64-435a-a4a1-66077fdbf860 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] 10.222.0.121 "GET /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b" status: 200 len: 1366 microversion: 2.1 time: 0.246204 Aug 04 10:33:35.785534 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 59/133] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:33:35 2022] GET /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b => generated 1366 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:33:36.136945 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-4edbf889-1e5c-4d98-92e8-e99612c7c7fc tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:33:36.138867 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-4edbf889-1e5c-4d98-92e8-e99612c7c7fc tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] [instance: cabceac5-859e-4c28-86c2-aa9b63953009] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:33:36.141482 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-3507d4b2-396d-4736-9287-7b32d8911616 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:33:36.142841 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-3507d4b2-396d-4736-9287-7b32d8911616 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] [instance: 2583b630-2f89-45ba-b781-c0b7c206d61e] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:33:36.148809 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-4edbf889-1e5c-4d98-92e8-e99612c7c7fc tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:36.149362 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-4edbf889-1e5c-4d98-92e8-e99612c7c7fc tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:36.151426 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-4edbf889-1e5c-4d98-92e8-e99612c7c7fc tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:36.151426 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-4edbf889-1e5c-4d98-92e8-e99612c7c7fc tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:36.158100 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-3507d4b2-396d-4736-9287-7b32d8911616 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:36.159149 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-3507d4b2-396d-4736-9287-7b32d8911616 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:36.160785 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-3507d4b2-396d-4736-9287-7b32d8911616 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:36.161585 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-3507d4b2-396d-4736-9287-7b32d8911616 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:36.383007 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-4edbf889-1e5c-4d98-92e8-e99612c7c7fc tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9520a49687b24281b78f08d43cb27dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c167faad577d47dfaf0d010a3f983fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:33:36.392462 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-4edbf889-1e5c-4d98-92e8-e99612c7c7fc tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] 10.222.0.121 "GET /compute/v2.1/servers/cabceac5-859e-4c28-86c2-aa9b63953009" status: 200 len: 1318 microversion: 2.1 time: 0.260138 Aug 04 10:33:36.400335 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 60/134] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:33:36 2022] GET /compute/v2.1/servers/cabceac5-859e-4c28-86c2-aa9b63953009 => generated 1318 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 10:33:36.400465 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-3507d4b2-396d-4736-9287-7b32d8911616 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3170dc3323f54512bc8819c8efa86b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7121bd118a2549c39332cfdb7edaa92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:33:36.410178 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-3507d4b2-396d-4736-9287-7b32d8911616 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] 10.222.0.121 "GET /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e" status: 200 len: 1325 microversion: 2.1 time: 0.289486 Aug 04 10:33:36.411123 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 75/135] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:33:36 2022] GET /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e => generated 1325 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:33:36.803390 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-82bd7a77-7a2f-4dc4-9864-e9236bbfa482 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:33:36.804057 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-82bd7a77-7a2f-4dc4-9864-e9236bbfa482 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] [instance: c6dec6e8-e2f9-4c57-8326-19fc989b5c6e] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:33:36.805826 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-67619ea1-2efb-4f2a-8956-f8fff4e276f6 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:33:36.806656 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-67619ea1-2efb-4f2a-8956-f8fff4e276f6 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] [instance: 81259012-5f3b-44f6-b979-39119f14929b] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:33:36.811553 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-82bd7a77-7a2f-4dc4-9864-e9236bbfa482 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:36.812028 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-82bd7a77-7a2f-4dc4-9864-e9236bbfa482 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:36.813308 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-82bd7a77-7a2f-4dc4-9864-e9236bbfa482 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:36.813449 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-82bd7a77-7a2f-4dc4-9864-e9236bbfa482 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:36.813561 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-67619ea1-2efb-4f2a-8956-f8fff4e276f6 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:36.813942 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-67619ea1-2efb-4f2a-8956-f8fff4e276f6 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:36.814768 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-67619ea1-2efb-4f2a-8956-f8fff4e276f6 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:36.815259 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-67619ea1-2efb-4f2a-8956-f8fff4e276f6 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:37.019805 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-82bd7a77-7a2f-4dc4-9864-e9236bbfa482 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a38b5af1654f44bc6cb5832c2e8e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051b6a3defca48d7b4f8bb6705f89f20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:33:37.024180 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-67619ea1-2efb-4f2a-8956-f8fff4e276f6 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa2e2a5a6ed4c5c9db91269266dd30b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f46ab11dd0b428486c673afc14b5b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:33:37.028339 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-82bd7a77-7a2f-4dc4-9864-e9236bbfa482 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] 10.222.0.121 "GET /compute/v2.1/servers/c6dec6e8-e2f9-4c57-8326-19fc989b5c6e" status: 200 len: 1371 microversion: 2.1 time: 0.229130 Aug 04 10:33:37.028932 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 61/136] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:33:36 2022] GET /compute/v2.1/servers/c6dec6e8-e2f9-4c57-8326-19fc989b5c6e => generated 1371 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:33:37.032316 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-67619ea1-2efb-4f2a-8956-f8fff4e276f6 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] 10.222.0.121 "GET /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b" status: 200 len: 1366 microversion: 2.1 time: 0.230536 Aug 04 10:33:37.032903 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 76/137] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:33:36 2022] GET /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b => generated 1366 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:33:37.429531 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-e18f58d8-638e-4ffd-8a34-0e4aa5b37a56 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:33:37.430165 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-e18f58d8-638e-4ffd-8a34-0e4aa5b37a56 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] [instance: cabceac5-859e-4c28-86c2-aa9b63953009] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:33:37.430874 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-71b1ea35-be64-43ec-8fd3-ac92f4021df7 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:33:37.431515 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-71b1ea35-be64-43ec-8fd3-ac92f4021df7 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] [instance: 2583b630-2f89-45ba-b781-c0b7c206d61e] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:33:37.436847 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-e18f58d8-638e-4ffd-8a34-0e4aa5b37a56 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:37.437320 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-e18f58d8-638e-4ffd-8a34-0e4aa5b37a56 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:37.438132 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-e18f58d8-638e-4ffd-8a34-0e4aa5b37a56 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:37.438607 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-e18f58d8-638e-4ffd-8a34-0e4aa5b37a56 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:37.440123 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-71b1ea35-be64-43ec-8fd3-ac92f4021df7 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:37.440745 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-71b1ea35-be64-43ec-8fd3-ac92f4021df7 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:37.441680 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-71b1ea35-be64-43ec-8fd3-ac92f4021df7 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:37.442169 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-71b1ea35-be64-43ec-8fd3-ac92f4021df7 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:37.952408 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-e18f58d8-638e-4ffd-8a34-0e4aa5b37a56 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9520a49687b24281b78f08d43cb27dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c167faad577d47dfaf0d010a3f983fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:33:37.968461 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-e18f58d8-638e-4ffd-8a34-0e4aa5b37a56 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] 10.222.0.121 "GET /compute/v2.1/servers/cabceac5-859e-4c28-86c2-aa9b63953009" status: 200 len: 1318 microversion: 2.1 time: 0.542745 Aug 04 10:33:37.970337 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 62/138] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:33:37 2022] GET /compute/v2.1/servers/cabceac5-859e-4c28-86c2-aa9b63953009 => generated 1318 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:33:38.051996 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-8abeb0ca-902d-4115-bb9c-b58fdba4f2f7 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:33:38.052869 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-8abeb0ca-902d-4115-bb9c-b58fdba4f2f7 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] [instance: c6dec6e8-e2f9-4c57-8326-19fc989b5c6e] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:33:38.061644 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-8abeb0ca-902d-4115-bb9c-b58fdba4f2f7 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:38.062186 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-8abeb0ca-902d-4115-bb9c-b58fdba4f2f7 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:38.063329 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-8abeb0ca-902d-4115-bb9c-b58fdba4f2f7 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:38.063783 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-8abeb0ca-902d-4115-bb9c-b58fdba4f2f7 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:38.257852 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-71b1ea35-be64-43ec-8fd3-ac92f4021df7 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3170dc3323f54512bc8819c8efa86b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7121bd118a2549c39332cfdb7edaa92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:33:38.269024 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-71b1ea35-be64-43ec-8fd3-ac92f4021df7 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] 10.222.0.121 "GET /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e" status: 200 len: 1325 microversion: 2.1 time: 0.841907 Aug 04 10:33:38.269644 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 77/139] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:33:37 2022] GET /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e => generated 1325 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:33:38.274982 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-fe70b7b0-f143-4a6f-8c75-fd8346bb4c23 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:33:38.276045 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-fe70b7b0-f143-4a6f-8c75-fd8346bb4c23 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] [instance: 81259012-5f3b-44f6-b979-39119f14929b] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:33:38.284239 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-fe70b7b0-f143-4a6f-8c75-fd8346bb4c23 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:38.285051 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-fe70b7b0-f143-4a6f-8c75-fd8346bb4c23 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:38.286038 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-fe70b7b0-f143-4a6f-8c75-fd8346bb4c23 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:38.286701 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-fe70b7b0-f143-4a6f-8c75-fd8346bb4c23 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:38.428442 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-8abeb0ca-902d-4115-bb9c-b58fdba4f2f7 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a38b5af1654f44bc6cb5832c2e8e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051b6a3defca48d7b4f8bb6705f89f20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:33:38.437632 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-8abeb0ca-902d-4115-bb9c-b58fdba4f2f7 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] 10.222.0.121 "GET /compute/v2.1/servers/c6dec6e8-e2f9-4c57-8326-19fc989b5c6e" status: 200 len: 1371 microversion: 2.1 time: 0.391640 Aug 04 10:33:38.438485 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 63/140] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:33:38 2022] GET /compute/v2.1/servers/c6dec6e8-e2f9-4c57-8326-19fc989b5c6e => generated 1371 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 10:33:38.480872 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-fe70b7b0-f143-4a6f-8c75-fd8346bb4c23 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa2e2a5a6ed4c5c9db91269266dd30b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f46ab11dd0b428486c673afc14b5b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:33:38.492638 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-fe70b7b0-f143-4a6f-8c75-fd8346bb4c23 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] 10.222.0.121 "GET /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b" status: 200 len: 1366 microversion: 2.1 time: 0.221541 Aug 04 10:33:38.493328 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 78/141] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:33:38 2022] GET /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b => generated 1366 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:33:38.994598 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-e0d34464-5f3e-4817-ba18-045088590059 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:33:38.995442 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-e0d34464-5f3e-4817-ba18-045088590059 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] [instance: cabceac5-859e-4c28-86c2-aa9b63953009] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:33:39.003705 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-e0d34464-5f3e-4817-ba18-045088590059 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:39.004652 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-e0d34464-5f3e-4817-ba18-045088590059 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:39.005870 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-e0d34464-5f3e-4817-ba18-045088590059 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:39.006564 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-e0d34464-5f3e-4817-ba18-045088590059 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:39.184304 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-e0d34464-5f3e-4817-ba18-045088590059 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9520a49687b24281b78f08d43cb27dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c167faad577d47dfaf0d010a3f983fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:33:39.193749 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-e0d34464-5f3e-4817-ba18-045088590059 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] 10.222.0.121 "GET /compute/v2.1/servers/cabceac5-859e-4c28-86c2-aa9b63953009" status: 200 len: 1318 microversion: 2.1 time: 0.203642 Aug 04 10:33:39.194790 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 64/142] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:33:38 2022] GET /compute/v2.1/servers/cabceac5-859e-4c28-86c2-aa9b63953009 => generated 1318 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:33:39.290555 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-51b3daa3-70eb-47e8-aa69-52c7b93c36af tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:33:39.291193 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-51b3daa3-70eb-47e8-aa69-52c7b93c36af tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] [instance: 2583b630-2f89-45ba-b781-c0b7c206d61e] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:33:39.297918 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-51b3daa3-70eb-47e8-aa69-52c7b93c36af tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:39.298873 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-51b3daa3-70eb-47e8-aa69-52c7b93c36af tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:39.300265 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-51b3daa3-70eb-47e8-aa69-52c7b93c36af tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:39.300727 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-51b3daa3-70eb-47e8-aa69-52c7b93c36af tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:39.446754 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-51b3daa3-70eb-47e8-aa69-52c7b93c36af tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3170dc3323f54512bc8819c8efa86b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7121bd118a2549c39332cfdb7edaa92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:33:39.455305 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-51b3daa3-70eb-47e8-aa69-52c7b93c36af tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] 10.222.0.121 "GET /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e" status: 200 len: 1325 microversion: 2.1 time: 0.168961 Aug 04 10:33:39.456439 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 79/143] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:33:39 2022] GET /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e => generated 1325 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 10:33:39.460528 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-3c7f9749-0fe5-4531-bc29-1808ccf7168e tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:33:39.461395 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-3c7f9749-0fe5-4531-bc29-1808ccf7168e tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] [instance: c6dec6e8-e2f9-4c57-8326-19fc989b5c6e] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:33:39.468447 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-3c7f9749-0fe5-4531-bc29-1808ccf7168e tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:39.469345 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-3c7f9749-0fe5-4531-bc29-1808ccf7168e tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:39.470142 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-3c7f9749-0fe5-4531-bc29-1808ccf7168e tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:39.470581 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-3c7f9749-0fe5-4531-bc29-1808ccf7168e tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:39.520677 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-f2d42e8d-5809-481f-a20a-a61739dd6ad6 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:33:39.522715 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-f2d42e8d-5809-481f-a20a-a61739dd6ad6 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] [instance: 81259012-5f3b-44f6-b979-39119f14929b] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:33:39.531589 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-f2d42e8d-5809-481f-a20a-a61739dd6ad6 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:39.531925 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-f2d42e8d-5809-481f-a20a-a61739dd6ad6 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:39.532742 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-f2d42e8d-5809-481f-a20a-a61739dd6ad6 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:39.533182 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-f2d42e8d-5809-481f-a20a-a61739dd6ad6 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:39.647688 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG dbcounter [-] [124456] Writing DB stats nova_cell0:SELECT=2 {{(pid=124456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:33:39.698874 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-3c7f9749-0fe5-4531-bc29-1808ccf7168e tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a38b5af1654f44bc6cb5832c2e8e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051b6a3defca48d7b4f8bb6705f89f20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:33:39.712222 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-3c7f9749-0fe5-4531-bc29-1808ccf7168e tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] 10.222.0.121 "GET /compute/v2.1/servers/c6dec6e8-e2f9-4c57-8326-19fc989b5c6e" status: 200 len: 1371 microversion: 2.1 time: 0.256772 Aug 04 10:33:39.713619 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 65/144] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:33:39 2022] GET /compute/v2.1/servers/c6dec6e8-e2f9-4c57-8326-19fc989b5c6e => generated 1371 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 10:33:39.743667 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-f2d42e8d-5809-481f-a20a-a61739dd6ad6 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa2e2a5a6ed4c5c9db91269266dd30b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f46ab11dd0b428486c673afc14b5b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:33:39.754334 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-f2d42e8d-5809-481f-a20a-a61739dd6ad6 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] 10.222.0.121 "GET /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b" status: 200 len: 1366 microversion: 2.1 time: 0.239427 Aug 04 10:33:39.755220 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 80/145] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:33:39 2022] GET /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b => generated 1366 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:33:40.215295 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-9a4c9c1b-78d9-4ea7-bc12-690ff3928827 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:33:40.215806 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-9a4c9c1b-78d9-4ea7-bc12-690ff3928827 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] [instance: cabceac5-859e-4c28-86c2-aa9b63953009] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:33:40.222444 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-9a4c9c1b-78d9-4ea7-bc12-690ff3928827 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:40.222900 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-9a4c9c1b-78d9-4ea7-bc12-690ff3928827 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:40.223734 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-9a4c9c1b-78d9-4ea7-bc12-690ff3928827 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:40.224215 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-9a4c9c1b-78d9-4ea7-bc12-690ff3928827 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:40.454988 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-9a4c9c1b-78d9-4ea7-bc12-690ff3928827 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9520a49687b24281b78f08d43cb27dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c167faad577d47dfaf0d010a3f983fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:33:40.466138 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-9a4c9c1b-78d9-4ea7-bc12-690ff3928827 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] 10.222.0.121 "GET /compute/v2.1/servers/cabceac5-859e-4c28-86c2-aa9b63953009" status: 200 len: 1318 microversion: 2.1 time: 0.254664 Aug 04 10:33:40.467519 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 66/146] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:33:40 2022] GET /compute/v2.1/servers/cabceac5-859e-4c28-86c2-aa9b63953009 => generated 1318 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:33:40.497081 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-8f537a80-c2b5-446b-9a13-91e7609169aa tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:33:40.500588 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-8f537a80-c2b5-446b-9a13-91e7609169aa tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] [instance: 2583b630-2f89-45ba-b781-c0b7c206d61e] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:33:40.514117 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-8f537a80-c2b5-446b-9a13-91e7609169aa tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:40.514976 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-8f537a80-c2b5-446b-9a13-91e7609169aa tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:40.516467 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-8f537a80-c2b5-446b-9a13-91e7609169aa tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:40.517230 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-8f537a80-c2b5-446b-9a13-91e7609169aa tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:40.677258 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG dbcounter [-] [124457] Writing DB stats nova_cell0:SELECT=2 {{(pid=124457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:33:40.747308 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-f322061f-3298-4411-bfc2-7a8abf881fcf tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:33:40.747958 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-f322061f-3298-4411-bfc2-7a8abf881fcf tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] [instance: c6dec6e8-e2f9-4c57-8326-19fc989b5c6e] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:33:40.755128 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-f322061f-3298-4411-bfc2-7a8abf881fcf tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:40.755984 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-f322061f-3298-4411-bfc2-7a8abf881fcf tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:40.757078 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-f322061f-3298-4411-bfc2-7a8abf881fcf tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:40.757789 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-f322061f-3298-4411-bfc2-7a8abf881fcf tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:40.764620 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-8f537a80-c2b5-446b-9a13-91e7609169aa tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3170dc3323f54512bc8819c8efa86b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7121bd118a2549c39332cfdb7edaa92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:33:40.802283 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-8f537a80-c2b5-446b-9a13-91e7609169aa tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] 10.222.0.121 "GET /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e" status: 200 len: 1325 microversion: 2.1 time: 0.314316 Aug 04 10:33:40.816961 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 81/147] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:33:40 2022] GET /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e => generated 1325 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 10:33:40.825406 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-4b39c9c3-dde8-43d5-bcc0-64efc6a578b7 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:33:40.826085 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-4b39c9c3-dde8-43d5-bcc0-64efc6a578b7 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] [instance: 81259012-5f3b-44f6-b979-39119f14929b] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:33:40.855828 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-4b39c9c3-dde8-43d5-bcc0-64efc6a578b7 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:40.857408 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-4b39c9c3-dde8-43d5-bcc0-64efc6a578b7 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:40.861144 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-4b39c9c3-dde8-43d5-bcc0-64efc6a578b7 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:40.862451 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-4b39c9c3-dde8-43d5-bcc0-64efc6a578b7 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:41.048800 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-f322061f-3298-4411-bfc2-7a8abf881fcf tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a38b5af1654f44bc6cb5832c2e8e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051b6a3defca48d7b4f8bb6705f89f20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:33:41.062115 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-f322061f-3298-4411-bfc2-7a8abf881fcf tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] 10.222.0.121 "GET /compute/v2.1/servers/c6dec6e8-e2f9-4c57-8326-19fc989b5c6e" status: 200 len: 1371 microversion: 2.1 time: 0.318234 Aug 04 10:33:41.067218 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 67/148] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:33:40 2022] GET /compute/v2.1/servers/c6dec6e8-e2f9-4c57-8326-19fc989b5c6e => generated 1371 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 10:33:41.193929 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-4b39c9c3-dde8-43d5-bcc0-64efc6a578b7 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa2e2a5a6ed4c5c9db91269266dd30b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f46ab11dd0b428486c673afc14b5b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:33:41.252076 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-4b39c9c3-dde8-43d5-bcc0-64efc6a578b7 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] 10.222.0.121 "GET /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b" status: 200 len: 1366 microversion: 2.1 time: 0.417235 Aug 04 10:33:41.253483 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 82/149] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:33:40 2022] GET /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b => generated 1366 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:33:41.504257 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-a0f90120-dfb6-420e-9c49-7fd39a03cf62 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:33:41.505180 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-a0f90120-dfb6-420e-9c49-7fd39a03cf62 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] [instance: cabceac5-859e-4c28-86c2-aa9b63953009] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:33:41.522116 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-a0f90120-dfb6-420e-9c49-7fd39a03cf62 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:41.525602 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-a0f90120-dfb6-420e-9c49-7fd39a03cf62 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:41.528122 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-a0f90120-dfb6-420e-9c49-7fd39a03cf62 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:41.529022 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-a0f90120-dfb6-420e-9c49-7fd39a03cf62 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:41.555606 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG dbcounter [-] [124456] Writing DB stats nova_cell1:SELECT=100 {{(pid=124456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:33:41.750227 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-a0f90120-dfb6-420e-9c49-7fd39a03cf62 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9520a49687b24281b78f08d43cb27dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c167faad577d47dfaf0d010a3f983fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:33:41.762216 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-a0f90120-dfb6-420e-9c49-7fd39a03cf62 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] 10.222.0.121 "GET /compute/v2.1/servers/cabceac5-859e-4c28-86c2-aa9b63953009" status: 200 len: 1318 microversion: 2.1 time: 0.262870 Aug 04 10:33:41.763692 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 68/150] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:33:41 2022] GET /compute/v2.1/servers/cabceac5-859e-4c28-86c2-aa9b63953009 => generated 1318 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:33:41.850297 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-504bff63-da28-474b-a208-0780bb18b05a tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:33:41.851755 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-504bff63-da28-474b-a208-0780bb18b05a tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] [instance: 2583b630-2f89-45ba-b781-c0b7c206d61e] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:33:41.882254 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-504bff63-da28-474b-a208-0780bb18b05a tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:41.882999 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-504bff63-da28-474b-a208-0780bb18b05a tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:41.884528 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-504bff63-da28-474b-a208-0780bb18b05a tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:41.885342 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-504bff63-da28-474b-a208-0780bb18b05a tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:41.933038 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG dbcounter [-] [124457] Writing DB stats nova_cell1:SELECT=100 {{(pid=124457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:33:42.086046 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-3b1025c1-455b-4d59-ad87-6c7d61a3e151 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:33:42.086703 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-3b1025c1-455b-4d59-ad87-6c7d61a3e151 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] [instance: c6dec6e8-e2f9-4c57-8326-19fc989b5c6e] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:33:42.093290 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-3b1025c1-455b-4d59-ad87-6c7d61a3e151 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:42.094138 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-3b1025c1-455b-4d59-ad87-6c7d61a3e151 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:42.095095 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-3b1025c1-455b-4d59-ad87-6c7d61a3e151 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:42.095773 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-3b1025c1-455b-4d59-ad87-6c7d61a3e151 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:42.122289 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-504bff63-da28-474b-a208-0780bb18b05a tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3170dc3323f54512bc8819c8efa86b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7121bd118a2549c39332cfdb7edaa92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:33:42.139740 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-504bff63-da28-474b-a208-0780bb18b05a tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] 10.222.0.121 "GET /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e" status: 200 len: 1325 microversion: 2.1 time: 0.299182 Aug 04 10:33:42.143600 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 83/151] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:33:41 2022] GET /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e => generated 1325 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:33:42.278906 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-31628e95-7981-41c9-9e51-ede292c3d01b tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:33:42.279610 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-31628e95-7981-41c9-9e51-ede292c3d01b tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] [instance: 81259012-5f3b-44f6-b979-39119f14929b] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:33:42.287383 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-31628e95-7981-41c9-9e51-ede292c3d01b tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:42.287843 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-31628e95-7981-41c9-9e51-ede292c3d01b tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:42.288901 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-31628e95-7981-41c9-9e51-ede292c3d01b tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:42.289541 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-31628e95-7981-41c9-9e51-ede292c3d01b tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:42.310710 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-3b1025c1-455b-4d59-ad87-6c7d61a3e151 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a38b5af1654f44bc6cb5832c2e8e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051b6a3defca48d7b4f8bb6705f89f20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:33:42.324276 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-3b1025c1-455b-4d59-ad87-6c7d61a3e151 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] 10.222.0.121 "GET /compute/v2.1/servers/c6dec6e8-e2f9-4c57-8326-19fc989b5c6e" status: 200 len: 1371 microversion: 2.1 time: 0.241131 Aug 04 10:33:42.325519 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 69/152] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:33:42 2022] GET /compute/v2.1/servers/c6dec6e8-e2f9-4c57-8326-19fc989b5c6e => generated 1371 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 10:33:42.480420 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-31628e95-7981-41c9-9e51-ede292c3d01b tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa2e2a5a6ed4c5c9db91269266dd30b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f46ab11dd0b428486c673afc14b5b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:33:42.488720 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-31628e95-7981-41c9-9e51-ede292c3d01b tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] 10.222.0.121 "GET /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b" status: 200 len: 1366 microversion: 2.1 time: 0.216689 Aug 04 10:33:42.489324 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 84/153] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:33:42 2022] GET /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b => generated 1366 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 10:33:42.788358 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-a5f256a0-0fd5-410d-a728-ed145ac3dfe2 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:33:42.789067 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-a5f256a0-0fd5-410d-a728-ed145ac3dfe2 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] [instance: cabceac5-859e-4c28-86c2-aa9b63953009] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:33:42.795379 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-a5f256a0-0fd5-410d-a728-ed145ac3dfe2 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:42.796008 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-a5f256a0-0fd5-410d-a728-ed145ac3dfe2 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:42.796872 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-a5f256a0-0fd5-410d-a728-ed145ac3dfe2 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:42.797402 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-a5f256a0-0fd5-410d-a728-ed145ac3dfe2 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:42.944096 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-a5f256a0-0fd5-410d-a728-ed145ac3dfe2 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9520a49687b24281b78f08d43cb27dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c167faad577d47dfaf0d010a3f983fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:33:42.952716 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-a5f256a0-0fd5-410d-a728-ed145ac3dfe2 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] 10.222.0.121 "GET /compute/v2.1/servers/cabceac5-859e-4c28-86c2-aa9b63953009" status: 200 len: 1318 microversion: 2.1 time: 0.168380 Aug 04 10:33:42.953690 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 70/154] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:33:42 2022] GET /compute/v2.1/servers/cabceac5-859e-4c28-86c2-aa9b63953009 => generated 1318 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:33:43.170282 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-36888882-c4c8-455b-88ee-3c40253248a7 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:33:43.171129 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-36888882-c4c8-455b-88ee-3c40253248a7 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] [instance: 2583b630-2f89-45ba-b781-c0b7c206d61e] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:33:43.179274 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-36888882-c4c8-455b-88ee-3c40253248a7 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:43.180220 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-36888882-c4c8-455b-88ee-3c40253248a7 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:43.181229 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-36888882-c4c8-455b-88ee-3c40253248a7 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:43.182238 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-36888882-c4c8-455b-88ee-3c40253248a7 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:43.347268 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-d1fdf7f6-25e9-4cec-82ad-901e02069c75 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:33:43.348332 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-d1fdf7f6-25e9-4cec-82ad-901e02069c75 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] [instance: c6dec6e8-e2f9-4c57-8326-19fc989b5c6e] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:33:43.356051 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-d1fdf7f6-25e9-4cec-82ad-901e02069c75 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:43.356885 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-d1fdf7f6-25e9-4cec-82ad-901e02069c75 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:43.357932 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-d1fdf7f6-25e9-4cec-82ad-901e02069c75 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:43.358570 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-d1fdf7f6-25e9-4cec-82ad-901e02069c75 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:43.398884 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-36888882-c4c8-455b-88ee-3c40253248a7 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3170dc3323f54512bc8819c8efa86b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7121bd118a2549c39332cfdb7edaa92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:33:43.410660 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-36888882-c4c8-455b-88ee-3c40253248a7 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] 10.222.0.121 "GET /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e" status: 200 len: 1325 microversion: 2.1 time: 0.244133 Aug 04 10:33:43.411596 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 85/155] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:33:43 2022] GET /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e => generated 1325 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:33:43.511996 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-3a158fd4-c64d-46c4-ac10-f6b68002dda7 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:33:43.513176 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-3a158fd4-c64d-46c4-ac10-f6b68002dda7 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] [instance: 81259012-5f3b-44f6-b979-39119f14929b] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:33:43.526217 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-3a158fd4-c64d-46c4-ac10-f6b68002dda7 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:43.526941 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-3a158fd4-c64d-46c4-ac10-f6b68002dda7 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:43.527970 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-3a158fd4-c64d-46c4-ac10-f6b68002dda7 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:43.528901 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-3a158fd4-c64d-46c4-ac10-f6b68002dda7 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:43.614673 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-d1fdf7f6-25e9-4cec-82ad-901e02069c75 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a38b5af1654f44bc6cb5832c2e8e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051b6a3defca48d7b4f8bb6705f89f20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:33:43.623423 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-d1fdf7f6-25e9-4cec-82ad-901e02069c75 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] 10.222.0.121 "GET /compute/v2.1/servers/c6dec6e8-e2f9-4c57-8326-19fc989b5c6e" status: 200 len: 1371 microversion: 2.1 time: 0.280606 Aug 04 10:33:43.624273 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 71/156] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:33:43 2022] GET /compute/v2.1/servers/c6dec6e8-e2f9-4c57-8326-19fc989b5c6e => generated 1371 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 10:33:43.732692 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-3a158fd4-c64d-46c4-ac10-f6b68002dda7 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa2e2a5a6ed4c5c9db91269266dd30b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f46ab11dd0b428486c673afc14b5b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:33:43.741506 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-3a158fd4-c64d-46c4-ac10-f6b68002dda7 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] 10.222.0.121 "GET /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b" status: 200 len: 1366 microversion: 2.1 time: 0.233397 Aug 04 10:33:43.755669 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 86/157] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:33:43 2022] GET /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b => generated 1366 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 10:33:43.973631 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-b8e4467a-4f58-44ca-ab6f-f19709237491 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:33:43.974261 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-b8e4467a-4f58-44ca-ab6f-f19709237491 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] [instance: cabceac5-859e-4c28-86c2-aa9b63953009] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:33:43.980959 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-b8e4467a-4f58-44ca-ab6f-f19709237491 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:43.981425 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-b8e4467a-4f58-44ca-ab6f-f19709237491 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:43.982217 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-b8e4467a-4f58-44ca-ab6f-f19709237491 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:43.982662 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-b8e4467a-4f58-44ca-ab6f-f19709237491 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:44.147021 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-b8e4467a-4f58-44ca-ab6f-f19709237491 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9520a49687b24281b78f08d43cb27dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c167faad577d47dfaf0d010a3f983fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:33:44.154633 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-b8e4467a-4f58-44ca-ab6f-f19709237491 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] 10.222.0.121 "GET /compute/v2.1/servers/cabceac5-859e-4c28-86c2-aa9b63953009" status: 200 len: 1318 microversion: 2.1 time: 0.185099 Aug 04 10:33:44.155766 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 72/158] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:33:43 2022] GET /compute/v2.1/servers/cabceac5-859e-4c28-86c2-aa9b63953009 => generated 1318 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:33:44.432449 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-54b63914-662a-4128-8634-1b5c089765aa tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:33:44.434299 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-54b63914-662a-4128-8634-1b5c089765aa tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] [instance: 2583b630-2f89-45ba-b781-c0b7c206d61e] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:33:44.442288 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-54b63914-662a-4128-8634-1b5c089765aa tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:44.442753 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-54b63914-662a-4128-8634-1b5c089765aa tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:44.443694 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-54b63914-662a-4128-8634-1b5c089765aa tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:44.444180 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-54b63914-662a-4128-8634-1b5c089765aa tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:44.648662 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-4bbf7d72-2797-4108-aeba-99fb044eed32 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:33:44.650287 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-4bbf7d72-2797-4108-aeba-99fb044eed32 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] [instance: c6dec6e8-e2f9-4c57-8326-19fc989b5c6e] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:33:44.650854 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-54b63914-662a-4128-8634-1b5c089765aa tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3170dc3323f54512bc8819c8efa86b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7121bd118a2549c39332cfdb7edaa92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:33:44.657443 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-4bbf7d72-2797-4108-aeba-99fb044eed32 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:44.658291 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-4bbf7d72-2797-4108-aeba-99fb044eed32 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:44.659600 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-4bbf7d72-2797-4108-aeba-99fb044eed32 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:44.660315 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-4bbf7d72-2797-4108-aeba-99fb044eed32 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:44.664281 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-54b63914-662a-4128-8634-1b5c089765aa tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] 10.222.0.121 "GET /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e" status: 200 len: 1325 microversion: 2.1 time: 0.235714 Aug 04 10:33:44.664879 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 87/159] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:33:44 2022] GET /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e => generated 1325 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:33:44.779114 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-1a3a07f1-e164-4c16-9a4d-0bf1086e4584 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:33:44.780000 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-1a3a07f1-e164-4c16-9a4d-0bf1086e4584 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] [instance: 81259012-5f3b-44f6-b979-39119f14929b] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:33:44.786884 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-1a3a07f1-e164-4c16-9a4d-0bf1086e4584 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:44.787615 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-1a3a07f1-e164-4c16-9a4d-0bf1086e4584 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:44.789146 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-1a3a07f1-e164-4c16-9a4d-0bf1086e4584 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:44.789752 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-1a3a07f1-e164-4c16-9a4d-0bf1086e4584 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:44.893585 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-4bbf7d72-2797-4108-aeba-99fb044eed32 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a38b5af1654f44bc6cb5832c2e8e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051b6a3defca48d7b4f8bb6705f89f20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:33:44.902735 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-4bbf7d72-2797-4108-aeba-99fb044eed32 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] 10.222.0.121 "GET /compute/v2.1/servers/c6dec6e8-e2f9-4c57-8326-19fc989b5c6e" status: 200 len: 1371 microversion: 2.1 time: 0.259076 Aug 04 10:33:44.903608 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 73/160] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:33:44 2022] GET /compute/v2.1/servers/c6dec6e8-e2f9-4c57-8326-19fc989b5c6e => generated 1371 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 10:33:44.971529 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-1a3a07f1-e164-4c16-9a4d-0bf1086e4584 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa2e2a5a6ed4c5c9db91269266dd30b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f46ab11dd0b428486c673afc14b5b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:33:44.995935 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-1a3a07f1-e164-4c16-9a4d-0bf1086e4584 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] 10.222.0.121 "GET /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b" status: 200 len: 1366 microversion: 2.1 time: 0.220385 Aug 04 10:33:44.996620 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 88/161] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:33:44 2022] GET /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b => generated 1366 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 10:33:45.180436 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-917e99b0-a56d-4872-ac12-01ddf895dcf6 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:33:45.181160 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-917e99b0-a56d-4872-ac12-01ddf895dcf6 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] [instance: cabceac5-859e-4c28-86c2-aa9b63953009] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:33:45.191497 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-917e99b0-a56d-4872-ac12-01ddf895dcf6 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:45.191497 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-917e99b0-a56d-4872-ac12-01ddf895dcf6 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:45.191497 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-917e99b0-a56d-4872-ac12-01ddf895dcf6 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:45.191497 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-917e99b0-a56d-4872-ac12-01ddf895dcf6 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:45.364330 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-917e99b0-a56d-4872-ac12-01ddf895dcf6 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9520a49687b24281b78f08d43cb27dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c167faad577d47dfaf0d010a3f983fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:33:45.374337 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-917e99b0-a56d-4872-ac12-01ddf895dcf6 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] 10.222.0.121 "GET /compute/v2.1/servers/cabceac5-859e-4c28-86c2-aa9b63953009" status: 200 len: 1318 microversion: 2.1 time: 0.199677 Aug 04 10:33:45.375590 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 74/162] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:33:45 2022] GET /compute/v2.1/servers/cabceac5-859e-4c28-86c2-aa9b63953009 => generated 1318 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:33:45.687367 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-f4e95de8-027d-4331-9525-2de2e3835c92 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:33:45.688420 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-f4e95de8-027d-4331-9525-2de2e3835c92 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] [instance: 2583b630-2f89-45ba-b781-c0b7c206d61e] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:33:45.695712 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-f4e95de8-027d-4331-9525-2de2e3835c92 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:45.696217 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-f4e95de8-027d-4331-9525-2de2e3835c92 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:45.697006 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-f4e95de8-027d-4331-9525-2de2e3835c92 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:45.697587 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-f4e95de8-027d-4331-9525-2de2e3835c92 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:45.916936 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-f4e95de8-027d-4331-9525-2de2e3835c92 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3170dc3323f54512bc8819c8efa86b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7121bd118a2549c39332cfdb7edaa92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:33:45.925206 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-2a4cbd4b-3a21-4f78-8698-efe5242ea76d tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:33:45.926260 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-2a4cbd4b-3a21-4f78-8698-efe5242ea76d tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] [instance: c6dec6e8-e2f9-4c57-8326-19fc989b5c6e] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:33:45.934226 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-f4e95de8-027d-4331-9525-2de2e3835c92 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] 10.222.0.121 "GET /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e" status: 200 len: 1325 microversion: 2.1 time: 0.252050 Aug 04 10:33:45.938501 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-2a4cbd4b-3a21-4f78-8698-efe5242ea76d tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:45.954057 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-2a4cbd4b-3a21-4f78-8698-efe5242ea76d tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:45.954583 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 89/163] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:33:45 2022] GET /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e => generated 1325 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:33:45.957337 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-2a4cbd4b-3a21-4f78-8698-efe5242ea76d tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:45.957544 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-2a4cbd4b-3a21-4f78-8698-efe5242ea76d tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:46.018109 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-3f636d00-0e76-4a18-939e-125d73b6b5a6 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:33:46.018849 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-3f636d00-0e76-4a18-939e-125d73b6b5a6 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] [instance: 81259012-5f3b-44f6-b979-39119f14929b] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:33:46.029341 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-3f636d00-0e76-4a18-939e-125d73b6b5a6 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:46.029914 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-3f636d00-0e76-4a18-939e-125d73b6b5a6 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:46.031169 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-3f636d00-0e76-4a18-939e-125d73b6b5a6 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:46.031798 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-3f636d00-0e76-4a18-939e-125d73b6b5a6 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:46.181897 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-2a4cbd4b-3a21-4f78-8698-efe5242ea76d tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a38b5af1654f44bc6cb5832c2e8e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051b6a3defca48d7b4f8bb6705f89f20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:33:46.194183 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-2a4cbd4b-3a21-4f78-8698-efe5242ea76d tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] 10.222.0.121 "GET /compute/v2.1/servers/c6dec6e8-e2f9-4c57-8326-19fc989b5c6e" status: 200 len: 1371 microversion: 2.1 time: 0.272851 Aug 04 10:33:46.197127 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 75/164] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:33:45 2022] GET /compute/v2.1/servers/c6dec6e8-e2f9-4c57-8326-19fc989b5c6e => generated 1371 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:33:46.398309 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-fc74d536-a4b8-4af5-8e7a-e2866b9f3c54 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:33:46.399104 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-fc74d536-a4b8-4af5-8e7a-e2866b9f3c54 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] [instance: cabceac5-859e-4c28-86c2-aa9b63953009] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:33:46.419437 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-fc74d536-a4b8-4af5-8e7a-e2866b9f3c54 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:46.419437 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-fc74d536-a4b8-4af5-8e7a-e2866b9f3c54 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:46.419437 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-fc74d536-a4b8-4af5-8e7a-e2866b9f3c54 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:46.419437 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-fc74d536-a4b8-4af5-8e7a-e2866b9f3c54 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:46.757435 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-3f636d00-0e76-4a18-939e-125d73b6b5a6 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa2e2a5a6ed4c5c9db91269266dd30b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f46ab11dd0b428486c673afc14b5b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:33:46.769588 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-3f636d00-0e76-4a18-939e-125d73b6b5a6 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] 10.222.0.121 "GET /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b" status: 200 len: 1366 microversion: 2.1 time: 0.755950 Aug 04 10:33:46.770635 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 90/165] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:33:46 2022] GET /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b => generated 1366 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 10:33:46.962608 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-149d2746-3ada-4704-ac52-877c01268e8d tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:33:46.963308 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-149d2746-3ada-4704-ac52-877c01268e8d tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] [instance: 2583b630-2f89-45ba-b781-c0b7c206d61e] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:33:46.979050 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-149d2746-3ada-4704-ac52-877c01268e8d tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:46.980194 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-149d2746-3ada-4704-ac52-877c01268e8d tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:46.981449 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-149d2746-3ada-4704-ac52-877c01268e8d tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:46.984970 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-149d2746-3ada-4704-ac52-877c01268e8d tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:47.036340 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-fc74d536-a4b8-4af5-8e7a-e2866b9f3c54 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9520a49687b24281b78f08d43cb27dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c167faad577d47dfaf0d010a3f983fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:33:47.051091 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-fc74d536-a4b8-4af5-8e7a-e2866b9f3c54 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] 10.222.0.121 "GET /compute/v2.1/servers/cabceac5-859e-4c28-86c2-aa9b63953009" status: 200 len: 1318 microversion: 2.1 time: 0.655973 Aug 04 10:33:47.053087 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 76/166] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:33:46 2022] GET /compute/v2.1/servers/cabceac5-859e-4c28-86c2-aa9b63953009 => generated 1318 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 10:33:47.222456 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-46674060-4b9d-49d9-a582-e6579bb824e9 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:33:47.224210 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-46674060-4b9d-49d9-a582-e6579bb824e9 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] [instance: c6dec6e8-e2f9-4c57-8326-19fc989b5c6e] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:33:47.237439 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-46674060-4b9d-49d9-a582-e6579bb824e9 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:47.238184 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-46674060-4b9d-49d9-a582-e6579bb824e9 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:47.240597 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-46674060-4b9d-49d9-a582-e6579bb824e9 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:47.241498 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-46674060-4b9d-49d9-a582-e6579bb824e9 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:47.836905 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-149d2746-3ada-4704-ac52-877c01268e8d tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3170dc3323f54512bc8819c8efa86b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7121bd118a2549c39332cfdb7edaa92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:33:47.847652 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-149d2746-3ada-4704-ac52-877c01268e8d tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] 10.222.0.121 "GET /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e" status: 200 len: 1325 microversion: 2.1 time: 0.890214 Aug 04 10:33:47.849893 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 91/167] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:33:46 2022] GET /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e => generated 1325 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:33:47.889061 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-46674060-4b9d-49d9-a582-e6579bb824e9 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a38b5af1654f44bc6cb5832c2e8e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051b6a3defca48d7b4f8bb6705f89f20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:33:47.908229 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-46674060-4b9d-49d9-a582-e6579bb824e9 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] 10.222.0.121 "GET /compute/v2.1/servers/c6dec6e8-e2f9-4c57-8326-19fc989b5c6e" status: 200 len: 1371 microversion: 2.1 time: 0.691483 Aug 04 10:33:47.909737 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 77/168] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:33:47 2022] GET /compute/v2.1/servers/c6dec6e8-e2f9-4c57-8326-19fc989b5c6e => generated 1371 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:33:47.915446 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-c07baa8e-7dad-40f6-b726-65e45dcb3a5e tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:33:47.916121 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-c07baa8e-7dad-40f6-b726-65e45dcb3a5e tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] [instance: 81259012-5f3b-44f6-b979-39119f14929b] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:33:47.924169 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-c07baa8e-7dad-40f6-b726-65e45dcb3a5e tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:47.924612 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-c07baa8e-7dad-40f6-b726-65e45dcb3a5e tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:47.925654 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-c07baa8e-7dad-40f6-b726-65e45dcb3a5e tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:47.926569 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-c07baa8e-7dad-40f6-b726-65e45dcb3a5e tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:47.998219 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [req-dcc8085f-88dc-4df8-9440-bfc1f05e8a5a req-a6105d70-beec-4d20-a4c1-c5b9c956e20a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b09b542-5b10-4244-88af-cb6de23588d8", "name": "network-vif-plugged", "status": "completed", "tag": "d8ed119b-b3f2-4fd9-99a2-09f4903e50d6"}]} {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:33:48.025484 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [req-dcc8085f-88dc-4df8-9440-bfc1f05e8a5a req-a6105d70-beec-4d20-a4c1-c5b9c956e20a service nova] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:48.026866 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [req-dcc8085f-88dc-4df8-9440-bfc1f05e8a5a req-a6105d70-beec-4d20-a4c1-c5b9c956e20a service nova] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:48.047494 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.compute.server_external_events [req-dcc8085f-88dc-4df8-9440-bfc1f05e8a5a req-a6105d70-beec-4d20-a4c1-c5b9c956e20a service nova] Creating event network-vif-plugged:d8ed119b-b3f2-4fd9-99a2-09f4903e50d6 for instance 9b09b542-5b10-4244-88af-cb6de23588d8 on hv-cinder-85200 Aug 04 10:33:48.061139 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [req-dcc8085f-88dc-4df8-9440-bfc1f05e8a5a req-a6105d70-beec-4d20-a4c1-c5b9c956e20a service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.193052 Aug 04 10:33:48.062065 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 92/169] 10.222.0.121 () {64 vars in 1322 bytes} [Thu Aug 4 10:33:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:33:48.086907 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-1a3c2a51-d024-4e99-b330-6a396231eb70 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:33:48.091530 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-1a3c2a51-d024-4e99-b330-6a396231eb70 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] [instance: cabceac5-859e-4c28-86c2-aa9b63953009] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:33:48.124397 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-1a3c2a51-d024-4e99-b330-6a396231eb70 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:48.127618 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-1a3c2a51-d024-4e99-b330-6a396231eb70 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:48.129464 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-1a3c2a51-d024-4e99-b330-6a396231eb70 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:48.131277 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-1a3c2a51-d024-4e99-b330-6a396231eb70 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:48.160992 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-c07baa8e-7dad-40f6-b726-65e45dcb3a5e tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa2e2a5a6ed4c5c9db91269266dd30b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f46ab11dd0b428486c673afc14b5b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:33:48.180675 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-c07baa8e-7dad-40f6-b726-65e45dcb3a5e tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] 10.222.0.121 "GET /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b" status: 200 len: 1366 microversion: 2.1 time: 0.268119 Aug 04 10:33:48.182395 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 78/170] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:33:47 2022] GET /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b => generated 1366 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:33:48.367837 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-1a3c2a51-d024-4e99-b330-6a396231eb70 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9520a49687b24281b78f08d43cb27dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c167faad577d47dfaf0d010a3f983fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:33:48.376324 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-1a3c2a51-d024-4e99-b330-6a396231eb70 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] 10.222.0.121 "GET /compute/v2.1/servers/cabceac5-859e-4c28-86c2-aa9b63953009" status: 200 len: 1318 microversion: 2.1 time: 0.304358 Aug 04 10:33:48.376927 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 93/171] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:33:48 2022] GET /compute/v2.1/servers/cabceac5-859e-4c28-86c2-aa9b63953009 => generated 1318 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:33:48.870248 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-22adbe02-1f5c-4fef-ba9c-002f139d2579 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:33:48.870897 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-22adbe02-1f5c-4fef-ba9c-002f139d2579 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] [instance: 2583b630-2f89-45ba-b781-c0b7c206d61e] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:33:48.877513 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-22adbe02-1f5c-4fef-ba9c-002f139d2579 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:48.877977 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-22adbe02-1f5c-4fef-ba9c-002f139d2579 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:48.878761 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-22adbe02-1f5c-4fef-ba9c-002f139d2579 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:48.879200 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-22adbe02-1f5c-4fef-ba9c-002f139d2579 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:48.935256 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-e071e4b0-d75f-4ce2-b9a6-bb3bce23d3f2 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:33:48.935854 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-e071e4b0-d75f-4ce2-b9a6-bb3bce23d3f2 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] [instance: c6dec6e8-e2f9-4c57-8326-19fc989b5c6e] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:33:48.943147 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-e071e4b0-d75f-4ce2-b9a6-bb3bce23d3f2 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:48.943972 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-e071e4b0-d75f-4ce2-b9a6-bb3bce23d3f2 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:48.944841 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-e071e4b0-d75f-4ce2-b9a6-bb3bce23d3f2 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:48.945360 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-e071e4b0-d75f-4ce2-b9a6-bb3bce23d3f2 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:49.058730 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-22adbe02-1f5c-4fef-ba9c-002f139d2579 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3170dc3323f54512bc8819c8efa86b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7121bd118a2549c39332cfdb7edaa92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:33:49.070849 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-22adbe02-1f5c-4fef-ba9c-002f139d2579 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] 10.222.0.121 "GET /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e" status: 200 len: 1325 microversion: 2.1 time: 0.204449 Aug 04 10:33:49.071903 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 79/172] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:33:48 2022] GET /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e => generated 1325 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:33:49.113507 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-e071e4b0-d75f-4ce2-b9a6-bb3bce23d3f2 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a38b5af1654f44bc6cb5832c2e8e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051b6a3defca48d7b4f8bb6705f89f20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:33:49.121982 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-e071e4b0-d75f-4ce2-b9a6-bb3bce23d3f2 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] 10.222.0.121 "GET /compute/v2.1/servers/c6dec6e8-e2f9-4c57-8326-19fc989b5c6e" status: 200 len: 1371 microversion: 2.1 time: 0.190709 Aug 04 10:33:49.122588 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 94/173] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:33:48 2022] GET /compute/v2.1/servers/c6dec6e8-e2f9-4c57-8326-19fc989b5c6e => generated 1371 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:33:49.203313 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-92ee7cf7-c513-421a-a693-c6fe1632cedf tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:33:49.204293 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-92ee7cf7-c513-421a-a693-c6fe1632cedf tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] [instance: 81259012-5f3b-44f6-b979-39119f14929b] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:33:49.211580 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-92ee7cf7-c513-421a-a693-c6fe1632cedf tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:49.212084 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-92ee7cf7-c513-421a-a693-c6fe1632cedf tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:49.213564 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-92ee7cf7-c513-421a-a693-c6fe1632cedf tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:49.213984 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-92ee7cf7-c513-421a-a693-c6fe1632cedf tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:49.402763 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-e475b628-bd58-4d24-afca-958d97696501 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:33:49.405348 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-e475b628-bd58-4d24-afca-958d97696501 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] [instance: cabceac5-859e-4c28-86c2-aa9b63953009] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:33:49.417240 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-e475b628-bd58-4d24-afca-958d97696501 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:49.418027 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-e475b628-bd58-4d24-afca-958d97696501 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:49.419576 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-e475b628-bd58-4d24-afca-958d97696501 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:49.420460 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-e475b628-bd58-4d24-afca-958d97696501 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:49.422570 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-92ee7cf7-c513-421a-a693-c6fe1632cedf tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa2e2a5a6ed4c5c9db91269266dd30b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f46ab11dd0b428486c673afc14b5b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:33:49.438871 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-92ee7cf7-c513-421a-a693-c6fe1632cedf tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] 10.222.0.121 "GET /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b" status: 200 len: 1366 microversion: 2.1 time: 0.239724 Aug 04 10:33:49.439635 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 80/174] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:33:49 2022] GET /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b => generated 1366 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:33:49.642230 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-e475b628-bd58-4d24-afca-958d97696501 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9520a49687b24281b78f08d43cb27dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c167faad577d47dfaf0d010a3f983fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:33:49.654190 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-e475b628-bd58-4d24-afca-958d97696501 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] 10.222.0.121 "GET /compute/v2.1/servers/cabceac5-859e-4c28-86c2-aa9b63953009" status: 200 len: 1318 microversion: 2.1 time: 0.257687 Aug 04 10:33:49.656084 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 95/175] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:33:49 2022] GET /compute/v2.1/servers/cabceac5-859e-4c28-86c2-aa9b63953009 => generated 1318 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:33:50.094312 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-521ad7e8-ef23-4d30-bd65-9f1845a58411 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:33:50.094891 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-521ad7e8-ef23-4d30-bd65-9f1845a58411 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] [instance: 2583b630-2f89-45ba-b781-c0b7c206d61e] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:33:50.096958 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG dbcounter [-] [124456] Writing DB stats nova_api:SELECT=98 {{(pid=124456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:33:50.102988 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-521ad7e8-ef23-4d30-bd65-9f1845a58411 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:50.103434 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-521ad7e8-ef23-4d30-bd65-9f1845a58411 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:50.104242 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-521ad7e8-ef23-4d30-bd65-9f1845a58411 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:50.104703 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-521ad7e8-ef23-4d30-bd65-9f1845a58411 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:50.144654 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-93b6346c-73b7-43ac-9a96-1ec3b886a270 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:33:50.145633 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-93b6346c-73b7-43ac-9a96-1ec3b886a270 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] [instance: c6dec6e8-e2f9-4c57-8326-19fc989b5c6e] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:33:50.153946 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-93b6346c-73b7-43ac-9a96-1ec3b886a270 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:50.154502 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-93b6346c-73b7-43ac-9a96-1ec3b886a270 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:50.155787 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-93b6346c-73b7-43ac-9a96-1ec3b886a270 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:50.156836 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-93b6346c-73b7-43ac-9a96-1ec3b886a270 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:50.366988 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-521ad7e8-ef23-4d30-bd65-9f1845a58411 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3170dc3323f54512bc8819c8efa86b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7121bd118a2549c39332cfdb7edaa92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:33:50.377511 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-521ad7e8-ef23-4d30-bd65-9f1845a58411 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] 10.222.0.121 "GET /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e" status: 200 len: 1325 microversion: 2.1 time: 0.287262 Aug 04 10:33:50.378418 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 81/176] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:33:50 2022] GET /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e => generated 1325 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:33:50.399987 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-93b6346c-73b7-43ac-9a96-1ec3b886a270 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a38b5af1654f44bc6cb5832c2e8e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051b6a3defca48d7b4f8bb6705f89f20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:33:50.408153 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-93b6346c-73b7-43ac-9a96-1ec3b886a270 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] 10.222.0.121 "GET /compute/v2.1/servers/c6dec6e8-e2f9-4c57-8326-19fc989b5c6e" status: 200 len: 1371 microversion: 2.1 time: 0.269303 Aug 04 10:33:50.408890 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 96/177] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:33:50 2022] GET /compute/v2.1/servers/c6dec6e8-e2f9-4c57-8326-19fc989b5c6e => generated 1371 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:33:50.460286 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-526a827f-3062-4ede-a44d-2628ea29e521 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:33:50.460994 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-526a827f-3062-4ede-a44d-2628ea29e521 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] [instance: 81259012-5f3b-44f6-b979-39119f14929b] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:33:50.467384 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-526a827f-3062-4ede-a44d-2628ea29e521 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:50.467837 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-526a827f-3062-4ede-a44d-2628ea29e521 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:50.468677 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-526a827f-3062-4ede-a44d-2628ea29e521 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:50.469127 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-526a827f-3062-4ede-a44d-2628ea29e521 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:50.623742 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-526a827f-3062-4ede-a44d-2628ea29e521 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa2e2a5a6ed4c5c9db91269266dd30b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f46ab11dd0b428486c673afc14b5b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:33:50.631545 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-526a827f-3062-4ede-a44d-2628ea29e521 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] 10.222.0.121 "GET /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b" status: 200 len: 1366 microversion: 2.1 time: 0.175394 Aug 04 10:33:50.632449 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 82/178] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:33:50 2022] GET /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b => generated 1366 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:33:50.677672 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-009d173f-b713-4811-ba69-392763d40473 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:33:50.678402 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-009d173f-b713-4811-ba69-392763d40473 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] [instance: cabceac5-859e-4c28-86c2-aa9b63953009] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:33:50.685093 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-009d173f-b713-4811-ba69-392763d40473 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:50.685545 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-009d173f-b713-4811-ba69-392763d40473 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:50.686347 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-009d173f-b713-4811-ba69-392763d40473 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:50.686778 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-009d173f-b713-4811-ba69-392763d40473 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:50.850037 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-009d173f-b713-4811-ba69-392763d40473 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9520a49687b24281b78f08d43cb27dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c167faad577d47dfaf0d010a3f983fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:33:50.860344 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-009d173f-b713-4811-ba69-392763d40473 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] 10.222.0.121 "GET /compute/v2.1/servers/cabceac5-859e-4c28-86c2-aa9b63953009" status: 200 len: 1318 microversion: 2.1 time: 0.186453 Aug 04 10:33:50.865105 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 97/179] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:33:50 2022] GET /compute/v2.1/servers/cabceac5-859e-4c28-86c2-aa9b63953009 => generated 1318 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:33:51.400708 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-0f43aefe-d028-4317-8cf4-429c3ecd6df3 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:33:51.401861 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-0f43aefe-d028-4317-8cf4-429c3ecd6df3 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] [instance: 2583b630-2f89-45ba-b781-c0b7c206d61e] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:33:51.413969 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-0f43aefe-d028-4317-8cf4-429c3ecd6df3 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:51.414534 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-0f43aefe-d028-4317-8cf4-429c3ecd6df3 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:51.415537 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-0f43aefe-d028-4317-8cf4-429c3ecd6df3 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:51.415983 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-0f43aefe-d028-4317-8cf4-429c3ecd6df3 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:51.430650 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-2364c4bc-df2a-41c1-a545-f5e451903b88 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:33:51.432888 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-2364c4bc-df2a-41c1-a545-f5e451903b88 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] [instance: c6dec6e8-e2f9-4c57-8326-19fc989b5c6e] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:33:51.442042 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-2364c4bc-df2a-41c1-a545-f5e451903b88 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:51.442652 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-2364c4bc-df2a-41c1-a545-f5e451903b88 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:51.443625 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-2364c4bc-df2a-41c1-a545-f5e451903b88 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:51.444055 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-2364c4bc-df2a-41c1-a545-f5e451903b88 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:51.619349 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-0f43aefe-d028-4317-8cf4-429c3ecd6df3 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3170dc3323f54512bc8819c8efa86b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7121bd118a2549c39332cfdb7edaa92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:33:51.628112 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-0f43aefe-d028-4317-8cf4-429c3ecd6df3 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] 10.222.0.121 "GET /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e" status: 200 len: 1325 microversion: 2.1 time: 0.231819 Aug 04 10:33:51.628819 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 83/180] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:33:51 2022] GET /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e => generated 1325 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:33:51.653403 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-20a364be-d7b7-494f-add2-bcf2f6a26703 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:33:51.654040 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-20a364be-d7b7-494f-add2-bcf2f6a26703 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] [instance: 81259012-5f3b-44f6-b979-39119f14929b] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:33:51.654369 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-2364c4bc-df2a-41c1-a545-f5e451903b88 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a38b5af1654f44bc6cb5832c2e8e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051b6a3defca48d7b4f8bb6705f89f20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:33:51.661988 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-20a364be-d7b7-494f-add2-bcf2f6a26703 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:51.662610 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-20a364be-d7b7-494f-add2-bcf2f6a26703 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:51.663087 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-2364c4bc-df2a-41c1-a545-f5e451903b88 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] 10.222.0.121 "GET /compute/v2.1/servers/c6dec6e8-e2f9-4c57-8326-19fc989b5c6e" status: 200 len: 1371 microversion: 2.1 time: 0.236833 Aug 04 10:33:51.663755 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-20a364be-d7b7-494f-add2-bcf2f6a26703 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:51.664009 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 98/181] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:33:51 2022] GET /compute/v2.1/servers/c6dec6e8-e2f9-4c57-8326-19fc989b5c6e => generated 1371 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:33:51.668222 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-20a364be-d7b7-494f-add2-bcf2f6a26703 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:51.826281 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-20a364be-d7b7-494f-add2-bcf2f6a26703 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa2e2a5a6ed4c5c9db91269266dd30b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f46ab11dd0b428486c673afc14b5b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:33:51.831202 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG dbcounter [-] [124456] Writing DB stats nova_cell1:SELECT=100 {{(pid=124456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:33:51.838708 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-20a364be-d7b7-494f-add2-bcf2f6a26703 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] 10.222.0.121 "GET /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b" status: 200 len: 1366 microversion: 2.1 time: 0.189513 Aug 04 10:33:51.839620 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 84/182] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:33:51 2022] GET /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b => generated 1366 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:33:51.884070 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-948cab99-8643-4941-ab60-af44a8a27978 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:33:51.884597 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-948cab99-8643-4941-ab60-af44a8a27978 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] [instance: cabceac5-859e-4c28-86c2-aa9b63953009] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:33:51.889856 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG dbcounter [-] [124457] Writing DB stats nova_api:SELECT=100 {{(pid=124457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:33:51.894478 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-948cab99-8643-4941-ab60-af44a8a27978 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:51.894973 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-948cab99-8643-4941-ab60-af44a8a27978 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:51.895783 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-948cab99-8643-4941-ab60-af44a8a27978 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:51.896258 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-948cab99-8643-4941-ab60-af44a8a27978 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:52.038420 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-948cab99-8643-4941-ab60-af44a8a27978 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9520a49687b24281b78f08d43cb27dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c167faad577d47dfaf0d010a3f983fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:33:52.047148 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-948cab99-8643-4941-ab60-af44a8a27978 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] 10.222.0.121 "GET /compute/v2.1/servers/cabceac5-859e-4c28-86c2-aa9b63953009" status: 200 len: 1318 microversion: 2.1 time: 0.168693 Aug 04 10:33:52.047761 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 99/183] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:33:51 2022] GET /compute/v2.1/servers/cabceac5-859e-4c28-86c2-aa9b63953009 => generated 1318 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:33:52.651176 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-51a46d30-e01a-4357-bbcd-d8682a1e24f7 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:33:52.651936 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-51a46d30-e01a-4357-bbcd-d8682a1e24f7 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] [instance: 2583b630-2f89-45ba-b781-c0b7c206d61e] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:33:52.658387 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-51a46d30-e01a-4357-bbcd-d8682a1e24f7 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:52.658827 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-51a46d30-e01a-4357-bbcd-d8682a1e24f7 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:52.659608 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-51a46d30-e01a-4357-bbcd-d8682a1e24f7 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:52.660137 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-51a46d30-e01a-4357-bbcd-d8682a1e24f7 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:52.685229 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-18c85473-8eef-4d18-9666-b7dca8dc549e tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:33:52.686006 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-18c85473-8eef-4d18-9666-b7dca8dc549e tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] [instance: c6dec6e8-e2f9-4c57-8326-19fc989b5c6e] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:33:52.692354 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-18c85473-8eef-4d18-9666-b7dca8dc549e tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:52.692792 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-18c85473-8eef-4d18-9666-b7dca8dc549e tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:52.693800 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-18c85473-8eef-4d18-9666-b7dca8dc549e tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:52.694256 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-18c85473-8eef-4d18-9666-b7dca8dc549e tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:52.905011 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-51a46d30-e01a-4357-bbcd-d8682a1e24f7 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3170dc3323f54512bc8819c8efa86b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7121bd118a2549c39332cfdb7edaa92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:33:52.911598 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-18c85473-8eef-4d18-9666-b7dca8dc549e tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a38b5af1654f44bc6cb5832c2e8e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051b6a3defca48d7b4f8bb6705f89f20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:33:52.917545 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG dbcounter [-] [124457] Writing DB stats nova_cell1:SELECT=100 {{(pid=124457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:33:52.920462 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-51a46d30-e01a-4357-bbcd-d8682a1e24f7 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] 10.222.0.121 "GET /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e" status: 200 len: 1325 microversion: 2.1 time: 0.273741 Aug 04 10:33:52.930362 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 85/184] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:33:52 2022] GET /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e => generated 1325 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:33:52.930362 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-7a8060bc-7101-4f29-be24-50b17b9252e0 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:33:52.930362 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-7a8060bc-7101-4f29-be24-50b17b9252e0 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] [instance: 81259012-5f3b-44f6-b979-39119f14929b] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:33:52.930904 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-18c85473-8eef-4d18-9666-b7dca8dc549e tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] 10.222.0.121 "GET /compute/v2.1/servers/c6dec6e8-e2f9-4c57-8326-19fc989b5c6e" status: 200 len: 1371 microversion: 2.1 time: 0.246265 Aug 04 10:33:52.930904 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 100/185] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:33:52 2022] GET /compute/v2.1/servers/c6dec6e8-e2f9-4c57-8326-19fc989b5c6e => generated 1371 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:33:52.935127 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-7a8060bc-7101-4f29-be24-50b17b9252e0 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:52.935804 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-7a8060bc-7101-4f29-be24-50b17b9252e0 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:52.936796 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-7a8060bc-7101-4f29-be24-50b17b9252e0 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:52.937385 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-7a8060bc-7101-4f29-be24-50b17b9252e0 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:53.069509 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-14335a8e-6e18-412a-98d5-99ef23fc49d3 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:33:53.070235 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-14335a8e-6e18-412a-98d5-99ef23fc49d3 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] [instance: cabceac5-859e-4c28-86c2-aa9b63953009] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:33:53.077634 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-14335a8e-6e18-412a-98d5-99ef23fc49d3 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:53.078514 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-14335a8e-6e18-412a-98d5-99ef23fc49d3 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:53.079557 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-14335a8e-6e18-412a-98d5-99ef23fc49d3 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:53.080168 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-14335a8e-6e18-412a-98d5-99ef23fc49d3 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:53.102834 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-7a8060bc-7101-4f29-be24-50b17b9252e0 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa2e2a5a6ed4c5c9db91269266dd30b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f46ab11dd0b428486c673afc14b5b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:33:53.114682 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-7a8060bc-7101-4f29-be24-50b17b9252e0 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] 10.222.0.121 "GET /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b" status: 200 len: 1366 microversion: 2.1 time: 0.192478 Aug 04 10:33:53.115830 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 86/186] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:33:52 2022] GET /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b => generated 1366 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:33:53.282338 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-14335a8e-6e18-412a-98d5-99ef23fc49d3 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9520a49687b24281b78f08d43cb27dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c167faad577d47dfaf0d010a3f983fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:33:53.298415 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-14335a8e-6e18-412a-98d5-99ef23fc49d3 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] 10.222.0.121 "GET /compute/v2.1/servers/cabceac5-859e-4c28-86c2-aa9b63953009" status: 200 len: 1318 microversion: 2.1 time: 0.233059 Aug 04 10:33:53.299441 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 101/187] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:33:53 2022] GET /compute/v2.1/servers/cabceac5-859e-4c28-86c2-aa9b63953009 => generated 1318 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:33:53.957352 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-f364894a-cfa9-4aee-94d1-09f7811eaf1e tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:33:53.957923 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-f364894a-cfa9-4aee-94d1-09f7811eaf1e tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] [instance: 2583b630-2f89-45ba-b781-c0b7c206d61e] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:33:53.962722 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-23a860c0-c593-4b4a-a0ab-b0a352ebefce tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:33:53.963581 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-23a860c0-c593-4b4a-a0ab-b0a352ebefce tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] [instance: c6dec6e8-e2f9-4c57-8326-19fc989b5c6e] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:33:53.965429 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-f364894a-cfa9-4aee-94d1-09f7811eaf1e tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:53.965972 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-f364894a-cfa9-4aee-94d1-09f7811eaf1e tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:53.966843 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-f364894a-cfa9-4aee-94d1-09f7811eaf1e tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:53.967391 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-f364894a-cfa9-4aee-94d1-09f7811eaf1e tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:53.970822 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-23a860c0-c593-4b4a-a0ab-b0a352ebefce tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:53.971276 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-23a860c0-c593-4b4a-a0ab-b0a352ebefce tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:53.972590 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-23a860c0-c593-4b4a-a0ab-b0a352ebefce tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:53.973052 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-23a860c0-c593-4b4a-a0ab-b0a352ebefce tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:54.190545 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-23a860c0-c593-4b4a-a0ab-b0a352ebefce tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a38b5af1654f44bc6cb5832c2e8e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051b6a3defca48d7b4f8bb6705f89f20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:33:54.196324 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-f364894a-cfa9-4aee-94d1-09f7811eaf1e tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3170dc3323f54512bc8819c8efa86b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7121bd118a2549c39332cfdb7edaa92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:33:54.202712 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-23a860c0-c593-4b4a-a0ab-b0a352ebefce tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] 10.222.0.121 "GET /compute/v2.1/servers/c6dec6e8-e2f9-4c57-8326-19fc989b5c6e" status: 200 len: 1371 microversion: 2.1 time: 0.244008 Aug 04 10:33:54.203876 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 102/188] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:33:53 2022] GET /compute/v2.1/servers/c6dec6e8-e2f9-4c57-8326-19fc989b5c6e => generated 1371 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:33:54.207216 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-f364894a-cfa9-4aee-94d1-09f7811eaf1e tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] 10.222.0.121 "GET /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e" status: 200 len: 1325 microversion: 2.1 time: 0.254791 Aug 04 10:33:54.208448 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 87/189] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:33:53 2022] GET /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e => generated 1325 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 10:33:54.213682 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-a6db462a-ebb6-42aa-ab5f-7b80196f6edb tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:33:54.215139 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-a6db462a-ebb6-42aa-ab5f-7b80196f6edb tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] [instance: 81259012-5f3b-44f6-b979-39119f14929b] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:33:54.224519 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-a6db462a-ebb6-42aa-ab5f-7b80196f6edb tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:54.225317 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-a6db462a-ebb6-42aa-ab5f-7b80196f6edb tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:54.226740 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-a6db462a-ebb6-42aa-ab5f-7b80196f6edb tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:54.227852 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-a6db462a-ebb6-42aa-ab5f-7b80196f6edb tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:54.333662 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-ceb4e512-7699-4e6e-90a1-061d2d9edb70 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:33:54.334751 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-ceb4e512-7699-4e6e-90a1-061d2d9edb70 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] [instance: cabceac5-859e-4c28-86c2-aa9b63953009] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:33:54.347132 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-ceb4e512-7699-4e6e-90a1-061d2d9edb70 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:54.347595 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-ceb4e512-7699-4e6e-90a1-061d2d9edb70 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:54.348443 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-ceb4e512-7699-4e6e-90a1-061d2d9edb70 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:54.348954 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-ceb4e512-7699-4e6e-90a1-061d2d9edb70 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:54.443995 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-a6db462a-ebb6-42aa-ab5f-7b80196f6edb tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa2e2a5a6ed4c5c9db91269266dd30b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f46ab11dd0b428486c673afc14b5b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:33:54.459372 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-a6db462a-ebb6-42aa-ab5f-7b80196f6edb tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] 10.222.0.121 "GET /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b" status: 200 len: 1366 microversion: 2.1 time: 0.253153 Aug 04 10:33:54.460339 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 103/190] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:33:54 2022] GET /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b => generated 1366 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:33:54.547416 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-ceb4e512-7699-4e6e-90a1-061d2d9edb70 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9520a49687b24281b78f08d43cb27dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c167faad577d47dfaf0d010a3f983fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:33:54.556407 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-ceb4e512-7699-4e6e-90a1-061d2d9edb70 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] 10.222.0.121 "GET /compute/v2.1/servers/cabceac5-859e-4c28-86c2-aa9b63953009" status: 200 len: 1318 microversion: 2.1 time: 0.227845 Aug 04 10:33:54.557002 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 88/191] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:33:54 2022] GET /compute/v2.1/servers/cabceac5-859e-4c28-86c2-aa9b63953009 => generated 1318 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:33:55.227315 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-d26e49be-9b0c-4234-ad02-384ee4ee93d8 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:33:55.228467 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-d26e49be-9b0c-4234-ad02-384ee4ee93d8 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] [instance: c6dec6e8-e2f9-4c57-8326-19fc989b5c6e] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:33:55.230560 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-1ad77619-f316-4322-b79a-5c6196829541 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:33:55.231913 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-1ad77619-f316-4322-b79a-5c6196829541 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] [instance: 2583b630-2f89-45ba-b781-c0b7c206d61e] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:33:55.235962 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-d26e49be-9b0c-4234-ad02-384ee4ee93d8 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:55.236418 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-d26e49be-9b0c-4234-ad02-384ee4ee93d8 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:55.237400 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-d26e49be-9b0c-4234-ad02-384ee4ee93d8 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:55.238050 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-d26e49be-9b0c-4234-ad02-384ee4ee93d8 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:55.240268 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-1ad77619-f316-4322-b79a-5c6196829541 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:55.241197 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-1ad77619-f316-4322-b79a-5c6196829541 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:55.242107 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-1ad77619-f316-4322-b79a-5c6196829541 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:55.242570 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-1ad77619-f316-4322-b79a-5c6196829541 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:55.458152 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-1ad77619-f316-4322-b79a-5c6196829541 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3170dc3323f54512bc8819c8efa86b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7121bd118a2549c39332cfdb7edaa92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:33:55.463610 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-d26e49be-9b0c-4234-ad02-384ee4ee93d8 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a38b5af1654f44bc6cb5832c2e8e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051b6a3defca48d7b4f8bb6705f89f20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:33:55.467231 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-1ad77619-f316-4322-b79a-5c6196829541 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] 10.222.0.121 "GET /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e" status: 200 len: 1325 microversion: 2.1 time: 0.241316 Aug 04 10:33:55.468265 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 89/192] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:33:55 2022] GET /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e => generated 1325 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:33:55.480043 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-d26e49be-9b0c-4234-ad02-384ee4ee93d8 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] 10.222.0.121 "GET /compute/v2.1/servers/c6dec6e8-e2f9-4c57-8326-19fc989b5c6e" status: 200 len: 1371 microversion: 2.1 time: 0.255810 Aug 04 10:33:55.480337 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 104/193] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:33:55 2022] GET /compute/v2.1/servers/c6dec6e8-e2f9-4c57-8326-19fc989b5c6e => generated 1371 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:33:55.491714 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-1fddfc5a-d533-443f-9eda-0e33d201bc88 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:33:55.492533 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-1fddfc5a-d533-443f-9eda-0e33d201bc88 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] [instance: 81259012-5f3b-44f6-b979-39119f14929b] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:33:55.499721 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-1fddfc5a-d533-443f-9eda-0e33d201bc88 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:55.500237 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-1fddfc5a-d533-443f-9eda-0e33d201bc88 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:55.501021 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-1fddfc5a-d533-443f-9eda-0e33d201bc88 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:55.501455 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-1fddfc5a-d533-443f-9eda-0e33d201bc88 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:55.588524 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-8938b616-3be5-4dbf-adbd-6bf5de0c8fe4 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:33:55.589516 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-8938b616-3be5-4dbf-adbd-6bf5de0c8fe4 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] [instance: cabceac5-859e-4c28-86c2-aa9b63953009] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:33:55.598893 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-8938b616-3be5-4dbf-adbd-6bf5de0c8fe4 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:55.599480 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-8938b616-3be5-4dbf-adbd-6bf5de0c8fe4 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:55.600530 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-8938b616-3be5-4dbf-adbd-6bf5de0c8fe4 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:55.601098 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-8938b616-3be5-4dbf-adbd-6bf5de0c8fe4 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:55.651872 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-1fddfc5a-d533-443f-9eda-0e33d201bc88 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa2e2a5a6ed4c5c9db91269266dd30b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f46ab11dd0b428486c673afc14b5b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:33:55.660348 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-1fddfc5a-d533-443f-9eda-0e33d201bc88 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] 10.222.0.121 "GET /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b" status: 200 len: 1366 microversion: 2.1 time: 0.179559 Aug 04 10:33:55.661253 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 90/194] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:33:55 2022] GET /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b => generated 1366 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:33:55.780978 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-8938b616-3be5-4dbf-adbd-6bf5de0c8fe4 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9520a49687b24281b78f08d43cb27dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c167faad577d47dfaf0d010a3f983fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:33:55.789749 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-8938b616-3be5-4dbf-adbd-6bf5de0c8fe4 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] 10.222.0.121 "GET /compute/v2.1/servers/cabceac5-859e-4c28-86c2-aa9b63953009" status: 200 len: 1318 microversion: 2.1 time: 0.209487 Aug 04 10:33:55.790358 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 105/195] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:33:55 2022] GET /compute/v2.1/servers/cabceac5-859e-4c28-86c2-aa9b63953009 => generated 1318 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 10:33:56.495750 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-b7fa3a91-368f-409b-8129-3328748c9dc4 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:33:56.497110 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-b7fa3a91-368f-409b-8129-3328748c9dc4 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] [instance: 2583b630-2f89-45ba-b781-c0b7c206d61e] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:33:56.501471 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-3438e226-47c7-4a70-a763-dadd5cb49385 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:33:56.502041 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-3438e226-47c7-4a70-a763-dadd5cb49385 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] [instance: c6dec6e8-e2f9-4c57-8326-19fc989b5c6e] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:33:56.504064 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-b7fa3a91-368f-409b-8129-3328748c9dc4 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:56.504712 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-b7fa3a91-368f-409b-8129-3328748c9dc4 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:56.505663 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-b7fa3a91-368f-409b-8129-3328748c9dc4 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:56.506290 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-b7fa3a91-368f-409b-8129-3328748c9dc4 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:56.508737 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-3438e226-47c7-4a70-a763-dadd5cb49385 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:56.509383 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-3438e226-47c7-4a70-a763-dadd5cb49385 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:56.510156 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-3438e226-47c7-4a70-a763-dadd5cb49385 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:56.510608 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-3438e226-47c7-4a70-a763-dadd5cb49385 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:56.741053 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-b7fa3a91-368f-409b-8129-3328748c9dc4 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3170dc3323f54512bc8819c8efa86b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7121bd118a2549c39332cfdb7edaa92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:33:56.744196 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-3438e226-47c7-4a70-a763-dadd5cb49385 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a38b5af1654f44bc6cb5832c2e8e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051b6a3defca48d7b4f8bb6705f89f20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:33:56.749745 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-b7fa3a91-368f-409b-8129-3328748c9dc4 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] 10.222.0.121 "GET /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e" status: 200 len: 1325 microversion: 2.1 time: 0.257936 Aug 04 10:33:56.750428 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 91/196] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:33:56 2022] GET /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e => generated 1325 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:33:56.758683 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-3438e226-47c7-4a70-a763-dadd5cb49385 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] 10.222.0.121 "GET /compute/v2.1/servers/c6dec6e8-e2f9-4c57-8326-19fc989b5c6e" status: 200 len: 1371 microversion: 2.1 time: 0.254862 Aug 04 10:33:56.758683 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 106/197] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:33:56 2022] GET /compute/v2.1/servers/c6dec6e8-e2f9-4c57-8326-19fc989b5c6e => generated 1371 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:33:56.758891 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-e8b68078-a9cb-4e9a-97b8-f9cae7431457 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:33:56.758891 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-e8b68078-a9cb-4e9a-97b8-f9cae7431457 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] [instance: 81259012-5f3b-44f6-b979-39119f14929b] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:33:56.762924 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-e8b68078-a9cb-4e9a-97b8-f9cae7431457 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:56.763474 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-e8b68078-a9cb-4e9a-97b8-f9cae7431457 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:56.764318 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-e8b68078-a9cb-4e9a-97b8-f9cae7431457 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:56.764764 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-e8b68078-a9cb-4e9a-97b8-f9cae7431457 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:56.813577 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-728136ae-25ea-41ff-8f9a-3ac85cce6b31 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:33:56.814393 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-728136ae-25ea-41ff-8f9a-3ac85cce6b31 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] [instance: cabceac5-859e-4c28-86c2-aa9b63953009] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:33:56.821118 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-728136ae-25ea-41ff-8f9a-3ac85cce6b31 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:56.821488 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-728136ae-25ea-41ff-8f9a-3ac85cce6b31 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:56.822269 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-728136ae-25ea-41ff-8f9a-3ac85cce6b31 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:56.822714 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-728136ae-25ea-41ff-8f9a-3ac85cce6b31 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:56.954317 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-e8b68078-a9cb-4e9a-97b8-f9cae7431457 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa2e2a5a6ed4c5c9db91269266dd30b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f46ab11dd0b428486c673afc14b5b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:33:56.962948 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-e8b68078-a9cb-4e9a-97b8-f9cae7431457 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] 10.222.0.121 "GET /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b" status: 200 len: 1366 microversion: 2.1 time: 0.211438 Aug 04 10:33:56.963581 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 92/198] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:33:56 2022] GET /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b => generated 1366 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:33:56.985674 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-728136ae-25ea-41ff-8f9a-3ac85cce6b31 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9520a49687b24281b78f08d43cb27dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c167faad577d47dfaf0d010a3f983fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:33:56.993002 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-728136ae-25ea-41ff-8f9a-3ac85cce6b31 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] 10.222.0.121 "GET /compute/v2.1/servers/cabceac5-859e-4c28-86c2-aa9b63953009" status: 200 len: 1318 microversion: 2.1 time: 0.183909 Aug 04 10:33:56.993604 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 107/199] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:33:56 2022] GET /compute/v2.1/servers/cabceac5-859e-4c28-86c2-aa9b63953009 => generated 1318 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 10:33:57.771674 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-338d4e36-0e1e-4756-bc50-d71ac7ea3aa6 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:33:57.772920 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-338d4e36-0e1e-4756-bc50-d71ac7ea3aa6 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] [instance: 2583b630-2f89-45ba-b781-c0b7c206d61e] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:33:57.773655 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-8c3214f7-5b3d-4cc0-8221-610ea4b81feb tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:33:57.774277 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-8c3214f7-5b3d-4cc0-8221-610ea4b81feb tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] [instance: c6dec6e8-e2f9-4c57-8326-19fc989b5c6e] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:33:57.779667 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-338d4e36-0e1e-4756-bc50-d71ac7ea3aa6 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:57.780151 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-338d4e36-0e1e-4756-bc50-d71ac7ea3aa6 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:57.780691 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-8c3214f7-5b3d-4cc0-8221-610ea4b81feb tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:57.780945 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-338d4e36-0e1e-4756-bc50-d71ac7ea3aa6 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:57.781141 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-8c3214f7-5b3d-4cc0-8221-610ea4b81feb tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:57.781391 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-338d4e36-0e1e-4756-bc50-d71ac7ea3aa6 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:57.782094 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-8c3214f7-5b3d-4cc0-8221-610ea4b81feb tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:57.782542 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-8c3214f7-5b3d-4cc0-8221-610ea4b81feb tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:58.009367 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-8c3214f7-5b3d-4cc0-8221-610ea4b81feb tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a38b5af1654f44bc6cb5832c2e8e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051b6a3defca48d7b4f8bb6705f89f20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:33:58.012311 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-338d4e36-0e1e-4756-bc50-d71ac7ea3aa6 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3170dc3323f54512bc8819c8efa86b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7121bd118a2549c39332cfdb7edaa92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:33:58.018093 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-8c3214f7-5b3d-4cc0-8221-610ea4b81feb tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] 10.222.0.121 "GET /compute/v2.1/servers/c6dec6e8-e2f9-4c57-8326-19fc989b5c6e" status: 200 len: 1371 microversion: 2.1 time: 0.248648 Aug 04 10:33:58.018675 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 108/200] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:33:57 2022] GET /compute/v2.1/servers/c6dec6e8-e2f9-4c57-8326-19fc989b5c6e => generated 1371 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:33:58.021787 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-338d4e36-0e1e-4756-bc50-d71ac7ea3aa6 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] 10.222.0.121 "GET /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e" status: 200 len: 1325 microversion: 2.1 time: 0.254492 Aug 04 10:33:58.022443 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 93/201] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:33:57 2022] GET /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e => generated 1325 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:33:58.024132 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-f5ee1586-88a1-401e-937a-36dc953e3b04 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:33:58.024953 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-f5ee1586-88a1-401e-937a-36dc953e3b04 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] [instance: 81259012-5f3b-44f6-b979-39119f14929b] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:33:58.029123 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-237ba461-6ee1-4fb3-a4ec-a2fb50f5c448 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:33:58.029954 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-237ba461-6ee1-4fb3-a4ec-a2fb50f5c448 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] [instance: cabceac5-859e-4c28-86c2-aa9b63953009] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:33:58.032121 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-f5ee1586-88a1-401e-937a-36dc953e3b04 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:58.032772 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-f5ee1586-88a1-401e-937a-36dc953e3b04 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:58.033761 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-f5ee1586-88a1-401e-937a-36dc953e3b04 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:58.034401 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-f5ee1586-88a1-401e-937a-36dc953e3b04 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:58.037748 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-237ba461-6ee1-4fb3-a4ec-a2fb50f5c448 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:58.038287 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-237ba461-6ee1-4fb3-a4ec-a2fb50f5c448 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:58.039142 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-237ba461-6ee1-4fb3-a4ec-a2fb50f5c448 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:58.039587 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-237ba461-6ee1-4fb3-a4ec-a2fb50f5c448 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:58.259232 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-237ba461-6ee1-4fb3-a4ec-a2fb50f5c448 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9520a49687b24281b78f08d43cb27dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c167faad577d47dfaf0d010a3f983fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:33:58.262139 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-f5ee1586-88a1-401e-937a-36dc953e3b04 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa2e2a5a6ed4c5c9db91269266dd30b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f46ab11dd0b428486c673afc14b5b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:33:58.267360 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-237ba461-6ee1-4fb3-a4ec-a2fb50f5c448 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] 10.222.0.121 "GET /compute/v2.1/servers/cabceac5-859e-4c28-86c2-aa9b63953009" status: 200 len: 1318 microversion: 2.1 time: 0.243685 Aug 04 10:33:58.268072 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 94/202] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:33:58 2022] GET /compute/v2.1/servers/cabceac5-859e-4c28-86c2-aa9b63953009 => generated 1318 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:33:58.270034 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-f5ee1586-88a1-401e-937a-36dc953e3b04 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] 10.222.0.121 "GET /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b" status: 200 len: 1366 microversion: 2.1 time: 0.249629 Aug 04 10:33:58.270605 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 109/203] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:33:58 2022] GET /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b => generated 1366 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:33:59.043439 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-fc6f7cc7-25d0-4027-b641-d266d4084d70 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:33:59.044168 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-fc6f7cc7-25d0-4027-b641-d266d4084d70 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] [instance: 2583b630-2f89-45ba-b781-c0b7c206d61e] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:33:59.044562 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-8c91bb06-9877-4ada-81b6-c851f2247042 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:33:59.045156 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-8c91bb06-9877-4ada-81b6-c851f2247042 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] [instance: c6dec6e8-e2f9-4c57-8326-19fc989b5c6e] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:33:59.051880 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-fc6f7cc7-25d0-4027-b641-d266d4084d70 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:59.052147 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-8c91bb06-9877-4ada-81b6-c851f2247042 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:59.052380 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-fc6f7cc7-25d0-4027-b641-d266d4084d70 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:59.052516 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-8c91bb06-9877-4ada-81b6-c851f2247042 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:59.053333 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-fc6f7cc7-25d0-4027-b641-d266d4084d70 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:59.053548 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-8c91bb06-9877-4ada-81b6-c851f2247042 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:59.053749 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-8c91bb06-9877-4ada-81b6-c851f2247042 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:59.053921 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-fc6f7cc7-25d0-4027-b641-d266d4084d70 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:59.268875 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-fc6f7cc7-25d0-4027-b641-d266d4084d70 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3170dc3323f54512bc8819c8efa86b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7121bd118a2549c39332cfdb7edaa92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:33:59.276946 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-8c91bb06-9877-4ada-81b6-c851f2247042 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a38b5af1654f44bc6cb5832c2e8e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051b6a3defca48d7b4f8bb6705f89f20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:33:59.277445 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-fc6f7cc7-25d0-4027-b641-d266d4084d70 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] 10.222.0.121 "GET /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e" status: 200 len: 1325 microversion: 2.1 time: 0.238126 Aug 04 10:33:59.278057 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 95/204] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:33:59 2022] GET /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e => generated 1325 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:33:59.286353 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-8c91bb06-9877-4ada-81b6-c851f2247042 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] 10.222.0.121 "GET /compute/v2.1/servers/c6dec6e8-e2f9-4c57-8326-19fc989b5c6e" status: 200 len: 1371 microversion: 2.1 time: 0.245591 Aug 04 10:33:59.287060 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 110/205] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:33:59 2022] GET /compute/v2.1/servers/c6dec6e8-e2f9-4c57-8326-19fc989b5c6e => generated 1371 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:33:59.288736 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-e518d837-ca49-4da7-9835-8f7b841da19a tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:33:59.289675 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-e518d837-ca49-4da7-9835-8f7b841da19a tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] [instance: cabceac5-859e-4c28-86c2-aa9b63953009] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:33:59.296484 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-e518d837-ca49-4da7-9835-8f7b841da19a tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:59.297310 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-e518d837-ca49-4da7-9835-8f7b841da19a tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:59.298384 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-e518d837-ca49-4da7-9835-8f7b841da19a tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:59.299078 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-e518d837-ca49-4da7-9835-8f7b841da19a tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:59.300139 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-f51050b7-d84d-45c9-917c-747130cfdfac tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:33:59.300942 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-f51050b7-d84d-45c9-917c-747130cfdfac tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] [instance: 81259012-5f3b-44f6-b979-39119f14929b] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:33:59.308002 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-f51050b7-d84d-45c9-917c-747130cfdfac tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:59.308498 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-f51050b7-d84d-45c9-917c-747130cfdfac tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:59.309307 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-f51050b7-d84d-45c9-917c-747130cfdfac tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:33:59.309755 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-f51050b7-d84d-45c9-917c-747130cfdfac tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:33:59.507616 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-e518d837-ca49-4da7-9835-8f7b841da19a tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9520a49687b24281b78f08d43cb27dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c167faad577d47dfaf0d010a3f983fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:33:59.510850 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-f51050b7-d84d-45c9-917c-747130cfdfac tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa2e2a5a6ed4c5c9db91269266dd30b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f46ab11dd0b428486c673afc14b5b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:33:59.518041 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-e518d837-ca49-4da7-9835-8f7b841da19a tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] 10.222.0.121 "GET /compute/v2.1/servers/cabceac5-859e-4c28-86c2-aa9b63953009" status: 200 len: 1318 microversion: 2.1 time: 0.233329 Aug 04 10:33:59.519048 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 96/206] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:33:59 2022] GET /compute/v2.1/servers/cabceac5-859e-4c28-86c2-aa9b63953009 => generated 1318 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 10:33:59.521315 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-f51050b7-d84d-45c9-917c-747130cfdfac tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] 10.222.0.121 "GET /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b" status: 200 len: 1366 microversion: 2.1 time: 0.225120 Aug 04 10:33:59.522138 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 111/207] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:33:59 2022] GET /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b => generated 1366 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:34:00.299737 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-b9d85829-87b8-4e0b-b2aa-8aa0aafabf7f tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:34:00.300384 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-b9d85829-87b8-4e0b-b2aa-8aa0aafabf7f tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] [instance: 2583b630-2f89-45ba-b781-c0b7c206d61e] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:34:00.307189 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-b9d85829-87b8-4e0b-b2aa-8aa0aafabf7f tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:00.307646 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-b9d85829-87b8-4e0b-b2aa-8aa0aafabf7f tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:00.308477 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-b9d85829-87b8-4e0b-b2aa-8aa0aafabf7f tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:00.308867 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-cd7690d3-d82e-4ca5-af91-b997e710b080 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:34:00.309383 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-b9d85829-87b8-4e0b-b2aa-8aa0aafabf7f tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:00.309482 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-cd7690d3-d82e-4ca5-af91-b997e710b080 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] [instance: c6dec6e8-e2f9-4c57-8326-19fc989b5c6e] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:34:00.316326 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-cd7690d3-d82e-4ca5-af91-b997e710b080 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:00.316783 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-cd7690d3-d82e-4ca5-af91-b997e710b080 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:00.317567 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-cd7690d3-d82e-4ca5-af91-b997e710b080 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:00.318016 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-cd7690d3-d82e-4ca5-af91-b997e710b080 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:00.510349 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-cd7690d3-d82e-4ca5-af91-b997e710b080 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a38b5af1654f44bc6cb5832c2e8e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051b6a3defca48d7b4f8bb6705f89f20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:34:00.517980 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-b9d85829-87b8-4e0b-b2aa-8aa0aafabf7f tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3170dc3323f54512bc8819c8efa86b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7121bd118a2549c39332cfdb7edaa92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:34:00.518506 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-cd7690d3-d82e-4ca5-af91-b997e710b080 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] 10.222.0.121 "GET /compute/v2.1/servers/c6dec6e8-e2f9-4c57-8326-19fc989b5c6e" status: 200 len: 1371 microversion: 2.1 time: 0.213674 Aug 04 10:34:00.519242 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 112/208] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:34:00 2022] GET /compute/v2.1/servers/c6dec6e8-e2f9-4c57-8326-19fc989b5c6e => generated 1371 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:34:00.530562 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-b9d85829-87b8-4e0b-b2aa-8aa0aafabf7f tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] 10.222.0.121 "GET /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e" status: 200 len: 1325 microversion: 2.1 time: 0.234984 Aug 04 10:34:00.531335 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 97/209] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:34:00 2022] GET /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e => generated 1325 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:34:00.544233 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-0845716b-1590-46cc-8ea0-00d95bd3775d tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:34:00.545077 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-0845716b-1590-46cc-8ea0-00d95bd3775d tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] [instance: cabceac5-859e-4c28-86c2-aa9b63953009] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:34:00.547117 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-3f0cfcf1-4e58-4315-98a5-b1cda751cf36 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:34:00.547782 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-3f0cfcf1-4e58-4315-98a5-b1cda751cf36 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] [instance: 81259012-5f3b-44f6-b979-39119f14929b] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:34:00.552789 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-0845716b-1590-46cc-8ea0-00d95bd3775d tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:00.553561 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-0845716b-1590-46cc-8ea0-00d95bd3775d tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:00.554140 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-3f0cfcf1-4e58-4315-98a5-b1cda751cf36 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:00.554625 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-3f0cfcf1-4e58-4315-98a5-b1cda751cf36 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:00.554887 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-0845716b-1590-46cc-8ea0-00d95bd3775d tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:00.555401 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-0845716b-1590-46cc-8ea0-00d95bd3775d tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:00.555524 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-3f0cfcf1-4e58-4315-98a5-b1cda751cf36 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:00.555829 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-3f0cfcf1-4e58-4315-98a5-b1cda751cf36 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:00.913700 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-3f0cfcf1-4e58-4315-98a5-b1cda751cf36 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa2e2a5a6ed4c5c9db91269266dd30b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f46ab11dd0b428486c673afc14b5b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:34:00.917693 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-0845716b-1590-46cc-8ea0-00d95bd3775d tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9520a49687b24281b78f08d43cb27dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c167faad577d47dfaf0d010a3f983fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:34:00.924901 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-3f0cfcf1-4e58-4315-98a5-b1cda751cf36 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] 10.222.0.121 "GET /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b" status: 200 len: 1366 microversion: 2.1 time: 0.382370 Aug 04 10:34:00.933884 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 98/210] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:34:00 2022] GET /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b => generated 1366 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 10:34:00.936716 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-0845716b-1590-46cc-8ea0-00d95bd3775d tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] 10.222.0.121 "GET /compute/v2.1/servers/cabceac5-859e-4c28-86c2-aa9b63953009" status: 200 len: 1318 microversion: 2.1 time: 0.395778 Aug 04 10:34:00.938068 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 113/211] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:34:00 2022] GET /compute/v2.1/servers/cabceac5-859e-4c28-86c2-aa9b63953009 => generated 1318 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:34:01.542619 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-658a9cf4-01c1-4313-bf37-ae1c73e497d9 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:34:01.543560 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-658a9cf4-01c1-4313-bf37-ae1c73e497d9 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] [instance: c6dec6e8-e2f9-4c57-8326-19fc989b5c6e] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:34:01.551268 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-658a9cf4-01c1-4313-bf37-ae1c73e497d9 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:01.551536 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-a8540fef-ccd3-4374-8569-ffe74d3ff96d tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:34:01.552028 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-658a9cf4-01c1-4313-bf37-ae1c73e497d9 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:01.552125 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-a8540fef-ccd3-4374-8569-ffe74d3ff96d tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] [instance: 2583b630-2f89-45ba-b781-c0b7c206d61e] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:34:01.553017 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-658a9cf4-01c1-4313-bf37-ae1c73e497d9 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:01.553629 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-658a9cf4-01c1-4313-bf37-ae1c73e497d9 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:01.558918 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-a8540fef-ccd3-4374-8569-ffe74d3ff96d tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:01.558918 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-a8540fef-ccd3-4374-8569-ffe74d3ff96d tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:01.559729 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-a8540fef-ccd3-4374-8569-ffe74d3ff96d tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:01.560222 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-a8540fef-ccd3-4374-8569-ffe74d3ff96d tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:01.956744 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-a8540fef-ccd3-4374-8569-ffe74d3ff96d tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3170dc3323f54512bc8819c8efa86b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7121bd118a2549c39332cfdb7edaa92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:34:01.959398 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-658a9cf4-01c1-4313-bf37-ae1c73e497d9 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a38b5af1654f44bc6cb5832c2e8e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051b6a3defca48d7b4f8bb6705f89f20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:34:01.967109 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-a8540fef-ccd3-4374-8569-ffe74d3ff96d tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] 10.222.0.121 "GET /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e" status: 200 len: 1325 microversion: 2.1 time: 0.419544 Aug 04 10:34:01.971847 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-658a9cf4-01c1-4313-bf37-ae1c73e497d9 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] 10.222.0.121 "GET /compute/v2.1/servers/c6dec6e8-e2f9-4c57-8326-19fc989b5c6e" status: 200 len: 1371 microversion: 2.1 time: 0.434166 Aug 04 10:34:01.984288 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 99/212] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:34:01 2022] GET /compute/v2.1/servers/c6dec6e8-e2f9-4c57-8326-19fc989b5c6e => generated 1371 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:34:01.984440 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 114/213] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:34:01 2022] GET /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e => generated 1325 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:34:01.984584 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-b0b36fec-9620-4e60-af74-732eddaa2d94 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:34:01.984584 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-b0b36fec-9620-4e60-af74-732eddaa2d94 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] [instance: 81259012-5f3b-44f6-b979-39119f14929b] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:34:01.985757 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-9b884b56-8248-4b1f-bc42-f4d632b52afa tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:34:01.986540 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-9b884b56-8248-4b1f-bc42-f4d632b52afa tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] [instance: cabceac5-859e-4c28-86c2-aa9b63953009] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:34:01.990701 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-b0b36fec-9620-4e60-af74-732eddaa2d94 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:01.991327 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-b0b36fec-9620-4e60-af74-732eddaa2d94 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:01.992337 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-b0b36fec-9620-4e60-af74-732eddaa2d94 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:01.992848 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-b0b36fec-9620-4e60-af74-732eddaa2d94 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:01.994061 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-9b884b56-8248-4b1f-bc42-f4d632b52afa tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:01.994625 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-9b884b56-8248-4b1f-bc42-f4d632b52afa tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:01.995300 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-9b884b56-8248-4b1f-bc42-f4d632b52afa tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:01.995740 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-9b884b56-8248-4b1f-bc42-f4d632b52afa tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:02.187754 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-9b884b56-8248-4b1f-bc42-f4d632b52afa tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9520a49687b24281b78f08d43cb27dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c167faad577d47dfaf0d010a3f983fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:34:02.191907 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-b0b36fec-9620-4e60-af74-732eddaa2d94 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa2e2a5a6ed4c5c9db91269266dd30b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f46ab11dd0b428486c673afc14b5b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:34:02.198613 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-9b884b56-8248-4b1f-bc42-f4d632b52afa tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] 10.222.0.121 "GET /compute/v2.1/servers/cabceac5-859e-4c28-86c2-aa9b63953009" status: 200 len: 1318 microversion: 2.1 time: 0.218134 Aug 04 10:34:02.199197 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 115/214] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:34:01 2022] GET /compute/v2.1/servers/cabceac5-859e-4c28-86c2-aa9b63953009 => generated 1318 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:34:02.201462 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-b0b36fec-9620-4e60-af74-732eddaa2d94 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] 10.222.0.121 "GET /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b" status: 200 len: 1366 microversion: 2.1 time: 0.227641 Aug 04 10:34:02.202202 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 100/215] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:34:01 2022] GET /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b => generated 1366 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:34:02.991395 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-7f14be9f-3aae-4537-8112-86793a28c31c tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:34:02.992199 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-7f14be9f-3aae-4537-8112-86793a28c31c tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] [instance: 2583b630-2f89-45ba-b781-c0b7c206d61e] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:34:02.998216 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-7a1ebdef-b6e7-4426-89b8-4465a7823946 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:34:02.998837 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-7a1ebdef-b6e7-4426-89b8-4465a7823946 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] [instance: c6dec6e8-e2f9-4c57-8326-19fc989b5c6e] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:34:02.999022 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-7f14be9f-3aae-4537-8112-86793a28c31c tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:02.999498 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-7f14be9f-3aae-4537-8112-86793a28c31c tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:03.000360 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-7f14be9f-3aae-4537-8112-86793a28c31c tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:03.000806 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-7f14be9f-3aae-4537-8112-86793a28c31c tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:03.005224 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-7a1ebdef-b6e7-4426-89b8-4465a7823946 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:03.005684 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-7a1ebdef-b6e7-4426-89b8-4465a7823946 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:03.006463 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-7a1ebdef-b6e7-4426-89b8-4465a7823946 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:03.006897 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-7a1ebdef-b6e7-4426-89b8-4465a7823946 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:03.026684 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG dbcounter [-] [124456] Writing DB stats nova_cell1:SELECT=100 {{(pid=124456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:34:03.216192 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-7f14be9f-3aae-4537-8112-86793a28c31c tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3170dc3323f54512bc8819c8efa86b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7121bd118a2549c39332cfdb7edaa92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:34:03.220806 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-7a1ebdef-b6e7-4426-89b8-4465a7823946 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a38b5af1654f44bc6cb5832c2e8e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051b6a3defca48d7b4f8bb6705f89f20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:34:03.224515 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-7f14be9f-3aae-4537-8112-86793a28c31c tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] 10.222.0.121 "GET /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e" status: 200 len: 1325 microversion: 2.1 time: 0.237340 Aug 04 10:34:03.225119 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 116/216] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:34:02 2022] GET /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e => generated 1325 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:34:03.229005 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-7a1ebdef-b6e7-4426-89b8-4465a7823946 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] 10.222.0.121 "GET /compute/v2.1/servers/c6dec6e8-e2f9-4c57-8326-19fc989b5c6e" status: 200 len: 1371 microversion: 2.1 time: 0.235053 Aug 04 10:34:03.229579 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 101/217] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:34:02 2022] GET /compute/v2.1/servers/c6dec6e8-e2f9-4c57-8326-19fc989b5c6e => generated 1371 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:34:03.230230 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-34e13ebd-a691-401e-8990-093440b0f666 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:34:03.231047 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-34e13ebd-a691-401e-8990-093440b0f666 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] [instance: cabceac5-859e-4c28-86c2-aa9b63953009] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:34:03.234680 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-dcad2f78-d0ae-4edd-a2e7-4a7e68b1259a tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:34:03.235304 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-dcad2f78-d0ae-4edd-a2e7-4a7e68b1259a tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] [instance: 81259012-5f3b-44f6-b979-39119f14929b] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:34:03.238046 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-34e13ebd-a691-401e-8990-093440b0f666 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:03.238751 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-34e13ebd-a691-401e-8990-093440b0f666 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:03.239819 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-34e13ebd-a691-401e-8990-093440b0f666 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:03.240657 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-34e13ebd-a691-401e-8990-093440b0f666 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:03.241590 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-dcad2f78-d0ae-4edd-a2e7-4a7e68b1259a tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:03.241979 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-dcad2f78-d0ae-4edd-a2e7-4a7e68b1259a tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:03.242756 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-dcad2f78-d0ae-4edd-a2e7-4a7e68b1259a tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:03.243204 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-dcad2f78-d0ae-4edd-a2e7-4a7e68b1259a tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:03.259335 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG dbcounter [-] [124457] Writing DB stats nova_cell1:SELECT=100 {{(pid=124457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:34:03.440384 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-34e13ebd-a691-401e-8990-093440b0f666 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9520a49687b24281b78f08d43cb27dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c167faad577d47dfaf0d010a3f983fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:34:03.443571 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-dcad2f78-d0ae-4edd-a2e7-4a7e68b1259a tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa2e2a5a6ed4c5c9db91269266dd30b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f46ab11dd0b428486c673afc14b5b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:34:03.449131 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-34e13ebd-a691-401e-8990-093440b0f666 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] 10.222.0.121 "GET /compute/v2.1/servers/cabceac5-859e-4c28-86c2-aa9b63953009" status: 200 len: 1318 microversion: 2.1 time: 0.222800 Aug 04 10:34:03.449872 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 117/218] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:34:03 2022] GET /compute/v2.1/servers/cabceac5-859e-4c28-86c2-aa9b63953009 => generated 1318 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:34:03.452205 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-dcad2f78-d0ae-4edd-a2e7-4a7e68b1259a tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] 10.222.0.121 "GET /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b" status: 200 len: 1366 microversion: 2.1 time: 0.221216 Aug 04 10:34:03.452937 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 102/219] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:34:03 2022] GET /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b => generated 1366 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:34:04.246570 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-7e51320f-b0d1-43fa-9e9a-bb69329fd76c tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:34:04.247318 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-7e51320f-b0d1-43fa-9e9a-bb69329fd76c tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] [instance: 2583b630-2f89-45ba-b781-c0b7c206d61e] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:34:04.250449 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-d119d2a2-d52e-4caf-939e-f97f7eecf130 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:34:04.251105 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-d119d2a2-d52e-4caf-939e-f97f7eecf130 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] [instance: c6dec6e8-e2f9-4c57-8326-19fc989b5c6e] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:34:04.255486 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-7e51320f-b0d1-43fa-9e9a-bb69329fd76c tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:04.256332 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-7e51320f-b0d1-43fa-9e9a-bb69329fd76c tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:04.257144 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-7e51320f-b0d1-43fa-9e9a-bb69329fd76c tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:04.257582 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-7e51320f-b0d1-43fa-9e9a-bb69329fd76c tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:04.257950 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-d119d2a2-d52e-4caf-939e-f97f7eecf130 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:04.258413 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-d119d2a2-d52e-4caf-939e-f97f7eecf130 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:04.259195 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-d119d2a2-d52e-4caf-939e-f97f7eecf130 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:04.259642 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-d119d2a2-d52e-4caf-939e-f97f7eecf130 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:04.470042 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-7e51320f-b0d1-43fa-9e9a-bb69329fd76c tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3170dc3323f54512bc8819c8efa86b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7121bd118a2549c39332cfdb7edaa92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:34:04.473116 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-d119d2a2-d52e-4caf-939e-f97f7eecf130 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a38b5af1654f44bc6cb5832c2e8e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051b6a3defca48d7b4f8bb6705f89f20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:34:04.478967 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-7e51320f-b0d1-43fa-9e9a-bb69329fd76c tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] 10.222.0.121 "GET /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e" status: 200 len: 1325 microversion: 2.1 time: 0.236474 Aug 04 10:34:04.479648 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 118/220] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:34:04 2022] GET /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e => generated 1325 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:34:04.481321 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-d119d2a2-d52e-4caf-939e-f97f7eecf130 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] 10.222.0.121 "GET /compute/v2.1/servers/c6dec6e8-e2f9-4c57-8326-19fc989b5c6e" status: 200 len: 1371 microversion: 2.1 time: 0.234925 Aug 04 10:34:04.482100 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 103/221] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:34:04 2022] GET /compute/v2.1/servers/c6dec6e8-e2f9-4c57-8326-19fc989b5c6e => generated 1371 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:34:04.484519 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-18207aa3-7d40-4b69-b2a6-00b03dc3bf18 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:34:04.485408 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-18207aa3-7d40-4b69-b2a6-00b03dc3bf18 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] [instance: cabceac5-859e-4c28-86c2-aa9b63953009] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:34:04.487643 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-feb56617-ec20-45a8-a7a5-89cc50996eef tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:34:04.488370 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-feb56617-ec20-45a8-a7a5-89cc50996eef tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] [instance: 81259012-5f3b-44f6-b979-39119f14929b] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:34:04.492587 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-18207aa3-7d40-4b69-b2a6-00b03dc3bf18 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:04.493288 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-18207aa3-7d40-4b69-b2a6-00b03dc3bf18 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:04.494321 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-18207aa3-7d40-4b69-b2a6-00b03dc3bf18 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:04.494765 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-feb56617-ec20-45a8-a7a5-89cc50996eef tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:04.494873 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-18207aa3-7d40-4b69-b2a6-00b03dc3bf18 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:04.495356 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-feb56617-ec20-45a8-a7a5-89cc50996eef tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:04.496233 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-feb56617-ec20-45a8-a7a5-89cc50996eef tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:04.496743 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-feb56617-ec20-45a8-a7a5-89cc50996eef tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:04.716221 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-feb56617-ec20-45a8-a7a5-89cc50996eef tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa2e2a5a6ed4c5c9db91269266dd30b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f46ab11dd0b428486c673afc14b5b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:34:04.718161 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-18207aa3-7d40-4b69-b2a6-00b03dc3bf18 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9520a49687b24281b78f08d43cb27dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c167faad577d47dfaf0d010a3f983fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:34:04.729311 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-18207aa3-7d40-4b69-b2a6-00b03dc3bf18 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] 10.222.0.121 "GET /compute/v2.1/servers/cabceac5-859e-4c28-86c2-aa9b63953009" status: 200 len: 1318 microversion: 2.1 time: 0.248375 Aug 04 10:34:04.729739 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-feb56617-ec20-45a8-a7a5-89cc50996eef tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] 10.222.0.121 "GET /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b" status: 200 len: 1366 microversion: 2.1 time: 0.246276 Aug 04 10:34:04.732851 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 119/222] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:34:04 2022] GET /compute/v2.1/servers/cabceac5-859e-4c28-86c2-aa9b63953009 => generated 1318 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:34:04.733095 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 104/223] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:34:04 2022] GET /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b => generated 1366 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:34:05.502545 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-47ca74a3-b25d-47ed-a721-9af2f41b72e4 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:34:05.503862 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-47ca74a3-b25d-47ed-a721-9af2f41b72e4 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] [instance: 2583b630-2f89-45ba-b781-c0b7c206d61e] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:34:05.506314 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-cf8a4bab-45aa-4485-bfc6-9b4c5e16d98a tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:34:05.508036 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-cf8a4bab-45aa-4485-bfc6-9b4c5e16d98a tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] [instance: c6dec6e8-e2f9-4c57-8326-19fc989b5c6e] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:34:05.511438 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-47ca74a3-b25d-47ed-a721-9af2f41b72e4 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:05.512141 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-47ca74a3-b25d-47ed-a721-9af2f41b72e4 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:05.513113 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-47ca74a3-b25d-47ed-a721-9af2f41b72e4 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:05.515337 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-47ca74a3-b25d-47ed-a721-9af2f41b72e4 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:05.515703 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-cf8a4bab-45aa-4485-bfc6-9b4c5e16d98a tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:05.516467 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-cf8a4bab-45aa-4485-bfc6-9b4c5e16d98a tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:05.517638 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-cf8a4bab-45aa-4485-bfc6-9b4c5e16d98a tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:05.518602 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-cf8a4bab-45aa-4485-bfc6-9b4c5e16d98a tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:05.908048 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-cf8a4bab-45aa-4485-bfc6-9b4c5e16d98a tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a38b5af1654f44bc6cb5832c2e8e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051b6a3defca48d7b4f8bb6705f89f20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:34:05.916829 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-cf8a4bab-45aa-4485-bfc6-9b4c5e16d98a tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] 10.222.0.121 "GET /compute/v2.1/servers/c6dec6e8-e2f9-4c57-8326-19fc989b5c6e" status: 200 len: 1371 microversion: 2.1 time: 0.416360 Aug 04 10:34:05.917607 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 105/224] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:34:05 2022] GET /compute/v2.1/servers/c6dec6e8-e2f9-4c57-8326-19fc989b5c6e => generated 1371 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:34:05.917933 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-47ca74a3-b25d-47ed-a721-9af2f41b72e4 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3170dc3323f54512bc8819c8efa86b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7121bd118a2549c39332cfdb7edaa92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:34:05.922815 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-0b4c95ef-c5bb-4b65-a05c-4cd069f477ff tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:34:05.923476 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-0b4c95ef-c5bb-4b65-a05c-4cd069f477ff tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] [instance: cabceac5-859e-4c28-86c2-aa9b63953009] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:34:05.926211 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-47ca74a3-b25d-47ed-a721-9af2f41b72e4 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] 10.222.0.121 "GET /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e" status: 200 len: 1325 microversion: 2.1 time: 0.427846 Aug 04 10:34:05.927093 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 120/225] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:34:05 2022] GET /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e => generated 1325 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:34:05.930577 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-0b4c95ef-c5bb-4b65-a05c-4cd069f477ff tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:05.931265 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-0b4c95ef-c5bb-4b65-a05c-4cd069f477ff tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:05.932255 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-0b4c95ef-c5bb-4b65-a05c-4cd069f477ff tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:05.932865 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-0b4c95ef-c5bb-4b65-a05c-4cd069f477ff tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:05.933754 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-c3ce94e3-5509-4121-ac48-7f5413f95bcf tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:34:05.934513 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-c3ce94e3-5509-4121-ac48-7f5413f95bcf tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] [instance: 81259012-5f3b-44f6-b979-39119f14929b] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:34:05.941467 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-c3ce94e3-5509-4121-ac48-7f5413f95bcf tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:05.942020 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-c3ce94e3-5509-4121-ac48-7f5413f95bcf tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:05.942897 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-c3ce94e3-5509-4121-ac48-7f5413f95bcf tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:05.943442 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-c3ce94e3-5509-4121-ac48-7f5413f95bcf tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:06.140203 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-0b4c95ef-c5bb-4b65-a05c-4cd069f477ff tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9520a49687b24281b78f08d43cb27dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c167faad577d47dfaf0d010a3f983fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:34:06.143480 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-c3ce94e3-5509-4121-ac48-7f5413f95bcf tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa2e2a5a6ed4c5c9db91269266dd30b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f46ab11dd0b428486c673afc14b5b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:34:06.148701 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-0b4c95ef-c5bb-4b65-a05c-4cd069f477ff tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] 10.222.0.121 "GET /compute/v2.1/servers/cabceac5-859e-4c28-86c2-aa9b63953009" status: 200 len: 1318 microversion: 2.1 time: 0.229770 Aug 04 10:34:06.149536 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 106/226] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:34:05 2022] GET /compute/v2.1/servers/cabceac5-859e-4c28-86c2-aa9b63953009 => generated 1318 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:34:06.151433 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-c3ce94e3-5509-4121-ac48-7f5413f95bcf tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] 10.222.0.121 "GET /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b" status: 200 len: 1366 microversion: 2.1 time: 0.223053 Aug 04 10:34:06.152019 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 121/227] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:34:05 2022] GET /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b => generated 1366 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:34:06.940889 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-9fc9fd59-3939-45b8-b17a-6e106eec0be2 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:34:06.942414 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-9fc9fd59-3939-45b8-b17a-6e106eec0be2 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] [instance: c6dec6e8-e2f9-4c57-8326-19fc989b5c6e] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:34:06.947453 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-6ae8191d-944e-4d38-a892-fbec0b8a64b3 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:34:06.948202 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-6ae8191d-944e-4d38-a892-fbec0b8a64b3 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] [instance: 2583b630-2f89-45ba-b781-c0b7c206d61e] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:34:06.949097 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-9fc9fd59-3939-45b8-b17a-6e106eec0be2 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:06.949547 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-9fc9fd59-3939-45b8-b17a-6e106eec0be2 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:06.950319 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-9fc9fd59-3939-45b8-b17a-6e106eec0be2 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:06.950753 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-9fc9fd59-3939-45b8-b17a-6e106eec0be2 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:06.955037 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-6ae8191d-944e-4d38-a892-fbec0b8a64b3 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:06.955572 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-6ae8191d-944e-4d38-a892-fbec0b8a64b3 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:06.956483 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-6ae8191d-944e-4d38-a892-fbec0b8a64b3 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:06.956978 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-6ae8191d-944e-4d38-a892-fbec0b8a64b3 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:07.154285 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-9fc9fd59-3939-45b8-b17a-6e106eec0be2 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a38b5af1654f44bc6cb5832c2e8e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051b6a3defca48d7b4f8bb6705f89f20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:34:07.156747 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-6ae8191d-944e-4d38-a892-fbec0b8a64b3 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3170dc3323f54512bc8819c8efa86b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7121bd118a2549c39332cfdb7edaa92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:34:07.164922 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-9fc9fd59-3939-45b8-b17a-6e106eec0be2 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] 10.222.0.121 "GET /compute/v2.1/servers/c6dec6e8-e2f9-4c57-8326-19fc989b5c6e" status: 200 len: 1371 microversion: 2.1 time: 0.227232 Aug 04 10:34:07.169569 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-6ae8191d-944e-4d38-a892-fbec0b8a64b3 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] 10.222.0.121 "GET /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e" status: 200 len: 1325 microversion: 2.1 time: 0.225432 Aug 04 10:34:07.170154 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 122/228] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:34:06 2022] GET /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e => generated 1325 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:34:07.175564 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-9c05dee1-c59a-4bfb-8dfc-c1cccf60850e tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:34:07.176219 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-9c05dee1-c59a-4bfb-8dfc-c1cccf60850e tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] [instance: cabceac5-859e-4c28-86c2-aa9b63953009] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:34:07.178514 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 107/229] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:34:06 2022] GET /compute/v2.1/servers/c6dec6e8-e2f9-4c57-8326-19fc989b5c6e => generated 1371 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:34:07.188016 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-9c05dee1-c59a-4bfb-8dfc-c1cccf60850e tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:07.188016 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-9c05dee1-c59a-4bfb-8dfc-c1cccf60850e tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:07.188016 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-9c05dee1-c59a-4bfb-8dfc-c1cccf60850e tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:07.188016 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-9c05dee1-c59a-4bfb-8dfc-c1cccf60850e tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:07.213487 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-30770e16-2683-4069-85e5-a9d11ae6fec9 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:34:07.217721 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-30770e16-2683-4069-85e5-a9d11ae6fec9 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] [instance: 81259012-5f3b-44f6-b979-39119f14929b] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:34:07.238810 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-30770e16-2683-4069-85e5-a9d11ae6fec9 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:07.239257 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-30770e16-2683-4069-85e5-a9d11ae6fec9 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:07.246520 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-30770e16-2683-4069-85e5-a9d11ae6fec9 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:07.246520 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-30770e16-2683-4069-85e5-a9d11ae6fec9 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:07.588441 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-9c05dee1-c59a-4bfb-8dfc-c1cccf60850e tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9520a49687b24281b78f08d43cb27dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c167faad577d47dfaf0d010a3f983fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:34:07.607013 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-9c05dee1-c59a-4bfb-8dfc-c1cccf60850e tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] 10.222.0.121 "GET /compute/v2.1/servers/cabceac5-859e-4c28-86c2-aa9b63953009" status: 200 len: 1318 microversion: 2.1 time: 0.432051 Aug 04 10:34:07.607987 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 123/230] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:34:07 2022] GET /compute/v2.1/servers/cabceac5-859e-4c28-86c2-aa9b63953009 => generated 1318 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:34:07.616861 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-30770e16-2683-4069-85e5-a9d11ae6fec9 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa2e2a5a6ed4c5c9db91269266dd30b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f46ab11dd0b428486c673afc14b5b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:34:07.630271 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-30770e16-2683-4069-85e5-a9d11ae6fec9 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] 10.222.0.121 "GET /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b" status: 200 len: 1366 microversion: 2.1 time: 0.450311 Aug 04 10:34:07.631751 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 108/231] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:34:07 2022] GET /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b => generated 1366 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:34:07.789055 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [req-2ac9794f-78e7-40c1-ba0e-b92c0e70e73f req-f17d7525-ccce-4332-be9c-4d31607f628d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6dec6e8-e2f9-4c57-8326-19fc989b5c6e", "name": "network-vif-plugged", "status": "completed", "tag": "03bbc55a-5c71-4f8b-8a66-c3b18135d94a"}]} {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:34:07.801080 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [req-2ac9794f-78e7-40c1-ba0e-b92c0e70e73f req-f17d7525-ccce-4332-be9c-4d31607f628d service nova] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:07.801857 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [req-2ac9794f-78e7-40c1-ba0e-b92c0e70e73f req-f17d7525-ccce-4332-be9c-4d31607f628d service nova] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:07.813787 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.compute.server_external_events [req-2ac9794f-78e7-40c1-ba0e-b92c0e70e73f req-f17d7525-ccce-4332-be9c-4d31607f628d service nova] Creating event network-vif-plugged:03bbc55a-5c71-4f8b-8a66-c3b18135d94a for instance c6dec6e8-e2f9-4c57-8326-19fc989b5c6e on hv-cinder-85200 Aug 04 10:34:07.819225 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [req-2ac9794f-78e7-40c1-ba0e-b92c0e70e73f req-f17d7525-ccce-4332-be9c-4d31607f628d service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035094 Aug 04 10:34:07.820052 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 124/232] 10.222.0.121 () {64 vars in 1322 bytes} [Thu Aug 4 10:34:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:34:08.185790 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-2069df4f-1a05-49e0-9bec-d3cd1ffec47a tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:34:08.188170 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-2069df4f-1a05-49e0-9bec-d3cd1ffec47a tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] [instance: c6dec6e8-e2f9-4c57-8326-19fc989b5c6e] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:34:08.200322 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-2069df4f-1a05-49e0-9bec-d3cd1ffec47a tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:08.200322 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-2069df4f-1a05-49e0-9bec-d3cd1ffec47a tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:08.200322 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-2069df4f-1a05-49e0-9bec-d3cd1ffec47a tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:08.200608 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-65137c68-2a2c-432c-a80e-d8b0f193b351 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:34:08.201059 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-2069df4f-1a05-49e0-9bec-d3cd1ffec47a tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:08.201145 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-65137c68-2a2c-432c-a80e-d8b0f193b351 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] [instance: 2583b630-2f89-45ba-b781-c0b7c206d61e] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:34:08.203222 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-65137c68-2a2c-432c-a80e-d8b0f193b351 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:08.203879 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-65137c68-2a2c-432c-a80e-d8b0f193b351 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:08.204756 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-65137c68-2a2c-432c-a80e-d8b0f193b351 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:08.205202 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-65137c68-2a2c-432c-a80e-d8b0f193b351 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:08.411818 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-2069df4f-1a05-49e0-9bec-d3cd1ffec47a tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a38b5af1654f44bc6cb5832c2e8e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051b6a3defca48d7b4f8bb6705f89f20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:34:08.425397 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-2069df4f-1a05-49e0-9bec-d3cd1ffec47a tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] 10.222.0.121 "GET /compute/v2.1/servers/c6dec6e8-e2f9-4c57-8326-19fc989b5c6e" status: 200 len: 1371 microversion: 2.1 time: 0.243467 Aug 04 10:34:08.431234 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 109/233] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:34:08 2022] GET /compute/v2.1/servers/c6dec6e8-e2f9-4c57-8326-19fc989b5c6e => generated 1371 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:34:08.432566 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-65137c68-2a2c-432c-a80e-d8b0f193b351 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3170dc3323f54512bc8819c8efa86b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7121bd118a2549c39332cfdb7edaa92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:34:08.442451 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-65137c68-2a2c-432c-a80e-d8b0f193b351 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] 10.222.0.121 "GET /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e" status: 200 len: 1325 microversion: 2.1 time: 0.252615 Aug 04 10:34:08.443252 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 125/234] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:34:08 2022] GET /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e => generated 1325 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:34:08.628869 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-70d5cda5-708e-4870-8eb0-de22f304ce1c tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:34:08.629648 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-70d5cda5-708e-4870-8eb0-de22f304ce1c tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] [instance: cabceac5-859e-4c28-86c2-aa9b63953009] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:34:08.636732 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-70d5cda5-708e-4870-8eb0-de22f304ce1c tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:08.637378 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-70d5cda5-708e-4870-8eb0-de22f304ce1c tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:08.638220 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-70d5cda5-708e-4870-8eb0-de22f304ce1c tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:08.638735 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-70d5cda5-708e-4870-8eb0-de22f304ce1c tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:08.664094 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-25b434fc-20c3-41d8-83c8-d5abdd0034f8 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:34:08.664094 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-25b434fc-20c3-41d8-83c8-d5abdd0034f8 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] [instance: 81259012-5f3b-44f6-b979-39119f14929b] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:34:08.667046 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-25b434fc-20c3-41d8-83c8-d5abdd0034f8 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:08.667845 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-25b434fc-20c3-41d8-83c8-d5abdd0034f8 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:08.668890 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-25b434fc-20c3-41d8-83c8-d5abdd0034f8 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:08.669276 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-25b434fc-20c3-41d8-83c8-d5abdd0034f8 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:08.875684 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-70d5cda5-708e-4870-8eb0-de22f304ce1c tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9520a49687b24281b78f08d43cb27dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c167faad577d47dfaf0d010a3f983fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:34:08.883843 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-70d5cda5-708e-4870-8eb0-de22f304ce1c tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] 10.222.0.121 "GET /compute/v2.1/servers/cabceac5-859e-4c28-86c2-aa9b63953009" status: 200 len: 1318 microversion: 2.1 time: 0.259749 Aug 04 10:34:08.884589 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 110/235] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:34:08 2022] GET /compute/v2.1/servers/cabceac5-859e-4c28-86c2-aa9b63953009 => generated 1318 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:34:08.901645 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-25b434fc-20c3-41d8-83c8-d5abdd0034f8 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa2e2a5a6ed4c5c9db91269266dd30b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f46ab11dd0b428486c673afc14b5b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:34:08.910154 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-25b434fc-20c3-41d8-83c8-d5abdd0034f8 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] 10.222.0.121 "GET /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b" status: 200 len: 1366 microversion: 2.1 time: 0.260892 Aug 04 10:34:08.910902 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 126/236] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:34:08 2022] GET /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b => generated 1366 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 10:34:09.450106 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-9d1eda83-6e57-42a1-b0ca-d68d44a61fb5 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:34:09.451153 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-9d1eda83-6e57-42a1-b0ca-d68d44a61fb5 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] [instance: c6dec6e8-e2f9-4c57-8326-19fc989b5c6e] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:34:09.461398 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-9d1eda83-6e57-42a1-b0ca-d68d44a61fb5 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:09.462150 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-9d1eda83-6e57-42a1-b0ca-d68d44a61fb5 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:09.463418 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-9d1eda83-6e57-42a1-b0ca-d68d44a61fb5 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:09.464187 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-9d1eda83-6e57-42a1-b0ca-d68d44a61fb5 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:09.466279 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-ad42b1cd-434c-40af-b38c-10cca462e30c tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:34:09.467179 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-ad42b1cd-434c-40af-b38c-10cca462e30c tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] [instance: 2583b630-2f89-45ba-b781-c0b7c206d61e] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:34:09.475894 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-ad42b1cd-434c-40af-b38c-10cca462e30c tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:09.476532 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-ad42b1cd-434c-40af-b38c-10cca462e30c tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:09.477792 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-ad42b1cd-434c-40af-b38c-10cca462e30c tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:09.478485 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-ad42b1cd-434c-40af-b38c-10cca462e30c tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:09.697712 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-ad42b1cd-434c-40af-b38c-10cca462e30c tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3170dc3323f54512bc8819c8efa86b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7121bd118a2549c39332cfdb7edaa92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:34:09.701282 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-9d1eda83-6e57-42a1-b0ca-d68d44a61fb5 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a38b5af1654f44bc6cb5832c2e8e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051b6a3defca48d7b4f8bb6705f89f20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:34:09.706435 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-ad42b1cd-434c-40af-b38c-10cca462e30c tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] 10.222.0.121 "GET /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e" status: 200 len: 1325 microversion: 2.1 time: 0.245018 Aug 04 10:34:09.707312 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 127/237] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:34:09 2022] GET /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e => generated 1325 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:34:09.720215 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-9d1eda83-6e57-42a1-b0ca-d68d44a61fb5 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] 10.222.0.121 "GET /compute/v2.1/servers/c6dec6e8-e2f9-4c57-8326-19fc989b5c6e" status: 200 len: 1371 microversion: 2.1 time: 0.267274 Aug 04 10:34:09.720215 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 111/238] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:34:09 2022] GET /compute/v2.1/servers/c6dec6e8-e2f9-4c57-8326-19fc989b5c6e => generated 1371 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:34:09.905253 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-aca688d7-12c1-4b1b-bdf6-72021635c6eb tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:34:09.905872 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-aca688d7-12c1-4b1b-bdf6-72021635c6eb tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] [instance: cabceac5-859e-4c28-86c2-aa9b63953009] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:34:09.912892 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-aca688d7-12c1-4b1b-bdf6-72021635c6eb tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:09.913083 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-aca688d7-12c1-4b1b-bdf6-72021635c6eb tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:09.913849 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-aca688d7-12c1-4b1b-bdf6-72021635c6eb tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:09.914294 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-aca688d7-12c1-4b1b-bdf6-72021635c6eb tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:09.931933 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-febd2813-e580-456c-b911-0705a0f789c2 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:34:09.932807 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-febd2813-e580-456c-b911-0705a0f789c2 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] [instance: 81259012-5f3b-44f6-b979-39119f14929b] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:34:09.941288 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-febd2813-e580-456c-b911-0705a0f789c2 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:09.942097 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-febd2813-e580-456c-b911-0705a0f789c2 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:09.943052 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-febd2813-e580-456c-b911-0705a0f789c2 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:09.943691 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-febd2813-e580-456c-b911-0705a0f789c2 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:10.127500 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-aca688d7-12c1-4b1b-bdf6-72021635c6eb tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9520a49687b24281b78f08d43cb27dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c167faad577d47dfaf0d010a3f983fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:34:10.135512 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-febd2813-e580-456c-b911-0705a0f789c2 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa2e2a5a6ed4c5c9db91269266dd30b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f46ab11dd0b428486c673afc14b5b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:34:10.136025 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-aca688d7-12c1-4b1b-bdf6-72021635c6eb tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] 10.222.0.121 "GET /compute/v2.1/servers/cabceac5-859e-4c28-86c2-aa9b63953009" status: 200 len: 1318 microversion: 2.1 time: 0.234915 Aug 04 10:34:10.136638 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 112/239] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:34:09 2022] GET /compute/v2.1/servers/cabceac5-859e-4c28-86c2-aa9b63953009 => generated 1318 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:34:10.143636 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-febd2813-e580-456c-b911-0705a0f789c2 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] 10.222.0.121 "GET /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b" status: 200 len: 1366 microversion: 2.1 time: 0.216588 Aug 04 10:34:10.144256 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 128/240] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:34:09 2022] GET /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b => generated 1366 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:34:10.734309 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-084530f5-59b9-493a-8f3f-b3059ce682cd tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:34:10.736565 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-508013da-8560-4dc3-b73a-86d9d2a636e7 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:34:10.737239 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-508013da-8560-4dc3-b73a-86d9d2a636e7 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] [instance: 2583b630-2f89-45ba-b781-c0b7c206d61e] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:34:10.740884 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-084530f5-59b9-493a-8f3f-b3059ce682cd tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] [instance: c6dec6e8-e2f9-4c57-8326-19fc989b5c6e] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:34:10.751032 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-508013da-8560-4dc3-b73a-86d9d2a636e7 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:10.751431 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-508013da-8560-4dc3-b73a-86d9d2a636e7 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:10.752646 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-508013da-8560-4dc3-b73a-86d9d2a636e7 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:10.753471 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-084530f5-59b9-493a-8f3f-b3059ce682cd tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:10.753717 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-508013da-8560-4dc3-b73a-86d9d2a636e7 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:10.753936 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-084530f5-59b9-493a-8f3f-b3059ce682cd tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:10.754743 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-084530f5-59b9-493a-8f3f-b3059ce682cd tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:10.755192 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-084530f5-59b9-493a-8f3f-b3059ce682cd tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:11.026792 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-508013da-8560-4dc3-b73a-86d9d2a636e7 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3170dc3323f54512bc8819c8efa86b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7121bd118a2549c39332cfdb7edaa92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:34:11.032773 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-084530f5-59b9-493a-8f3f-b3059ce682cd tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a38b5af1654f44bc6cb5832c2e8e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051b6a3defca48d7b4f8bb6705f89f20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:34:11.037715 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-508013da-8560-4dc3-b73a-86d9d2a636e7 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] 10.222.0.121 "GET /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e" status: 200 len: 1325 microversion: 2.1 time: 0.313396 Aug 04 10:34:11.038324 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 113/241] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:34:10 2022] GET /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e => generated 1325 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:34:11.053493 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-084530f5-59b9-493a-8f3f-b3059ce682cd tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] 10.222.0.121 "GET /compute/v2.1/servers/c6dec6e8-e2f9-4c57-8326-19fc989b5c6e" status: 200 len: 1371 microversion: 2.1 time: 0.323498 Aug 04 10:34:11.054368 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 129/242] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:34:10 2022] GET /compute/v2.1/servers/c6dec6e8-e2f9-4c57-8326-19fc989b5c6e => generated 1371 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 10:34:11.157540 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-20e14d2e-4da6-4ef0-9bd0-8f8818c5960d tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:34:11.158301 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-20e14d2e-4da6-4ef0-9bd0-8f8818c5960d tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] [instance: cabceac5-859e-4c28-86c2-aa9b63953009] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:34:11.164920 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-20e14d2e-4da6-4ef0-9bd0-8f8818c5960d tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:11.165373 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-20e14d2e-4da6-4ef0-9bd0-8f8818c5960d tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:11.166106 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-4e39ea46-6eec-495d-8687-250ed57379d8 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:34:11.166244 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-20e14d2e-4da6-4ef0-9bd0-8f8818c5960d tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:11.166577 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-20e14d2e-4da6-4ef0-9bd0-8f8818c5960d tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:11.167264 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-4e39ea46-6eec-495d-8687-250ed57379d8 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] [instance: 81259012-5f3b-44f6-b979-39119f14929b] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:34:11.175531 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-4e39ea46-6eec-495d-8687-250ed57379d8 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:11.176019 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-4e39ea46-6eec-495d-8687-250ed57379d8 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:11.176871 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-4e39ea46-6eec-495d-8687-250ed57379d8 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:11.177473 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-4e39ea46-6eec-495d-8687-250ed57379d8 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:11.394151 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-20e14d2e-4da6-4ef0-9bd0-8f8818c5960d tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9520a49687b24281b78f08d43cb27dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c167faad577d47dfaf0d010a3f983fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:34:11.396945 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-4e39ea46-6eec-495d-8687-250ed57379d8 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa2e2a5a6ed4c5c9db91269266dd30b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f46ab11dd0b428486c673afc14b5b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:34:11.403435 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-20e14d2e-4da6-4ef0-9bd0-8f8818c5960d tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] 10.222.0.121 "GET /compute/v2.1/servers/cabceac5-859e-4c28-86c2-aa9b63953009" status: 200 len: 1318 microversion: 2.1 time: 0.249999 Aug 04 10:34:11.404533 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 114/243] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:34:11 2022] GET /compute/v2.1/servers/cabceac5-859e-4c28-86c2-aa9b63953009 => generated 1318 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:34:11.407298 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-4e39ea46-6eec-495d-8687-250ed57379d8 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] 10.222.0.121 "GET /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b" status: 200 len: 1366 microversion: 2.1 time: 0.246379 Aug 04 10:34:11.408059 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 130/244] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:34:11 2022] GET /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b => generated 1366 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:34:12.059784 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-5ec6f6b6-a269-4d8f-a937-0546106a07c9 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:34:12.060558 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-5ec6f6b6-a269-4d8f-a937-0546106a07c9 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] [instance: 2583b630-2f89-45ba-b781-c0b7c206d61e] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:34:12.068674 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-5ec6f6b6-a269-4d8f-a937-0546106a07c9 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:12.069145 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-5ec6f6b6-a269-4d8f-a937-0546106a07c9 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:12.070266 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-5ec6f6b6-a269-4d8f-a937-0546106a07c9 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:12.070825 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-5ec6f6b6-a269-4d8f-a937-0546106a07c9 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:12.078751 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-89909a14-bf0c-4f3c-9844-61f67d55dd2c tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:34:12.080111 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-89909a14-bf0c-4f3c-9844-61f67d55dd2c tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] [instance: c6dec6e8-e2f9-4c57-8326-19fc989b5c6e] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:34:12.090026 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-89909a14-bf0c-4f3c-9844-61f67d55dd2c tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:12.090818 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-89909a14-bf0c-4f3c-9844-61f67d55dd2c tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:12.091898 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-89909a14-bf0c-4f3c-9844-61f67d55dd2c tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:12.092557 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-89909a14-bf0c-4f3c-9844-61f67d55dd2c tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:12.351670 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-5ec6f6b6-a269-4d8f-a937-0546106a07c9 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3170dc3323f54512bc8819c8efa86b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7121bd118a2549c39332cfdb7edaa92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:34:12.357278 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-89909a14-bf0c-4f3c-9844-61f67d55dd2c tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a38b5af1654f44bc6cb5832c2e8e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051b6a3defca48d7b4f8bb6705f89f20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:34:12.366545 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-89909a14-bf0c-4f3c-9844-61f67d55dd2c tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] 10.222.0.121 "GET /compute/v2.1/servers/c6dec6e8-e2f9-4c57-8326-19fc989b5c6e" status: 200 len: 1371 microversion: 2.1 time: 0.294930 Aug 04 10:34:12.367372 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 131/245] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:34:12 2022] GET /compute/v2.1/servers/c6dec6e8-e2f9-4c57-8326-19fc989b5c6e => generated 1371 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:34:12.373336 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-5ec6f6b6-a269-4d8f-a937-0546106a07c9 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] 10.222.0.121 "GET /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e" status: 200 len: 1325 microversion: 2.1 time: 0.311943 Aug 04 10:34:12.374283 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 115/246] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:34:12 2022] GET /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e => generated 1325 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:34:12.441508 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-ce6001f5-87a7-45b4-98ec-72579f8e3e68 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:34:12.442641 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-ce6001f5-87a7-45b4-98ec-72579f8e3e68 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] [instance: 81259012-5f3b-44f6-b979-39119f14929b] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:34:12.444328 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-155d6919-4996-4cbe-ab7a-4331cc6af4f3 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:34:12.445703 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-155d6919-4996-4cbe-ab7a-4331cc6af4f3 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] [instance: cabceac5-859e-4c28-86c2-aa9b63953009] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:34:12.466690 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-ce6001f5-87a7-45b4-98ec-72579f8e3e68 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:12.467322 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-ce6001f5-87a7-45b4-98ec-72579f8e3e68 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:12.469007 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-ce6001f5-87a7-45b4-98ec-72579f8e3e68 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:12.470077 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-ce6001f5-87a7-45b4-98ec-72579f8e3e68 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:12.471387 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-155d6919-4996-4cbe-ab7a-4331cc6af4f3 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:12.472201 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-155d6919-4996-4cbe-ab7a-4331cc6af4f3 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:12.475042 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-155d6919-4996-4cbe-ab7a-4331cc6af4f3 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:12.484316 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-155d6919-4996-4cbe-ab7a-4331cc6af4f3 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:12.816284 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-ce6001f5-87a7-45b4-98ec-72579f8e3e68 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa2e2a5a6ed4c5c9db91269266dd30b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f46ab11dd0b428486c673afc14b5b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:34:12.824789 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-ce6001f5-87a7-45b4-98ec-72579f8e3e68 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] 10.222.0.121 "GET /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b" status: 200 len: 1366 microversion: 2.1 time: 0.396153 Aug 04 10:34:12.825107 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-155d6919-4996-4cbe-ab7a-4331cc6af4f3 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9520a49687b24281b78f08d43cb27dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c167faad577d47dfaf0d010a3f983fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:34:12.825560 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 116/247] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:34:12 2022] GET /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b => generated 1366 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:34:12.839556 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-155d6919-4996-4cbe-ab7a-4331cc6af4f3 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] 10.222.0.121 "GET /compute/v2.1/servers/cabceac5-859e-4c28-86c2-aa9b63953009" status: 200 len: 1318 microversion: 2.1 time: 0.416877 Aug 04 10:34:12.840199 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 132/248] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:34:12 2022] GET /compute/v2.1/servers/cabceac5-859e-4c28-86c2-aa9b63953009 => generated 1318 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:34:13.391694 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-3d562b60-d7de-4fae-87ce-b8d8373578ab tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:34:13.392536 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-3d562b60-d7de-4fae-87ce-b8d8373578ab tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] [instance: c6dec6e8-e2f9-4c57-8326-19fc989b5c6e] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:34:13.396356 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-61228969-a5df-43d6-9085-e579dce61cd8 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:34:13.399321 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-61228969-a5df-43d6-9085-e579dce61cd8 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] [instance: 2583b630-2f89-45ba-b781-c0b7c206d61e] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:34:13.404114 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-3d562b60-d7de-4fae-87ce-b8d8373578ab tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:13.404865 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-3d562b60-d7de-4fae-87ce-b8d8373578ab tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:13.405689 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-3d562b60-d7de-4fae-87ce-b8d8373578ab tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:13.406366 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-3d562b60-d7de-4fae-87ce-b8d8373578ab tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:13.408109 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-61228969-a5df-43d6-9085-e579dce61cd8 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:13.408758 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-61228969-a5df-43d6-9085-e579dce61cd8 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:13.413465 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-61228969-a5df-43d6-9085-e579dce61cd8 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:13.414310 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-61228969-a5df-43d6-9085-e579dce61cd8 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:13.648742 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-3d562b60-d7de-4fae-87ce-b8d8373578ab tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a38b5af1654f44bc6cb5832c2e8e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051b6a3defca48d7b4f8bb6705f89f20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:34:13.661189 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-3d562b60-d7de-4fae-87ce-b8d8373578ab tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] 10.222.0.121 "GET /compute/v2.1/servers/c6dec6e8-e2f9-4c57-8326-19fc989b5c6e" status: 200 len: 1371 microversion: 2.1 time: 0.275457 Aug 04 10:34:13.662547 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 117/249] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:34:13 2022] GET /compute/v2.1/servers/c6dec6e8-e2f9-4c57-8326-19fc989b5c6e => generated 1371 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:34:13.668952 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-61228969-a5df-43d6-9085-e579dce61cd8 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3170dc3323f54512bc8819c8efa86b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7121bd118a2549c39332cfdb7edaa92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:34:13.677598 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-61228969-a5df-43d6-9085-e579dce61cd8 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] 10.222.0.121 "GET /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e" status: 200 len: 1325 microversion: 2.1 time: 0.286211 Aug 04 10:34:13.678247 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 133/250] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:34:13 2022] GET /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e => generated 1325 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:34:13.848371 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-bfb81ff9-e236-46ca-8a00-59109813330b tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:34:13.849300 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-bfb81ff9-e236-46ca-8a00-59109813330b tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] [instance: 81259012-5f3b-44f6-b979-39119f14929b] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:34:13.857060 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-bfb81ff9-e236-46ca-8a00-59109813330b tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:13.857809 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-bfb81ff9-e236-46ca-8a00-59109813330b tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:13.858784 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-bfb81ff9-e236-46ca-8a00-59109813330b tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:13.859385 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-bfb81ff9-e236-46ca-8a00-59109813330b tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:13.863561 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-ac381814-0a47-44e8-ba10-d726d2b1f2b9 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:34:13.864187 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG dbcounter [-] [124456] Writing DB stats nova_cell1:SELECT=100 {{(pid=124456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:34:13.864333 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-ac381814-0a47-44e8-ba10-d726d2b1f2b9 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] [instance: cabceac5-859e-4c28-86c2-aa9b63953009] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:34:13.870941 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-ac381814-0a47-44e8-ba10-d726d2b1f2b9 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:13.871401 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-ac381814-0a47-44e8-ba10-d726d2b1f2b9 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:13.872246 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-ac381814-0a47-44e8-ba10-d726d2b1f2b9 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:13.872695 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-ac381814-0a47-44e8-ba10-d726d2b1f2b9 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:14.090551 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-bfb81ff9-e236-46ca-8a00-59109813330b tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa2e2a5a6ed4c5c9db91269266dd30b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f46ab11dd0b428486c673afc14b5b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:34:14.091888 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-ac381814-0a47-44e8-ba10-d726d2b1f2b9 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9520a49687b24281b78f08d43cb27dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c167faad577d47dfaf0d010a3f983fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:34:14.099452 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG dbcounter [-] [124457] Writing DB stats nova_cell1:SELECT=100 {{(pid=124457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:34:14.100746 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-bfb81ff9-e236-46ca-8a00-59109813330b tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] 10.222.0.121 "GET /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b" status: 200 len: 1366 microversion: 2.1 time: 0.257618 Aug 04 10:34:14.101370 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 118/251] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:34:13 2022] GET /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b => generated 1366 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:34:14.110409 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-ac381814-0a47-44e8-ba10-d726d2b1f2b9 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] 10.222.0.121 "GET /compute/v2.1/servers/cabceac5-859e-4c28-86c2-aa9b63953009" status: 200 len: 1318 microversion: 2.1 time: 0.251604 Aug 04 10:34:14.111421 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 134/252] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:34:13 2022] GET /compute/v2.1/servers/cabceac5-859e-4c28-86c2-aa9b63953009 => generated 1318 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:34:14.685997 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-ffef8478-8f90-4077-a9ba-85afc141fa1d tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:34:14.686651 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-ffef8478-8f90-4077-a9ba-85afc141fa1d tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] [instance: c6dec6e8-e2f9-4c57-8326-19fc989b5c6e] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:34:14.693469 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-ffef8478-8f90-4077-a9ba-85afc141fa1d tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:14.693928 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-ffef8478-8f90-4077-a9ba-85afc141fa1d tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:14.695047 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-ffef8478-8f90-4077-a9ba-85afc141fa1d tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:14.701810 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-ffef8478-8f90-4077-a9ba-85afc141fa1d tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:14.707235 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-7cf5089d-8179-46c3-8f56-94c736b69ec0 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:34:14.708092 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-7cf5089d-8179-46c3-8f56-94c736b69ec0 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] [instance: 2583b630-2f89-45ba-b781-c0b7c206d61e] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:34:14.716055 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-7cf5089d-8179-46c3-8f56-94c736b69ec0 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:14.716600 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-7cf5089d-8179-46c3-8f56-94c736b69ec0 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:14.717476 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-7cf5089d-8179-46c3-8f56-94c736b69ec0 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:14.718138 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-7cf5089d-8179-46c3-8f56-94c736b69ec0 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:14.930023 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-ffef8478-8f90-4077-a9ba-85afc141fa1d tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a38b5af1654f44bc6cb5832c2e8e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051b6a3defca48d7b4f8bb6705f89f20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:34:14.934435 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-7cf5089d-8179-46c3-8f56-94c736b69ec0 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3170dc3323f54512bc8819c8efa86b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7121bd118a2549c39332cfdb7edaa92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:34:14.937857 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-ffef8478-8f90-4077-a9ba-85afc141fa1d tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] 10.222.0.121 "GET /compute/v2.1/servers/c6dec6e8-e2f9-4c57-8326-19fc989b5c6e" status: 200 len: 1371 microversion: 2.1 time: 0.255887 Aug 04 10:34:14.938455 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 119/253] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:34:14 2022] GET /compute/v2.1/servers/c6dec6e8-e2f9-4c57-8326-19fc989b5c6e => generated 1371 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:34:14.944319 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-7cf5089d-8179-46c3-8f56-94c736b69ec0 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] 10.222.0.121 "GET /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e" status: 200 len: 1325 microversion: 2.1 time: 0.246608 Aug 04 10:34:14.944319 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 135/254] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:34:14 2022] GET /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e => generated 1325 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 10:34:15.143349 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-191e9b15-f3f4-49cc-8445-2e4ee163dd3c tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:34:15.144208 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-191e9b15-f3f4-49cc-8445-2e4ee163dd3c tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] [instance: 81259012-5f3b-44f6-b979-39119f14929b] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:34:15.150336 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-00ed928f-dc1b-4bab-ad47-ac83d4a45d58 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:34:15.151415 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-00ed928f-dc1b-4bab-ad47-ac83d4a45d58 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] [instance: cabceac5-859e-4c28-86c2-aa9b63953009] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:34:15.152388 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-191e9b15-f3f4-49cc-8445-2e4ee163dd3c tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:15.152927 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-191e9b15-f3f4-49cc-8445-2e4ee163dd3c tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:15.153765 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-191e9b15-f3f4-49cc-8445-2e4ee163dd3c tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:15.154433 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-191e9b15-f3f4-49cc-8445-2e4ee163dd3c tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:15.162571 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-00ed928f-dc1b-4bab-ad47-ac83d4a45d58 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:15.163255 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-00ed928f-dc1b-4bab-ad47-ac83d4a45d58 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:15.164706 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-00ed928f-dc1b-4bab-ad47-ac83d4a45d58 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:15.165698 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-00ed928f-dc1b-4bab-ad47-ac83d4a45d58 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:15.395449 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-191e9b15-f3f4-49cc-8445-2e4ee163dd3c tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa2e2a5a6ed4c5c9db91269266dd30b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f46ab11dd0b428486c673afc14b5b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:34:15.405137 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-191e9b15-f3f4-49cc-8445-2e4ee163dd3c tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] 10.222.0.121 "GET /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b" status: 200 len: 1366 microversion: 2.1 time: 0.272987 Aug 04 10:34:15.405981 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 120/255] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:34:15 2022] GET /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b => generated 1366 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:34:15.411863 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-00ed928f-dc1b-4bab-ad47-ac83d4a45d58 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9520a49687b24281b78f08d43cb27dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c167faad577d47dfaf0d010a3f983fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:34:15.419872 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-00ed928f-dc1b-4bab-ad47-ac83d4a45d58 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] 10.222.0.121 "GET /compute/v2.1/servers/cabceac5-859e-4c28-86c2-aa9b63953009" status: 200 len: 1318 microversion: 2.1 time: 0.286449 Aug 04 10:34:15.420493 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 136/256] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:34:15 2022] GET /compute/v2.1/servers/cabceac5-859e-4c28-86c2-aa9b63953009 => generated 1318 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:34:15.963992 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-1dd14757-d356-40d4-be7a-e4803f82dc77 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:34:15.964616 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-1dd14757-d356-40d4-be7a-e4803f82dc77 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] [instance: 2583b630-2f89-45ba-b781-c0b7c206d61e] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:34:15.971305 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-c348e099-58b0-4f1c-90ea-a6f951c0c2fe tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:34:15.971901 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-1dd14757-d356-40d4-be7a-e4803f82dc77 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:15.972032 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-c348e099-58b0-4f1c-90ea-a6f951c0c2fe tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] [instance: c6dec6e8-e2f9-4c57-8326-19fc989b5c6e] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:34:15.972155 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-1dd14757-d356-40d4-be7a-e4803f82dc77 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:15.972885 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-1dd14757-d356-40d4-be7a-e4803f82dc77 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:15.973337 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-1dd14757-d356-40d4-be7a-e4803f82dc77 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:15.979983 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-c348e099-58b0-4f1c-90ea-a6f951c0c2fe tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:15.980425 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-c348e099-58b0-4f1c-90ea-a6f951c0c2fe tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:15.981234 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-c348e099-58b0-4f1c-90ea-a6f951c0c2fe tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:15.981675 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-c348e099-58b0-4f1c-90ea-a6f951c0c2fe tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:16.174412 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-c348e099-58b0-4f1c-90ea-a6f951c0c2fe tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a38b5af1654f44bc6cb5832c2e8e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051b6a3defca48d7b4f8bb6705f89f20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:34:16.177722 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-1dd14757-d356-40d4-be7a-e4803f82dc77 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3170dc3323f54512bc8819c8efa86b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7121bd118a2549c39332cfdb7edaa92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:34:16.182691 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-c348e099-58b0-4f1c-90ea-a6f951c0c2fe tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] 10.222.0.121 "GET /compute/v2.1/servers/c6dec6e8-e2f9-4c57-8326-19fc989b5c6e" status: 200 len: 1371 microversion: 2.1 time: 0.215621 Aug 04 10:34:16.183300 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 137/257] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:34:15 2022] GET /compute/v2.1/servers/c6dec6e8-e2f9-4c57-8326-19fc989b5c6e => generated 1371 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:34:16.185954 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-1dd14757-d356-40d4-be7a-e4803f82dc77 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] 10.222.0.121 "GET /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e" status: 200 len: 1325 microversion: 2.1 time: 0.226188 Aug 04 10:34:16.186551 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 121/258] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:34:15 2022] GET /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e => generated 1325 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:34:16.427105 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-88f14f6a-e9d2-4bfb-8ffa-fdfbe2e6f257 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:34:16.427743 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-88f14f6a-e9d2-4bfb-8ffa-fdfbe2e6f257 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] [instance: 81259012-5f3b-44f6-b979-39119f14929b] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:34:16.434153 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-88f14f6a-e9d2-4bfb-8ffa-fdfbe2e6f257 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:16.434616 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-88f14f6a-e9d2-4bfb-8ffa-fdfbe2e6f257 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:16.435507 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-88f14f6a-e9d2-4bfb-8ffa-fdfbe2e6f257 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:16.435899 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-88f14f6a-e9d2-4bfb-8ffa-fdfbe2e6f257 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:16.441403 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-e1565848-0023-4143-bbba-670b12ff417e tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:34:16.442439 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-e1565848-0023-4143-bbba-670b12ff417e tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] [instance: cabceac5-859e-4c28-86c2-aa9b63953009] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:34:16.449208 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-e1565848-0023-4143-bbba-670b12ff417e tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:16.449658 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-e1565848-0023-4143-bbba-670b12ff417e tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:16.450436 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-e1565848-0023-4143-bbba-670b12ff417e tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:16.450873 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-e1565848-0023-4143-bbba-670b12ff417e tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:16.641692 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-88f14f6a-e9d2-4bfb-8ffa-fdfbe2e6f257 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa2e2a5a6ed4c5c9db91269266dd30b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f46ab11dd0b428486c673afc14b5b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:34:16.645648 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-e1565848-0023-4143-bbba-670b12ff417e tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9520a49687b24281b78f08d43cb27dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c167faad577d47dfaf0d010a3f983fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:34:16.649698 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-88f14f6a-e9d2-4bfb-8ffa-fdfbe2e6f257 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] 10.222.0.121 "GET /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b" status: 200 len: 1366 microversion: 2.1 time: 0.226593 Aug 04 10:34:16.650287 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 138/259] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:34:16 2022] GET /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b => generated 1366 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:34:16.653486 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-e1565848-0023-4143-bbba-670b12ff417e tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] 10.222.0.121 "GET /compute/v2.1/servers/cabceac5-859e-4c28-86c2-aa9b63953009" status: 200 len: 1318 microversion: 2.1 time: 0.216161 Aug 04 10:34:16.654031 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 122/260] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:34:16 2022] GET /compute/v2.1/servers/cabceac5-859e-4c28-86c2-aa9b63953009 => generated 1318 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:34:17.204884 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-f10fe19b-23cb-4839-8161-2f57bd9da93e tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:34:17.205702 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-f10fe19b-23cb-4839-8161-2f57bd9da93e tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] [instance: c6dec6e8-e2f9-4c57-8326-19fc989b5c6e] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:34:17.207101 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-4e3cd362-4378-444d-a991-e616d827b307 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:34:17.207719 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-4e3cd362-4378-444d-a991-e616d827b307 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] [instance: 2583b630-2f89-45ba-b781-c0b7c206d61e] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:34:17.212634 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-f10fe19b-23cb-4839-8161-2f57bd9da93e tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:17.213088 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-f10fe19b-23cb-4839-8161-2f57bd9da93e tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:17.213899 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-f10fe19b-23cb-4839-8161-2f57bd9da93e tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:17.214338 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-f10fe19b-23cb-4839-8161-2f57bd9da93e tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:17.214566 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-4e3cd362-4378-444d-a991-e616d827b307 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:17.215046 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-4e3cd362-4378-444d-a991-e616d827b307 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:17.215830 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-4e3cd362-4378-444d-a991-e616d827b307 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:17.216306 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-4e3cd362-4378-444d-a991-e616d827b307 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:17.408840 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-f10fe19b-23cb-4839-8161-2f57bd9da93e tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a38b5af1654f44bc6cb5832c2e8e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051b6a3defca48d7b4f8bb6705f89f20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:34:17.417385 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-f10fe19b-23cb-4839-8161-2f57bd9da93e tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] 10.222.0.121 "GET /compute/v2.1/servers/c6dec6e8-e2f9-4c57-8326-19fc989b5c6e" status: 200 len: 1371 microversion: 2.1 time: 0.216779 Aug 04 10:34:17.418068 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 139/261] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:34:17 2022] GET /compute/v2.1/servers/c6dec6e8-e2f9-4c57-8326-19fc989b5c6e => generated 1371 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:34:17.425041 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-4e3cd362-4378-444d-a991-e616d827b307 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3170dc3323f54512bc8819c8efa86b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7121bd118a2549c39332cfdb7edaa92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:34:17.433177 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-4e3cd362-4378-444d-a991-e616d827b307 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] 10.222.0.121 "GET /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e" status: 200 len: 1325 microversion: 2.1 time: 0.230113 Aug 04 10:34:17.433799 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 123/262] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:34:17 2022] GET /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e => generated 1325 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:34:17.675457 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-3ad3165c-d4e3-46f9-872d-d90500e0dd85 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:34:17.676103 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-3ad3165c-d4e3-46f9-872d-d90500e0dd85 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] [instance: 81259012-5f3b-44f6-b979-39119f14929b] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:34:17.682876 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-2e179786-6392-42ee-9e82-ebb6e94b3462 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:34:17.683050 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-3ad3165c-d4e3-46f9-872d-d90500e0dd85 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:17.683459 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-3ad3165c-d4e3-46f9-872d-d90500e0dd85 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:17.683817 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-2e179786-6392-42ee-9e82-ebb6e94b3462 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] [instance: cabceac5-859e-4c28-86c2-aa9b63953009] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:34:17.684258 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-3ad3165c-d4e3-46f9-872d-d90500e0dd85 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:17.684671 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-3ad3165c-d4e3-46f9-872d-d90500e0dd85 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:17.690862 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-2e179786-6392-42ee-9e82-ebb6e94b3462 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:17.691321 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-2e179786-6392-42ee-9e82-ebb6e94b3462 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:17.692134 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-2e179786-6392-42ee-9e82-ebb6e94b3462 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:17.692571 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-2e179786-6392-42ee-9e82-ebb6e94b3462 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:17.902110 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-3ad3165c-d4e3-46f9-872d-d90500e0dd85 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa2e2a5a6ed4c5c9db91269266dd30b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f46ab11dd0b428486c673afc14b5b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:34:17.907488 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-2e179786-6392-42ee-9e82-ebb6e94b3462 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9520a49687b24281b78f08d43cb27dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c167faad577d47dfaf0d010a3f983fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:34:17.911028 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-3ad3165c-d4e3-46f9-872d-d90500e0dd85 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] 10.222.0.121 "GET /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b" status: 200 len: 1366 microversion: 2.1 time: 0.239559 Aug 04 10:34:17.911619 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 140/263] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:34:17 2022] GET /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b => generated 1366 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:34:17.916064 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-2e179786-6392-42ee-9e82-ebb6e94b3462 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] 10.222.0.121 "GET /compute/v2.1/servers/cabceac5-859e-4c28-86c2-aa9b63953009" status: 200 len: 1318 microversion: 2.1 time: 0.237910 Aug 04 10:34:17.916692 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 124/264] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:34:17 2022] GET /compute/v2.1/servers/cabceac5-859e-4c28-86c2-aa9b63953009 => generated 1318 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:34:18.439461 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-f73fc5f6-a876-473e-8b90-7906a8ccc94f tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:34:18.440103 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-f73fc5f6-a876-473e-8b90-7906a8ccc94f tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] [instance: c6dec6e8-e2f9-4c57-8326-19fc989b5c6e] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:34:18.446901 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-f73fc5f6-a876-473e-8b90-7906a8ccc94f tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:18.447358 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-f73fc5f6-a876-473e-8b90-7906a8ccc94f tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:18.448225 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-f73fc5f6-a876-473e-8b90-7906a8ccc94f tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:18.448676 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-f73fc5f6-a876-473e-8b90-7906a8ccc94f tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:18.454887 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-ea568d2f-dc85-4e8d-ad13-26f0f130c16c tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:34:18.455505 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-ea568d2f-dc85-4e8d-ad13-26f0f130c16c tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] [instance: 2583b630-2f89-45ba-b781-c0b7c206d61e] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:34:18.472880 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-ea568d2f-dc85-4e8d-ad13-26f0f130c16c tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:18.473330 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-ea568d2f-dc85-4e8d-ad13-26f0f130c16c tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:18.474114 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-ea568d2f-dc85-4e8d-ad13-26f0f130c16c tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:18.474526 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-ea568d2f-dc85-4e8d-ad13-26f0f130c16c tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:18.876197 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-f73fc5f6-a876-473e-8b90-7906a8ccc94f tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a38b5af1654f44bc6cb5832c2e8e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051b6a3defca48d7b4f8bb6705f89f20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:34:18.882938 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-ea568d2f-dc85-4e8d-ad13-26f0f130c16c tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3170dc3323f54512bc8819c8efa86b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7121bd118a2549c39332cfdb7edaa92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:34:18.892921 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-f73fc5f6-a876-473e-8b90-7906a8ccc94f tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] 10.222.0.121 "GET /compute/v2.1/servers/c6dec6e8-e2f9-4c57-8326-19fc989b5c6e" status: 200 len: 1371 microversion: 2.1 time: 0.456280 Aug 04 10:34:18.894020 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 141/265] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:34:18 2022] GET /compute/v2.1/servers/c6dec6e8-e2f9-4c57-8326-19fc989b5c6e => generated 1371 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:34:18.895687 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-ea568d2f-dc85-4e8d-ad13-26f0f130c16c tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] 10.222.0.121 "GET /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e" status: 200 len: 1325 microversion: 2.1 time: 0.444644 Aug 04 10:34:18.899998 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 125/266] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:34:18 2022] GET /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e => generated 1325 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 10:34:18.932840 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-a3e68b6a-f310-49c3-b2b3-b573c9cfce9b tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:34:18.933466 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-a3e68b6a-f310-49c3-b2b3-b573c9cfce9b tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] [instance: 81259012-5f3b-44f6-b979-39119f14929b] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:34:18.937399 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-822db36f-e45c-47a9-b4c9-3edf6c787668 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:34:18.938170 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-822db36f-e45c-47a9-b4c9-3edf6c787668 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] [instance: cabceac5-859e-4c28-86c2-aa9b63953009] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:34:18.940410 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-a3e68b6a-f310-49c3-b2b3-b573c9cfce9b tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:18.940870 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-a3e68b6a-f310-49c3-b2b3-b573c9cfce9b tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:18.941633 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-a3e68b6a-f310-49c3-b2b3-b573c9cfce9b tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:18.942079 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-a3e68b6a-f310-49c3-b2b3-b573c9cfce9b tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:18.944517 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-822db36f-e45c-47a9-b4c9-3edf6c787668 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:18.944980 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-822db36f-e45c-47a9-b4c9-3edf6c787668 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:18.945771 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-822db36f-e45c-47a9-b4c9-3edf6c787668 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:18.946211 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-822db36f-e45c-47a9-b4c9-3edf6c787668 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:19.163800 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-a3e68b6a-f310-49c3-b2b3-b573c9cfce9b tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa2e2a5a6ed4c5c9db91269266dd30b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f46ab11dd0b428486c673afc14b5b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:34:19.171481 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-822db36f-e45c-47a9-b4c9-3edf6c787668 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9520a49687b24281b78f08d43cb27dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c167faad577d47dfaf0d010a3f983fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:34:19.176251 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-a3e68b6a-f310-49c3-b2b3-b573c9cfce9b tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] 10.222.0.121 "GET /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b" status: 200 len: 1366 microversion: 2.1 time: 0.246964 Aug 04 10:34:19.177150 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 142/267] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:34:18 2022] GET /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b => generated 1366 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:34:19.182411 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-822db36f-e45c-47a9-b4c9-3edf6c787668 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] 10.222.0.121 "GET /compute/v2.1/servers/cabceac5-859e-4c28-86c2-aa9b63953009" status: 200 len: 1318 microversion: 2.1 time: 0.249253 Aug 04 10:34:19.183028 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 126/268] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:34:18 2022] GET /compute/v2.1/servers/cabceac5-859e-4c28-86c2-aa9b63953009 => generated 1318 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 10:34:19.917611 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-82e3e4a3-e1e8-42f6-8762-f341073247ab tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:34:19.918437 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-82e3e4a3-e1e8-42f6-8762-f341073247ab tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] [instance: 2583b630-2f89-45ba-b781-c0b7c206d61e] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:34:19.918789 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-6240f9e1-c633-453e-ad9c-7173e8fbac34 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:34:19.919983 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-6240f9e1-c633-453e-ad9c-7173e8fbac34 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] [instance: c6dec6e8-e2f9-4c57-8326-19fc989b5c6e] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:34:19.926528 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-6240f9e1-c633-453e-ad9c-7173e8fbac34 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:19.927174 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-6240f9e1-c633-453e-ad9c-7173e8fbac34 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:19.928347 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-6240f9e1-c633-453e-ad9c-7173e8fbac34 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:19.928793 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-82e3e4a3-e1e8-42f6-8762-f341073247ab tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:19.929140 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-6240f9e1-c633-453e-ad9c-7173e8fbac34 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:19.929274 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-82e3e4a3-e1e8-42f6-8762-f341073247ab tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:19.934999 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-82e3e4a3-e1e8-42f6-8762-f341073247ab tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:19.934999 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-82e3e4a3-e1e8-42f6-8762-f341073247ab tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:20.141328 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-82e3e4a3-e1e8-42f6-8762-f341073247ab tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3170dc3323f54512bc8819c8efa86b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7121bd118a2549c39332cfdb7edaa92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:34:20.146171 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-6240f9e1-c633-453e-ad9c-7173e8fbac34 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a38b5af1654f44bc6cb5832c2e8e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051b6a3defca48d7b4f8bb6705f89f20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:34:20.149634 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-82e3e4a3-e1e8-42f6-8762-f341073247ab tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] 10.222.0.121 "GET /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e" status: 200 len: 1325 microversion: 2.1 time: 0.236231 Aug 04 10:34:20.150245 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 127/269] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:34:19 2022] GET /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e => generated 1325 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:34:20.168036 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-6240f9e1-c633-453e-ad9c-7173e8fbac34 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] 10.222.0.121 "GET /compute/v2.1/servers/c6dec6e8-e2f9-4c57-8326-19fc989b5c6e" status: 200 len: 1371 microversion: 2.1 time: 0.254540 Aug 04 10:34:20.168629 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 143/270] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:34:19 2022] GET /compute/v2.1/servers/c6dec6e8-e2f9-4c57-8326-19fc989b5c6e => generated 1371 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:34:20.182710 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [req-94e5e686-4c3c-4908-b278-4bff480fd105 req-8848ad56-4a06-4729-b839-5b148193908e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2583b630-2f89-45ba-b781-c0b7c206d61e", "name": "network-vif-plugged", "status": "completed", "tag": "c85208ac-5355-452e-8834-f5f341168cc4"}]} {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:34:20.189208 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG dbcounter [-] [124456] Writing DB stats nova_api:SELECT=94 {{(pid=124456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:34:20.195290 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [req-94e5e686-4c3c-4908-b278-4bff480fd105 req-8848ad56-4a06-4729-b839-5b148193908e service nova] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:20.195752 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [req-94e5e686-4c3c-4908-b278-4bff480fd105 req-8848ad56-4a06-4729-b839-5b148193908e service nova] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:20.199007 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-e7d42990-e8f1-4925-b73e-a23ce7441bd8 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:34:20.199784 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-e7d42990-e8f1-4925-b73e-a23ce7441bd8 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] [instance: 81259012-5f3b-44f6-b979-39119f14929b] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:34:20.206252 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-e7d42990-e8f1-4925-b73e-a23ce7441bd8 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:20.206842 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-e7d42990-e8f1-4925-b73e-a23ce7441bd8 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:20.207680 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-e7d42990-e8f1-4925-b73e-a23ce7441bd8 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:20.208236 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-e7d42990-e8f1-4925-b73e-a23ce7441bd8 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:20.210823 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.compute.server_external_events [req-94e5e686-4c3c-4908-b278-4bff480fd105 req-8848ad56-4a06-4729-b839-5b148193908e service nova] Creating event network-vif-plugged:c85208ac-5355-452e-8834-f5f341168cc4 for instance 2583b630-2f89-45ba-b781-c0b7c206d61e on hv-cinder-85200 Aug 04 10:34:20.217387 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [req-94e5e686-4c3c-4908-b278-4bff480fd105 req-8848ad56-4a06-4729-b839-5b148193908e service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038984 Aug 04 10:34:20.218880 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 128/271] 10.222.0.121 () {64 vars in 1322 bytes} [Thu Aug 4 10:34:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:34:20.229472 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-ff83c17a-2d06-4637-bad4-30ad0f7b67dc tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:34:20.230441 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-ff83c17a-2d06-4637-bad4-30ad0f7b67dc tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] [instance: cabceac5-859e-4c28-86c2-aa9b63953009] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:34:20.238846 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-ff83c17a-2d06-4637-bad4-30ad0f7b67dc tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:20.239608 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-ff83c17a-2d06-4637-bad4-30ad0f7b67dc tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:20.241025 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-ff83c17a-2d06-4637-bad4-30ad0f7b67dc tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:20.241630 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-ff83c17a-2d06-4637-bad4-30ad0f7b67dc tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:20.402133 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-e7d42990-e8f1-4925-b73e-a23ce7441bd8 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa2e2a5a6ed4c5c9db91269266dd30b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f46ab11dd0b428486c673afc14b5b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:34:20.410617 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-e7d42990-e8f1-4925-b73e-a23ce7441bd8 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] 10.222.0.121 "GET /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b" status: 200 len: 1366 microversion: 2.1 time: 0.216378 Aug 04 10:34:20.411205 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 144/272] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:34:20 2022] GET /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b => generated 1366 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:34:20.424874 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-ff83c17a-2d06-4637-bad4-30ad0f7b67dc tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9520a49687b24281b78f08d43cb27dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c167faad577d47dfaf0d010a3f983fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:34:20.432841 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-ff83c17a-2d06-4637-bad4-30ad0f7b67dc tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] 10.222.0.121 "GET /compute/v2.1/servers/cabceac5-859e-4c28-86c2-aa9b63953009" status: 200 len: 1318 microversion: 2.1 time: 0.212263 Aug 04 10:34:20.433429 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 129/273] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:34:20 2022] GET /compute/v2.1/servers/cabceac5-859e-4c28-86c2-aa9b63953009 => generated 1318 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:34:21.172609 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-976ea722-83f9-41a6-a412-5e2a751f9515 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:34:21.173394 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-976ea722-83f9-41a6-a412-5e2a751f9515 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] [instance: 2583b630-2f89-45ba-b781-c0b7c206d61e] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:34:21.182250 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-976ea722-83f9-41a6-a412-5e2a751f9515 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:21.183022 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-976ea722-83f9-41a6-a412-5e2a751f9515 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:21.184459 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-976ea722-83f9-41a6-a412-5e2a751f9515 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:21.185109 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-976ea722-83f9-41a6-a412-5e2a751f9515 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:21.191610 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-6c3d0f0a-663b-440c-b8ef-88b0aa109430 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:34:21.192520 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-6c3d0f0a-663b-440c-b8ef-88b0aa109430 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] [instance: c6dec6e8-e2f9-4c57-8326-19fc989b5c6e] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:34:21.201246 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-6c3d0f0a-663b-440c-b8ef-88b0aa109430 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:21.201703 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-6c3d0f0a-663b-440c-b8ef-88b0aa109430 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:21.202486 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-6c3d0f0a-663b-440c-b8ef-88b0aa109430 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:21.203070 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-6c3d0f0a-663b-440c-b8ef-88b0aa109430 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:21.398237 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-976ea722-83f9-41a6-a412-5e2a751f9515 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3170dc3323f54512bc8819c8efa86b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7121bd118a2549c39332cfdb7edaa92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:34:21.407319 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-976ea722-83f9-41a6-a412-5e2a751f9515 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] 10.222.0.121 "GET /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e" status: 200 len: 1325 microversion: 2.1 time: 0.240898 Aug 04 10:34:21.408422 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 145/274] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:34:21 2022] GET /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e => generated 1325 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:34:21.411447 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-6c3d0f0a-663b-440c-b8ef-88b0aa109430 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a38b5af1654f44bc6cb5832c2e8e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051b6a3defca48d7b4f8bb6705f89f20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:34:21.420100 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-6c3d0f0a-663b-440c-b8ef-88b0aa109430 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] 10.222.0.121 "GET /compute/v2.1/servers/c6dec6e8-e2f9-4c57-8326-19fc989b5c6e" status: 200 len: 1371 microversion: 2.1 time: 0.234711 Aug 04 10:34:21.421420 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 130/275] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:34:21 2022] GET /compute/v2.1/servers/c6dec6e8-e2f9-4c57-8326-19fc989b5c6e => generated 1371 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:34:21.440470 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-e9849af6-00ef-4727-b5d3-346fa40dd3db tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:34:21.441395 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-e9849af6-00ef-4727-b5d3-346fa40dd3db tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] [instance: 81259012-5f3b-44f6-b979-39119f14929b] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:34:21.451039 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-e9849af6-00ef-4727-b5d3-346fa40dd3db tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:21.451704 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-e9849af6-00ef-4727-b5d3-346fa40dd3db tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:21.453079 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-e9849af6-00ef-4727-b5d3-346fa40dd3db tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:21.453887 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-e9849af6-00ef-4727-b5d3-346fa40dd3db tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:21.459138 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-ba91d9a8-da13-410c-8ad7-7edff31befe5 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:34:21.460227 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-ba91d9a8-da13-410c-8ad7-7edff31befe5 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] [instance: cabceac5-859e-4c28-86c2-aa9b63953009] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:34:21.469824 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-ba91d9a8-da13-410c-8ad7-7edff31befe5 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:21.470382 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-ba91d9a8-da13-410c-8ad7-7edff31befe5 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:21.471324 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-ba91d9a8-da13-410c-8ad7-7edff31befe5 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:21.471774 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-ba91d9a8-da13-410c-8ad7-7edff31befe5 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:21.698865 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-e9849af6-00ef-4727-b5d3-346fa40dd3db tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa2e2a5a6ed4c5c9db91269266dd30b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f46ab11dd0b428486c673afc14b5b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:34:21.701735 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-ba91d9a8-da13-410c-8ad7-7edff31befe5 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9520a49687b24281b78f08d43cb27dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c167faad577d47dfaf0d010a3f983fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:34:21.709318 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-e9849af6-00ef-4727-b5d3-346fa40dd3db tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] 10.222.0.121 "GET /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b" status: 200 len: 1366 microversion: 2.1 time: 0.274003 Aug 04 10:34:21.717770 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 146/276] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:34:21 2022] GET /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b => generated 1366 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:34:21.721114 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-ba91d9a8-da13-410c-8ad7-7edff31befe5 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] 10.222.0.121 "GET /compute/v2.1/servers/cabceac5-859e-4c28-86c2-aa9b63953009" status: 200 len: 1318 microversion: 2.1 time: 0.268937 Aug 04 10:34:21.722101 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 131/277] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:34:21 2022] GET /compute/v2.1/servers/cabceac5-859e-4c28-86c2-aa9b63953009 => generated 1318 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:34:22.437100 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-8d48c4ac-6f84-48a8-b8f1-aac3ca51bb14 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:34:22.438172 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-8d48c4ac-6f84-48a8-b8f1-aac3ca51bb14 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] [instance: 2583b630-2f89-45ba-b781-c0b7c206d61e] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:34:22.440138 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG dbcounter [-] [124457] Writing DB stats nova_api:SELECT=95 {{(pid=124457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:34:22.441373 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-81d6b2d1-3939-4a11-a6b2-31788dd692e9 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:34:22.442304 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-81d6b2d1-3939-4a11-a6b2-31788dd692e9 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] [instance: c6dec6e8-e2f9-4c57-8326-19fc989b5c6e] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:34:22.446198 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-8d48c4ac-6f84-48a8-b8f1-aac3ca51bb14 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:22.446694 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-8d48c4ac-6f84-48a8-b8f1-aac3ca51bb14 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:22.447561 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-8d48c4ac-6f84-48a8-b8f1-aac3ca51bb14 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:22.448039 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-8d48c4ac-6f84-48a8-b8f1-aac3ca51bb14 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:22.448936 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-81d6b2d1-3939-4a11-a6b2-31788dd692e9 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:22.449411 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-81d6b2d1-3939-4a11-a6b2-31788dd692e9 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:22.450203 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-81d6b2d1-3939-4a11-a6b2-31788dd692e9 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:22.450669 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-81d6b2d1-3939-4a11-a6b2-31788dd692e9 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:22.679979 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-8d48c4ac-6f84-48a8-b8f1-aac3ca51bb14 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3170dc3323f54512bc8819c8efa86b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7121bd118a2549c39332cfdb7edaa92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:34:22.684189 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-81d6b2d1-3939-4a11-a6b2-31788dd692e9 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a38b5af1654f44bc6cb5832c2e8e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051b6a3defca48d7b4f8bb6705f89f20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:34:22.691623 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-8d48c4ac-6f84-48a8-b8f1-aac3ca51bb14 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] 10.222.0.121 "GET /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e" status: 200 len: 1325 microversion: 2.1 time: 0.259064 Aug 04 10:34:22.692272 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-81d6b2d1-3939-4a11-a6b2-31788dd692e9 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] 10.222.0.121 "GET /compute/v2.1/servers/c6dec6e8-e2f9-4c57-8326-19fc989b5c6e" status: 200 len: 1371 microversion: 2.1 time: 0.254832 Aug 04 10:34:22.692564 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 147/278] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:34:22 2022] GET /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e => generated 1325 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:34:22.693228 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 132/279] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:34:22 2022] GET /compute/v2.1/servers/c6dec6e8-e2f9-4c57-8326-19fc989b5c6e => generated 1371 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 10:34:22.731612 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-b2e7cd00-1621-4a76-abe8-67e9903949ec tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:34:22.733182 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-b2e7cd00-1621-4a76-abe8-67e9903949ec tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] [instance: 81259012-5f3b-44f6-b979-39119f14929b] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:34:22.741771 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-b2e7cd00-1621-4a76-abe8-67e9903949ec tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:22.742354 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-b2e7cd00-1621-4a76-abe8-67e9903949ec tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:22.743155 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-b2e7cd00-1621-4a76-abe8-67e9903949ec tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:22.743417 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-64d753f1-34d9-4ec1-ab20-5b8dc56dbe00 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:34:22.743565 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-b2e7cd00-1621-4a76-abe8-67e9903949ec tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:22.744055 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-64d753f1-34d9-4ec1-ab20-5b8dc56dbe00 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] [instance: cabceac5-859e-4c28-86c2-aa9b63953009] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:34:22.751023 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-64d753f1-34d9-4ec1-ab20-5b8dc56dbe00 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:22.751809 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-64d753f1-34d9-4ec1-ab20-5b8dc56dbe00 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:22.752775 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-64d753f1-34d9-4ec1-ab20-5b8dc56dbe00 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:22.753214 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-64d753f1-34d9-4ec1-ab20-5b8dc56dbe00 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:23.002196 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-64d753f1-34d9-4ec1-ab20-5b8dc56dbe00 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9520a49687b24281b78f08d43cb27dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c167faad577d47dfaf0d010a3f983fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:34:23.011153 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-b2e7cd00-1621-4a76-abe8-67e9903949ec tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa2e2a5a6ed4c5c9db91269266dd30b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f46ab11dd0b428486c673afc14b5b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:34:23.033367 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-64d753f1-34d9-4ec1-ab20-5b8dc56dbe00 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] 10.222.0.121 "GET /compute/v2.1/servers/cabceac5-859e-4c28-86c2-aa9b63953009" status: 200 len: 1318 microversion: 2.1 time: 0.293621 Aug 04 10:34:23.034466 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 133/280] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:34:22 2022] GET /compute/v2.1/servers/cabceac5-859e-4c28-86c2-aa9b63953009 => generated 1318 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:34:23.038544 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-b2e7cd00-1621-4a76-abe8-67e9903949ec tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] 10.222.0.121 "GET /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b" status: 200 len: 1366 microversion: 2.1 time: 0.310818 Aug 04 10:34:23.039672 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 148/281] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:34:22 2022] GET /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b => generated 1366 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:34:23.723767 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-2799d380-4238-4c2d-b38f-dc758e36fe95 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:34:23.724916 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-2799d380-4238-4c2d-b38f-dc758e36fe95 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] [instance: c6dec6e8-e2f9-4c57-8326-19fc989b5c6e] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:34:23.728570 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-e865d912-2bc7-43d3-a904-0170372a21fb tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:34:23.729679 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-e865d912-2bc7-43d3-a904-0170372a21fb tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] [instance: 2583b630-2f89-45ba-b781-c0b7c206d61e] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:34:23.744130 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-2799d380-4238-4c2d-b38f-dc758e36fe95 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:23.746927 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-e865d912-2bc7-43d3-a904-0170372a21fb tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:23.747569 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-e865d912-2bc7-43d3-a904-0170372a21fb tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:23.748784 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-e865d912-2bc7-43d3-a904-0170372a21fb tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:23.749321 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-2799d380-4238-4c2d-b38f-dc758e36fe95 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:23.750974 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-2799d380-4238-4c2d-b38f-dc758e36fe95 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:23.752027 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-e865d912-2bc7-43d3-a904-0170372a21fb tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:23.752954 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-2799d380-4238-4c2d-b38f-dc758e36fe95 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:24.098827 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-e865d912-2bc7-43d3-a904-0170372a21fb tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3170dc3323f54512bc8819c8efa86b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7121bd118a2549c39332cfdb7edaa92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:34:24.110343 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-e865d912-2bc7-43d3-a904-0170372a21fb tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] 10.222.0.121 "GET /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e" status: 200 len: 1325 microversion: 2.1 time: 0.399786 Aug 04 10:34:24.111130 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 134/282] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:34:23 2022] GET /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e => generated 1325 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 10:34:24.117348 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-053e8b07-b019-46c6-a043-86b7c46ae3d9 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:34:24.117982 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-053e8b07-b019-46c6-a043-86b7c46ae3d9 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] [instance: cabceac5-859e-4c28-86c2-aa9b63953009] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:34:24.126772 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-053e8b07-b019-46c6-a043-86b7c46ae3d9 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:24.127583 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-053e8b07-b019-46c6-a043-86b7c46ae3d9 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:24.128710 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-053e8b07-b019-46c6-a043-86b7c46ae3d9 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:24.129854 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-053e8b07-b019-46c6-a043-86b7c46ae3d9 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:24.159206 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG dbcounter [-] [124456] Writing DB stats nova_cell1:SELECT=100 {{(pid=124456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:34:24.161511 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-2799d380-4238-4c2d-b38f-dc758e36fe95 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a38b5af1654f44bc6cb5832c2e8e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051b6a3defca48d7b4f8bb6705f89f20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:34:24.171578 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-2799d380-4238-4c2d-b38f-dc758e36fe95 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] 10.222.0.121 "GET /compute/v2.1/servers/c6dec6e8-e2f9-4c57-8326-19fc989b5c6e" status: 200 len: 1371 microversion: 2.1 time: 0.454007 Aug 04 10:34:24.172229 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 149/283] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:34:23 2022] GET /compute/v2.1/servers/c6dec6e8-e2f9-4c57-8326-19fc989b5c6e => generated 1371 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:34:24.176907 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-5de43460-a11b-46c8-8c27-dfc783e5901a tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:34:24.180700 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-5de43460-a11b-46c8-8c27-dfc783e5901a tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] [instance: 81259012-5f3b-44f6-b979-39119f14929b] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:34:24.192938 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-5de43460-a11b-46c8-8c27-dfc783e5901a tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:24.193657 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-5de43460-a11b-46c8-8c27-dfc783e5901a tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:24.194623 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-5de43460-a11b-46c8-8c27-dfc783e5901a tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:24.195239 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-5de43460-a11b-46c8-8c27-dfc783e5901a tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:24.420022 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-053e8b07-b019-46c6-a043-86b7c46ae3d9 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9520a49687b24281b78f08d43cb27dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c167faad577d47dfaf0d010a3f983fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:34:24.432203 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-053e8b07-b019-46c6-a043-86b7c46ae3d9 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] 10.222.0.121 "GET /compute/v2.1/servers/cabceac5-859e-4c28-86c2-aa9b63953009" status: 200 len: 1318 microversion: 2.1 time: 0.319271 Aug 04 10:34:24.433491 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 135/284] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:34:24 2022] GET /compute/v2.1/servers/cabceac5-859e-4c28-86c2-aa9b63953009 => generated 1318 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:34:24.495425 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-5de43460-a11b-46c8-8c27-dfc783e5901a tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa2e2a5a6ed4c5c9db91269266dd30b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f46ab11dd0b428486c673afc14b5b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:34:24.525837 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-5de43460-a11b-46c8-8c27-dfc783e5901a tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] 10.222.0.121 "GET /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b" status: 200 len: 1366 microversion: 2.1 time: 0.343964 Aug 04 10:34:24.532761 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 150/285] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:34:24 2022] GET /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b => generated 1366 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:34:25.080498 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [req-e252ac5e-fdc6-4768-b605-1485e1074bd3 req-31e06202-7401-4151-b203-585686ef522c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cabceac5-859e-4c28-86c2-aa9b63953009", "name": "network-vif-plugged", "status": "completed", "tag": "a3861873-99d9-49b7-9745-14f9834dfd57"}]} {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:34:25.118292 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [req-e252ac5e-fdc6-4768-b605-1485e1074bd3 req-31e06202-7401-4151-b203-585686ef522c service nova] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:25.121109 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [req-e252ac5e-fdc6-4768-b605-1485e1074bd3 req-31e06202-7401-4151-b203-585686ef522c service nova] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:25.134746 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-90021084-683d-4861-b1d4-cb2cf38f5287 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:34:25.135398 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-90021084-683d-4861-b1d4-cb2cf38f5287 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] [instance: 2583b630-2f89-45ba-b781-c0b7c206d61e] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:34:25.144867 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.compute.server_external_events [req-e252ac5e-fdc6-4768-b605-1485e1074bd3 req-31e06202-7401-4151-b203-585686ef522c service nova] Creating event network-vif-plugged:a3861873-99d9-49b7-9745-14f9834dfd57 for instance cabceac5-859e-4c28-86c2-aa9b63953009 on hv-cinder-85200 Aug 04 10:34:25.160111 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [req-e252ac5e-fdc6-4768-b605-1485e1074bd3 req-31e06202-7401-4151-b203-585686ef522c service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084934 Aug 04 10:34:25.162574 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-90021084-683d-4861-b1d4-cb2cf38f5287 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:25.163249 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 136/286] 10.222.0.121 () {64 vars in 1322 bytes} [Thu Aug 4 10:34:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 10:34:25.164403 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-90021084-683d-4861-b1d4-cb2cf38f5287 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:25.165393 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-90021084-683d-4861-b1d4-cb2cf38f5287 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:25.167934 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-90021084-683d-4861-b1d4-cb2cf38f5287 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:25.214132 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-a6278ac2-efca-49e6-9360-54f712855094 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:34:25.215725 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-a6278ac2-efca-49e6-9360-54f712855094 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] [instance: c6dec6e8-e2f9-4c57-8326-19fc989b5c6e] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:34:25.232117 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG dbcounter [-] [124457] Writing DB stats nova_cell1:SELECT=100 {{(pid=124457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:34:25.252415 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-a6278ac2-efca-49e6-9360-54f712855094 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:25.254186 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-a6278ac2-efca-49e6-9360-54f712855094 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:25.267830 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-a6278ac2-efca-49e6-9360-54f712855094 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:25.274527 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-a6278ac2-efca-49e6-9360-54f712855094 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:25.577008 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-90021084-683d-4861-b1d4-cb2cf38f5287 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3170dc3323f54512bc8819c8efa86b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7121bd118a2549c39332cfdb7edaa92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:34:25.596900 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-90021084-683d-4861-b1d4-cb2cf38f5287 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] 10.222.0.121 "GET /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e" status: 200 len: 1325 microversion: 2.1 time: 0.467393 Aug 04 10:34:25.613176 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 151/287] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:34:25 2022] GET /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e => generated 1325 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 10:34:25.620650 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-652aa462-68a5-46cc-b484-d5c6c35730c5 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:34:25.621725 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-652aa462-68a5-46cc-b484-d5c6c35730c5 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] [instance: cabceac5-859e-4c28-86c2-aa9b63953009] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:34:25.628996 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-652aa462-68a5-46cc-b484-d5c6c35730c5 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:25.629847 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-652aa462-68a5-46cc-b484-d5c6c35730c5 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:25.630920 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-652aa462-68a5-46cc-b484-d5c6c35730c5 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:25.632067 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-652aa462-68a5-46cc-b484-d5c6c35730c5 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:25.798963 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-a6278ac2-efca-49e6-9360-54f712855094 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a38b5af1654f44bc6cb5832c2e8e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051b6a3defca48d7b4f8bb6705f89f20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:34:25.838327 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-a6278ac2-efca-49e6-9360-54f712855094 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] 10.222.0.121 "GET /compute/v2.1/servers/c6dec6e8-e2f9-4c57-8326-19fc989b5c6e" status: 200 len: 1371 microversion: 2.1 time: 0.639384 Aug 04 10:34:25.855275 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 137/288] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:34:25 2022] GET /compute/v2.1/servers/c6dec6e8-e2f9-4c57-8326-19fc989b5c6e => generated 1371 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:34:25.890761 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-f392f444-abcd-4c75-9544-5cd0ffe53eb4 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:34:25.895756 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-f392f444-abcd-4c75-9544-5cd0ffe53eb4 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] [instance: 81259012-5f3b-44f6-b979-39119f14929b] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:34:25.929728 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-f392f444-abcd-4c75-9544-5cd0ffe53eb4 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:25.930562 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-f392f444-abcd-4c75-9544-5cd0ffe53eb4 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:25.931989 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-f392f444-abcd-4c75-9544-5cd0ffe53eb4 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:25.932995 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-f392f444-abcd-4c75-9544-5cd0ffe53eb4 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:26.220085 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-652aa462-68a5-46cc-b484-d5c6c35730c5 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9520a49687b24281b78f08d43cb27dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c167faad577d47dfaf0d010a3f983fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:34:26.230258 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-652aa462-68a5-46cc-b484-d5c6c35730c5 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] 10.222.0.121 "GET /compute/v2.1/servers/cabceac5-859e-4c28-86c2-aa9b63953009" status: 200 len: 1318 microversion: 2.1 time: 0.615025 Aug 04 10:34:26.230878 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 152/289] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:34:25 2022] GET /compute/v2.1/servers/cabceac5-859e-4c28-86c2-aa9b63953009 => generated 1318 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:34:26.416584 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-f392f444-abcd-4c75-9544-5cd0ffe53eb4 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa2e2a5a6ed4c5c9db91269266dd30b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f46ab11dd0b428486c673afc14b5b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:34:26.434053 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-f392f444-abcd-4c75-9544-5cd0ffe53eb4 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] 10.222.0.121 "GET /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b" status: 200 len: 1366 microversion: 2.1 time: 0.576630 Aug 04 10:34:26.436949 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 138/290] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:34:25 2022] GET /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b => generated 1366 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:34:26.657248 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-03963153-ad47-4a04-9c3f-9584fba1be77 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:34:26.658309 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-03963153-ad47-4a04-9c3f-9584fba1be77 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] [instance: 2583b630-2f89-45ba-b781-c0b7c206d61e] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:34:26.669346 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-03963153-ad47-4a04-9c3f-9584fba1be77 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:26.681250 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-03963153-ad47-4a04-9c3f-9584fba1be77 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:26.682065 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-03963153-ad47-4a04-9c3f-9584fba1be77 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:26.682752 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-03963153-ad47-4a04-9c3f-9584fba1be77 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:26.868615 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-03963153-ad47-4a04-9c3f-9584fba1be77 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3170dc3323f54512bc8819c8efa86b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7121bd118a2549c39332cfdb7edaa92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:34:26.881504 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-03963153-ad47-4a04-9c3f-9584fba1be77 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] 10.222.0.121 "GET /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e" status: 200 len: 1325 microversion: 2.1 time: 0.231719 Aug 04 10:34:26.882649 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 153/291] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:34:26 2022] GET /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e => generated 1325 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:34:26.888282 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-a0d80a3c-5c90-48c8-87ac-06e4f4b2db23 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:34:26.888915 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-a0d80a3c-5c90-48c8-87ac-06e4f4b2db23 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] [instance: c6dec6e8-e2f9-4c57-8326-19fc989b5c6e] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:34:26.895975 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-a0d80a3c-5c90-48c8-87ac-06e4f4b2db23 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:26.896457 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-a0d80a3c-5c90-48c8-87ac-06e4f4b2db23 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:26.897252 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-a0d80a3c-5c90-48c8-87ac-06e4f4b2db23 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:26.897699 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-a0d80a3c-5c90-48c8-87ac-06e4f4b2db23 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:27.079213 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-a0d80a3c-5c90-48c8-87ac-06e4f4b2db23 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a38b5af1654f44bc6cb5832c2e8e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051b6a3defca48d7b4f8bb6705f89f20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:34:27.093170 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-a0d80a3c-5c90-48c8-87ac-06e4f4b2db23 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] 10.222.0.121 "GET /compute/v2.1/servers/c6dec6e8-e2f9-4c57-8326-19fc989b5c6e" status: 200 len: 1371 microversion: 2.1 time: 0.212354 Aug 04 10:34:27.093983 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 139/292] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:34:26 2022] GET /compute/v2.1/servers/c6dec6e8-e2f9-4c57-8326-19fc989b5c6e => generated 1371 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:34:27.251898 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-3af5bc64-127c-4768-83cd-d64f2bb8f0d1 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:34:27.252656 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-3af5bc64-127c-4768-83cd-d64f2bb8f0d1 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] [instance: cabceac5-859e-4c28-86c2-aa9b63953009] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:34:27.262953 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-3af5bc64-127c-4768-83cd-d64f2bb8f0d1 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:27.264363 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-3af5bc64-127c-4768-83cd-d64f2bb8f0d1 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:27.265939 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-3af5bc64-127c-4768-83cd-d64f2bb8f0d1 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:27.267120 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-3af5bc64-127c-4768-83cd-d64f2bb8f0d1 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:27.293703 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [req-32587306-846a-4681-a954-73fd93419a61 req-376317c0-9c68-4311-bb86-05fade56f4d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81259012-5f3b-44f6-b979-39119f14929b", "name": "network-vif-plugged", "status": "completed", "tag": "79122914-2885-4d97-bea8-a589e38d68d8"}]} {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:34:27.323480 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [req-32587306-846a-4681-a954-73fd93419a61 req-376317c0-9c68-4311-bb86-05fade56f4d8 service nova] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:27.330698 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [req-32587306-846a-4681-a954-73fd93419a61 req-376317c0-9c68-4311-bb86-05fade56f4d8 service nova] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:27.367176 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.compute.server_external_events [req-32587306-846a-4681-a954-73fd93419a61 req-376317c0-9c68-4311-bb86-05fade56f4d8 service nova] Creating event network-vif-plugged:79122914-2885-4d97-bea8-a589e38d68d8 for instance 81259012-5f3b-44f6-b979-39119f14929b on hv-cinder-85200 Aug 04 10:34:27.378034 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [req-32587306-846a-4681-a954-73fd93419a61 req-376317c0-9c68-4311-bb86-05fade56f4d8 service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088824 Aug 04 10:34:27.378689 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 140/293] 10.222.0.121 () {64 vars in 1322 bytes} [Thu Aug 4 10:34:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 10:34:27.470240 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-b21c743f-8f6c-4ad6-9798-82faae4cfc5c tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:34:27.473229 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-b21c743f-8f6c-4ad6-9798-82faae4cfc5c tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] [instance: 81259012-5f3b-44f6-b979-39119f14929b] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:34:27.475245 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-3af5bc64-127c-4768-83cd-d64f2bb8f0d1 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9520a49687b24281b78f08d43cb27dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c167faad577d47dfaf0d010a3f983fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:34:27.482636 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-b21c743f-8f6c-4ad6-9798-82faae4cfc5c tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:27.483210 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-b21c743f-8f6c-4ad6-9798-82faae4cfc5c tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:27.484424 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-b21c743f-8f6c-4ad6-9798-82faae4cfc5c tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:27.484660 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-3af5bc64-127c-4768-83cd-d64f2bb8f0d1 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] 10.222.0.121 "GET /compute/v2.1/servers/cabceac5-859e-4c28-86c2-aa9b63953009" status: 200 len: 1318 microversion: 2.1 time: 0.236789 Aug 04 10:34:27.485396 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-b21c743f-8f6c-4ad6-9798-82faae4cfc5c tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:27.486189 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 154/294] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:34:27 2022] GET /compute/v2.1/servers/cabceac5-859e-4c28-86c2-aa9b63953009 => generated 1318 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:34:27.705836 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-b21c743f-8f6c-4ad6-9798-82faae4cfc5c tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa2e2a5a6ed4c5c9db91269266dd30b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f46ab11dd0b428486c673afc14b5b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:34:27.714560 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-b21c743f-8f6c-4ad6-9798-82faae4cfc5c tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] 10.222.0.121 "GET /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b" status: 200 len: 1366 microversion: 2.1 time: 0.252062 Aug 04 10:34:27.716278 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 141/295] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:34:27 2022] GET /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b => generated 1366 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 10:34:27.916417 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-b5d25e47-e878-4c9e-8163-263dc58a0158 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:34:27.919124 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-b5d25e47-e878-4c9e-8163-263dc58a0158 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] [instance: 2583b630-2f89-45ba-b781-c0b7c206d61e] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:34:27.930271 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-b5d25e47-e878-4c9e-8163-263dc58a0158 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:27.931069 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-b5d25e47-e878-4c9e-8163-263dc58a0158 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:27.933961 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-b5d25e47-e878-4c9e-8163-263dc58a0158 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:27.934782 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-b5d25e47-e878-4c9e-8163-263dc58a0158 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:28.131475 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-146be918-4379-43c2-9caa-1b97d0ad9188 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:34:28.131906 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-146be918-4379-43c2-9caa-1b97d0ad9188 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] [instance: c6dec6e8-e2f9-4c57-8326-19fc989b5c6e] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:34:28.139109 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-146be918-4379-43c2-9caa-1b97d0ad9188 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:28.139553 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-146be918-4379-43c2-9caa-1b97d0ad9188 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:28.140728 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-146be918-4379-43c2-9caa-1b97d0ad9188 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:28.141541 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-146be918-4379-43c2-9caa-1b97d0ad9188 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:28.227917 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-b5d25e47-e878-4c9e-8163-263dc58a0158 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3170dc3323f54512bc8819c8efa86b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7121bd118a2549c39332cfdb7edaa92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:34:28.240450 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-b5d25e47-e878-4c9e-8163-263dc58a0158 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] 10.222.0.121 "GET /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e" status: 200 len: 1519 microversion: 2.1 time: 0.333688 Aug 04 10:34:28.242625 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 155/296] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:34:27 2022] GET /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e => generated 1519 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:34:28.268704 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-60c27bd4-34d7-43ba-9df6-d6d257326937 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:34:28.273406 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-60c27bd4-34d7-43ba-9df6-d6d257326937 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] [instance: 2583b630-2f89-45ba-b781-c0b7c206d61e] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:34:28.282946 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-60c27bd4-34d7-43ba-9df6-d6d257326937 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:28.283845 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-60c27bd4-34d7-43ba-9df6-d6d257326937 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:28.285299 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-60c27bd4-34d7-43ba-9df6-d6d257326937 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:28.286544 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-60c27bd4-34d7-43ba-9df6-d6d257326937 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:28.360393 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-146be918-4379-43c2-9caa-1b97d0ad9188 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a38b5af1654f44bc6cb5832c2e8e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051b6a3defca48d7b4f8bb6705f89f20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:34:28.369800 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-146be918-4379-43c2-9caa-1b97d0ad9188 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] 10.222.0.121 "GET /compute/v2.1/servers/c6dec6e8-e2f9-4c57-8326-19fc989b5c6e" status: 200 len: 1371 microversion: 2.1 time: 0.243309 Aug 04 10:34:28.371446 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 142/297] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:34:28 2022] GET /compute/v2.1/servers/c6dec6e8-e2f9-4c57-8326-19fc989b5c6e => generated 1371 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:34:28.381687 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.objects.instance [None req-60c27bd4-34d7-43ba-9df6-d6d257326937 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lazy-loading 'flavor' on Instance uuid 2583b630-2f89-45ba-b781-c0b7c206d61e {{(pid=124457) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 10:34:28.512877 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-a7ab9876-c3a5-4346-abe5-a6c1d17f9bc6 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:34:28.513727 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-a7ab9876-c3a5-4346-abe5-a6c1d17f9bc6 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] [instance: cabceac5-859e-4c28-86c2-aa9b63953009] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:34:28.526854 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-a7ab9876-c3a5-4346-abe5-a6c1d17f9bc6 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:28.527204 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-a7ab9876-c3a5-4346-abe5-a6c1d17f9bc6 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:28.531150 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-a7ab9876-c3a5-4346-abe5-a6c1d17f9bc6 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:28.533250 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-a7ab9876-c3a5-4346-abe5-a6c1d17f9bc6 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:28.605108 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-60c27bd4-34d7-43ba-9df6-d6d257326937 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] 10.222.0.121 "POST /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e/action" status: 200 len: 32 microversion: 2.1 time: 0.343814 Aug 04 10:34:28.605841 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 156/298] 10.222.0.121 () {60 vars in 1283 bytes} [Thu Aug 4 10:34:28 2022] POST /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e/action => generated 32 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 04 10:34:28.620962 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-585f7a85-d83a-4946-a192-6ad4a445b47e tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:34:28.621885 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-585f7a85-d83a-4946-a192-6ad4a445b47e tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] [instance: 2583b630-2f89-45ba-b781-c0b7c206d61e] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:34:28.630651 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-585f7a85-d83a-4946-a192-6ad4a445b47e tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:28.631422 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-585f7a85-d83a-4946-a192-6ad4a445b47e tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:28.632696 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-585f7a85-d83a-4946-a192-6ad4a445b47e tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:28.633330 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-585f7a85-d83a-4946-a192-6ad4a445b47e tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:28.851575 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-a7ab9876-c3a5-4346-abe5-a6c1d17f9bc6 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9520a49687b24281b78f08d43cb27dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c167faad577d47dfaf0d010a3f983fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:34:28.865294 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-a7ab9876-c3a5-4346-abe5-a6c1d17f9bc6 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] 10.222.0.121 "GET /compute/v2.1/servers/cabceac5-859e-4c28-86c2-aa9b63953009" status: 200 len: 1318 microversion: 2.1 time: 0.357288 Aug 04 10:34:28.866220 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 143/299] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:34:28 2022] GET /compute/v2.1/servers/cabceac5-859e-4c28-86c2-aa9b63953009 => generated 1318 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:34:28.888138 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-82369016-d211-43be-bfe3-e147862f9f75 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:34:28.889455 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-82369016-d211-43be-bfe3-e147862f9f75 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] [instance: 81259012-5f3b-44f6-b979-39119f14929b] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:34:28.897345 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-82369016-d211-43be-bfe3-e147862f9f75 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:28.897980 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-82369016-d211-43be-bfe3-e147862f9f75 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:28.899111 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-82369016-d211-43be-bfe3-e147862f9f75 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:28.899902 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-82369016-d211-43be-bfe3-e147862f9f75 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:28.977500 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-585f7a85-d83a-4946-a192-6ad4a445b47e tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3170dc3323f54512bc8819c8efa86b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7121bd118a2549c39332cfdb7edaa92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:34:28.992805 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-585f7a85-d83a-4946-a192-6ad4a445b47e tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] 10.222.0.121 "GET /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e" status: 200 len: 1525 microversion: 2.1 time: 0.378361 Aug 04 10:34:28.993772 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 157/300] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:34:28 2022] GET /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e => generated 1525 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:34:29.135332 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-82369016-d211-43be-bfe3-e147862f9f75 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa2e2a5a6ed4c5c9db91269266dd30b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f46ab11dd0b428486c673afc14b5b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:34:29.151306 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-82369016-d211-43be-bfe3-e147862f9f75 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] 10.222.0.121 "GET /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b" status: 200 len: 1366 microversion: 2.1 time: 0.268948 Aug 04 10:34:29.178071 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 144/301] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:34:28 2022] GET /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b => generated 1366 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:34:29.396682 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-970d9c59-5717-4f98-885b-b1299cd4018e tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:34:29.397759 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-970d9c59-5717-4f98-885b-b1299cd4018e tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] [instance: c6dec6e8-e2f9-4c57-8326-19fc989b5c6e] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:34:29.407727 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-970d9c59-5717-4f98-885b-b1299cd4018e tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:29.408499 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-970d9c59-5717-4f98-885b-b1299cd4018e tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:29.410370 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-970d9c59-5717-4f98-885b-b1299cd4018e tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:29.411375 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-970d9c59-5717-4f98-885b-b1299cd4018e tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:29.896566 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-50420126-35b1-4ba1-8ed0-40d15c08f25d tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:34:29.897524 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-50420126-35b1-4ba1-8ed0-40d15c08f25d tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] [instance: cabceac5-859e-4c28-86c2-aa9b63953009] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:34:29.907515 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-50420126-35b1-4ba1-8ed0-40d15c08f25d tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:29.908292 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-50420126-35b1-4ba1-8ed0-40d15c08f25d tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:29.910851 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-50420126-35b1-4ba1-8ed0-40d15c08f25d tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:29.916596 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-50420126-35b1-4ba1-8ed0-40d15c08f25d tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:29.965354 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-970d9c59-5717-4f98-885b-b1299cd4018e tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a38b5af1654f44bc6cb5832c2e8e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051b6a3defca48d7b4f8bb6705f89f20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:34:29.975549 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-970d9c59-5717-4f98-885b-b1299cd4018e tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] 10.222.0.121 "GET /compute/v2.1/servers/c6dec6e8-e2f9-4c57-8326-19fc989b5c6e" status: 200 len: 1371 microversion: 2.1 time: 0.585382 Aug 04 10:34:29.990725 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 158/302] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:34:29 2022] GET /compute/v2.1/servers/c6dec6e8-e2f9-4c57-8326-19fc989b5c6e => generated 1371 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:34:30.035010 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-295c8d54-5481-4835-8805-c9acd25efd77 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:34:30.036625 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-295c8d54-5481-4835-8805-c9acd25efd77 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] [instance: 2583b630-2f89-45ba-b781-c0b7c206d61e] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:34:30.060576 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-295c8d54-5481-4835-8805-c9acd25efd77 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:30.064862 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-295c8d54-5481-4835-8805-c9acd25efd77 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:30.072625 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-295c8d54-5481-4835-8805-c9acd25efd77 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:30.073663 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-295c8d54-5481-4835-8805-c9acd25efd77 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:30.475472 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-50420126-35b1-4ba1-8ed0-40d15c08f25d tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9520a49687b24281b78f08d43cb27dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c167faad577d47dfaf0d010a3f983fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:34:30.481949 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-295c8d54-5481-4835-8805-c9acd25efd77 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3170dc3323f54512bc8819c8efa86b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7121bd118a2549c39332cfdb7edaa92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:34:30.492259 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-295c8d54-5481-4835-8805-c9acd25efd77 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] 10.222.0.121 "GET /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e" status: 200 len: 1525 microversion: 2.1 time: 0.464401 Aug 04 10:34:30.493156 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 159/303] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:34:30 2022] GET /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e => generated 1525 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:34:30.505152 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-50420126-35b1-4ba1-8ed0-40d15c08f25d tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] 10.222.0.121 "GET /compute/v2.1/servers/cabceac5-859e-4c28-86c2-aa9b63953009" status: 200 len: 1318 microversion: 2.1 time: 0.612261 Aug 04 10:34:30.508646 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 145/304] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:34:29 2022] GET /compute/v2.1/servers/cabceac5-859e-4c28-86c2-aa9b63953009 => generated 1318 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:34:30.517420 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-256ac00f-1ab4-451a-bb9c-5c121109f260 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:34:30.518279 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-256ac00f-1ab4-451a-bb9c-5c121109f260 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] [instance: 81259012-5f3b-44f6-b979-39119f14929b] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:34:30.528315 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-256ac00f-1ab4-451a-bb9c-5c121109f260 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:30.528823 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-256ac00f-1ab4-451a-bb9c-5c121109f260 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:30.529980 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-256ac00f-1ab4-451a-bb9c-5c121109f260 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:30.530713 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-256ac00f-1ab4-451a-bb9c-5c121109f260 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:30.856529 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-256ac00f-1ab4-451a-bb9c-5c121109f260 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa2e2a5a6ed4c5c9db91269266dd30b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f46ab11dd0b428486c673afc14b5b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:34:30.868515 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-256ac00f-1ab4-451a-bb9c-5c121109f260 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] 10.222.0.121 "GET /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b" status: 200 len: 1366 microversion: 2.1 time: 0.373776 Aug 04 10:34:30.869900 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 160/305] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:34:30 2022] GET /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b => generated 1366 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:34:31.002473 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-b8e8cf71-2853-4ef0-95ac-52cef0f726b6 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:34:31.003607 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-b8e8cf71-2853-4ef0-95ac-52cef0f726b6 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] [instance: c6dec6e8-e2f9-4c57-8326-19fc989b5c6e] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:34:31.016040 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-b8e8cf71-2853-4ef0-95ac-52cef0f726b6 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:31.017214 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-b8e8cf71-2853-4ef0-95ac-52cef0f726b6 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:31.018959 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-b8e8cf71-2853-4ef0-95ac-52cef0f726b6 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:31.020072 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-b8e8cf71-2853-4ef0-95ac-52cef0f726b6 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:31.273139 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-b8e8cf71-2853-4ef0-95ac-52cef0f726b6 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a38b5af1654f44bc6cb5832c2e8e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051b6a3defca48d7b4f8bb6705f89f20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:34:31.293483 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-b8e8cf71-2853-4ef0-95ac-52cef0f726b6 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] 10.222.0.121 "GET /compute/v2.1/servers/c6dec6e8-e2f9-4c57-8326-19fc989b5c6e" status: 200 len: 1560 microversion: 2.1 time: 0.298825 Aug 04 10:34:31.304601 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 146/306] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:34:30 2022] GET /compute/v2.1/servers/c6dec6e8-e2f9-4c57-8326-19fc989b5c6e => generated 1560 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:34:31.336153 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-faff04fb-19df-4f8f-a0d2-5eda134e73cb tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:34:31.336985 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-faff04fb-19df-4f8f-a0d2-5eda134e73cb tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] [instance: c6dec6e8-e2f9-4c57-8326-19fc989b5c6e] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:34:31.349611 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-faff04fb-19df-4f8f-a0d2-5eda134e73cb tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:31.350966 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-faff04fb-19df-4f8f-a0d2-5eda134e73cb tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:31.352873 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-faff04fb-19df-4f8f-a0d2-5eda134e73cb tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:31.354400 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-faff04fb-19df-4f8f-a0d2-5eda134e73cb tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:31.544434 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-86086b2b-853d-4485-b84c-c75c5af13843 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:34:31.545146 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-86086b2b-853d-4485-b84c-c75c5af13843 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] [instance: 2583b630-2f89-45ba-b781-c0b7c206d61e] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:34:31.551152 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-faff04fb-19df-4f8f-a0d2-5eda134e73cb tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] 10.222.0.121 "GET /compute/v2.1/servers/c6dec6e8-e2f9-4c57-8326-19fc989b5c6e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.221463 Aug 04 10:34:31.553212 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 161/307] 10.222.0.121 () {58 vars in 1280 bytes} [Thu Aug 4 10:34:31 2022] GET /compute/v2.1/servers/c6dec6e8-e2f9-4c57-8326-19fc989b5c6e/os-interface => generated 284 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:34:31.563136 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-3fd98f31-693a-4890-af96-cadbaf48b056 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:34:31.568140 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-3fd98f31-693a-4890-af96-cadbaf48b056 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] [instance: cabceac5-859e-4c28-86c2-aa9b63953009] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:34:31.571867 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-86086b2b-853d-4485-b84c-c75c5af13843 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:31.572753 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-86086b2b-853d-4485-b84c-c75c5af13843 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:31.574267 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-86086b2b-853d-4485-b84c-c75c5af13843 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:31.576545 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-86086b2b-853d-4485-b84c-c75c5af13843 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:31.586370 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-3fd98f31-693a-4890-af96-cadbaf48b056 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:31.589577 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-3fd98f31-693a-4890-af96-cadbaf48b056 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:31.591595 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-3fd98f31-693a-4890-af96-cadbaf48b056 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:31.594255 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-3fd98f31-693a-4890-af96-cadbaf48b056 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:32.042899 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-3fd98f31-693a-4890-af96-cadbaf48b056 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9520a49687b24281b78f08d43cb27dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c167faad577d47dfaf0d010a3f983fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:34:32.063694 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-3fd98f31-693a-4890-af96-cadbaf48b056 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] 10.222.0.121 "GET /compute/v2.1/servers/cabceac5-859e-4c28-86c2-aa9b63953009" status: 200 len: 1505 microversion: 2.1 time: 0.506067 Aug 04 10:34:32.067178 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 162/308] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:34:31 2022] GET /compute/v2.1/servers/cabceac5-859e-4c28-86c2-aa9b63953009 => generated 1505 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:34:32.078580 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-1fe6a566-7d5d-41f3-ab23-fce597aa409f tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:34:32.079043 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-86086b2b-853d-4485-b84c-c75c5af13843 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3170dc3323f54512bc8819c8efa86b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7121bd118a2549c39332cfdb7edaa92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:34:32.079816 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-1fe6a566-7d5d-41f3-ab23-fce597aa409f tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] [instance: 81259012-5f3b-44f6-b979-39119f14929b] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:34:32.104357 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-86086b2b-853d-4485-b84c-c75c5af13843 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] 10.222.0.121 "GET /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e" status: 200 len: 1525 microversion: 2.1 time: 0.581546 Aug 04 10:34:32.105049 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 147/309] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:34:31 2022] GET /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e => generated 1525 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:34:32.107651 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-1fe6a566-7d5d-41f3-ab23-fce597aa409f tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:32.108583 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-1fe6a566-7d5d-41f3-ab23-fce597aa409f tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:32.109669 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-1fe6a566-7d5d-41f3-ab23-fce597aa409f tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:32.110283 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-1fe6a566-7d5d-41f3-ab23-fce597aa409f tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:32.319089 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-1fe6a566-7d5d-41f3-ab23-fce597aa409f tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa2e2a5a6ed4c5c9db91269266dd30b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f46ab11dd0b428486c673afc14b5b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:34:32.352925 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-1fe6a566-7d5d-41f3-ab23-fce597aa409f tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] 10.222.0.121 "GET /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b" status: 200 len: 1366 microversion: 2.1 time: 0.283694 Aug 04 10:34:32.367991 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 163/310] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:34:32 2022] GET /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b => generated 1366 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:34:33.147989 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-d9ea6e38-0b16-4fe7-8d72-6c3e6611948c tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:34:33.149243 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-d9ea6e38-0b16-4fe7-8d72-6c3e6611948c tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] [instance: 2583b630-2f89-45ba-b781-c0b7c206d61e] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:34:33.157395 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-d9ea6e38-0b16-4fe7-8d72-6c3e6611948c tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:33.157863 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-d9ea6e38-0b16-4fe7-8d72-6c3e6611948c tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:33.158777 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-d9ea6e38-0b16-4fe7-8d72-6c3e6611948c tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:33.159228 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-d9ea6e38-0b16-4fe7-8d72-6c3e6611948c tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:33.395139 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-7d5fa47e-5289-4ca3-a820-6d97fbd5335a tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:34:33.395810 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-7d5fa47e-5289-4ca3-a820-6d97fbd5335a tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] [instance: 81259012-5f3b-44f6-b979-39119f14929b] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:34:33.401980 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-d9ea6e38-0b16-4fe7-8d72-6c3e6611948c tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3170dc3323f54512bc8819c8efa86b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7121bd118a2549c39332cfdb7edaa92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:34:33.406782 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-7d5fa47e-5289-4ca3-a820-6d97fbd5335a tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:33.407573 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-7d5fa47e-5289-4ca3-a820-6d97fbd5335a tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:33.408619 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-7d5fa47e-5289-4ca3-a820-6d97fbd5335a tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:33.409238 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-7d5fa47e-5289-4ca3-a820-6d97fbd5335a tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:33.412680 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-d9ea6e38-0b16-4fe7-8d72-6c3e6611948c tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] 10.222.0.121 "GET /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e" status: 200 len: 1525 microversion: 2.1 time: 0.271487 Aug 04 10:34:33.413710 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 148/311] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:34:33 2022] GET /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e => generated 1525 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 10:34:33.572550 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-7d5fa47e-5289-4ca3-a820-6d97fbd5335a tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa2e2a5a6ed4c5c9db91269266dd30b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f46ab11dd0b428486c673afc14b5b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:34:33.586670 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-7d5fa47e-5289-4ca3-a820-6d97fbd5335a tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] 10.222.0.121 "GET /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b" status: 200 len: 1550 microversion: 2.1 time: 0.197446 Aug 04 10:34:33.588974 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 164/312] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:34:33 2022] GET /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b => generated 1550 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:34:33.614965 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-86b81640-3db0-4234-96bb-c85aae8dae77 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:34:33.615486 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-86b81640-3db0-4234-96bb-c85aae8dae77 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] [instance: 81259012-5f3b-44f6-b979-39119f14929b] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:34:33.623919 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-86b81640-3db0-4234-96bb-c85aae8dae77 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:33.624653 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-86b81640-3db0-4234-96bb-c85aae8dae77 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:33.625480 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-86b81640-3db0-4234-96bb-c85aae8dae77 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:33.626133 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-86b81640-3db0-4234-96bb-c85aae8dae77 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:33.650934 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [req-3939f347-c187-43e9-914e-0ec9cb27c6f9 req-b1649096-9f4c-41a2-89d8-f02ab2cd6915 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c6dec6e8-e2f9-4c57-8326-19fc989b5c6e", "tag": "03bbc55a-5c71-4f8b-8a66-c3b18135d94a"}]} {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:34:33.663059 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [req-3939f347-c187-43e9-914e-0ec9cb27c6f9 req-b1649096-9f4c-41a2-89d8-f02ab2cd6915 service nova] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:33.663506 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [req-3939f347-c187-43e9-914e-0ec9cb27c6f9 req-b1649096-9f4c-41a2-89d8-f02ab2cd6915 service nova] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:33.679375 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.compute.server_external_events [req-3939f347-c187-43e9-914e-0ec9cb27c6f9 req-b1649096-9f4c-41a2-89d8-f02ab2cd6915 service nova] Creating event network-changed:03bbc55a-5c71-4f8b-8a66-c3b18135d94a for instance c6dec6e8-e2f9-4c57-8326-19fc989b5c6e on hv-cinder-85200 Aug 04 10:34:33.685471 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [req-3939f347-c187-43e9-914e-0ec9cb27c6f9 req-b1649096-9f4c-41a2-89d8-f02ab2cd6915 service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038055 Aug 04 10:34:33.690284 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 165/313] 10.222.0.121 () {64 vars in 1322 bytes} [Thu Aug 4 10:34:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 10:34:33.800612 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-86b81640-3db0-4234-96bb-c85aae8dae77 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] 10.222.0.121 "GET /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.191916 Aug 04 10:34:33.801493 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 149/314] 10.222.0.121 () {58 vars in 1280 bytes} [Thu Aug 4 10:34:33 2022] GET /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b/os-interface => generated 284 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:34:34.436903 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-f0afad4f-71a5-4c50-8920-4c871bbd351b tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:34:34.437812 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-f0afad4f-71a5-4c50-8920-4c871bbd351b tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] [instance: 2583b630-2f89-45ba-b781-c0b7c206d61e] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:34:34.445922 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-f0afad4f-71a5-4c50-8920-4c871bbd351b tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:34.446524 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-f0afad4f-71a5-4c50-8920-4c871bbd351b tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:34.447429 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-f0afad4f-71a5-4c50-8920-4c871bbd351b tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:34.448227 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-f0afad4f-71a5-4c50-8920-4c871bbd351b tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:34.636700 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-f0afad4f-71a5-4c50-8920-4c871bbd351b tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3170dc3323f54512bc8819c8efa86b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7121bd118a2549c39332cfdb7edaa92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:34:34.650988 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-f0afad4f-71a5-4c50-8920-4c871bbd351b tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] 10.222.0.121 "GET /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e" status: 200 len: 1525 microversion: 2.1 time: 0.219256 Aug 04 10:34:34.651599 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 166/315] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:34:34 2022] GET /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e => generated 1525 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:34:35.674143 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-aa9ac9c8-39ae-43f5-ba9b-ef90ad0743f5 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:34:35.674750 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-aa9ac9c8-39ae-43f5-ba9b-ef90ad0743f5 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] [instance: 2583b630-2f89-45ba-b781-c0b7c206d61e] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:34:35.681193 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-aa9ac9c8-39ae-43f5-ba9b-ef90ad0743f5 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:35.681646 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-aa9ac9c8-39ae-43f5-ba9b-ef90ad0743f5 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:35.682460 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-aa9ac9c8-39ae-43f5-ba9b-ef90ad0743f5 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:35.682907 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-aa9ac9c8-39ae-43f5-ba9b-ef90ad0743f5 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:35.703444 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [req-6f5375f5-fcc5-42f8-8776-f7d1871786d4 req-05abafdb-65e9-4693-8371-e11ae8fde3eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "81259012-5f3b-44f6-b979-39119f14929b", "tag": "79122914-2885-4d97-bea8-a589e38d68d8"}]} {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:34:35.714785 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [req-6f5375f5-fcc5-42f8-8776-f7d1871786d4 req-05abafdb-65e9-4693-8371-e11ae8fde3eb service nova] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:35.715683 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [req-6f5375f5-fcc5-42f8-8776-f7d1871786d4 req-05abafdb-65e9-4693-8371-e11ae8fde3eb service nova] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:35.728094 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG dbcounter [-] [124457] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:34:35.741421 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.compute.server_external_events [req-6f5375f5-fcc5-42f8-8776-f7d1871786d4 req-05abafdb-65e9-4693-8371-e11ae8fde3eb service nova] Creating event network-changed:79122914-2885-4d97-bea8-a589e38d68d8 for instance 81259012-5f3b-44f6-b979-39119f14929b on hv-cinder-85200 Aug 04 10:34:35.747553 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [req-6f5375f5-fcc5-42f8-8776-f7d1871786d4 req-05abafdb-65e9-4693-8371-e11ae8fde3eb service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049136 Aug 04 10:34:35.748549 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 167/316] 10.222.0.121 () {64 vars in 1322 bytes} [Thu Aug 4 10:34:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:34:35.843812 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-aa9ac9c8-39ae-43f5-ba9b-ef90ad0743f5 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3170dc3323f54512bc8819c8efa86b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7121bd118a2549c39332cfdb7edaa92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:34:35.858077 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-aa9ac9c8-39ae-43f5-ba9b-ef90ad0743f5 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] 10.222.0.121 "GET /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e" status: 200 len: 1525 microversion: 2.1 time: 0.188285 Aug 04 10:34:35.868181 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 150/317] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:34:35 2022] GET /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e => generated 1525 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:34:36.894107 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-668b188e-fe07-47cf-bf31-2b4155c4c3a0 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:34:36.894818 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-668b188e-fe07-47cf-bf31-2b4155c4c3a0 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] [instance: 2583b630-2f89-45ba-b781-c0b7c206d61e] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:34:36.901998 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-668b188e-fe07-47cf-bf31-2b4155c4c3a0 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:36.902736 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-668b188e-fe07-47cf-bf31-2b4155c4c3a0 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:36.903535 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-668b188e-fe07-47cf-bf31-2b4155c4c3a0 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:36.904006 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-668b188e-fe07-47cf-bf31-2b4155c4c3a0 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:37.051068 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-668b188e-fe07-47cf-bf31-2b4155c4c3a0 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3170dc3323f54512bc8819c8efa86b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7121bd118a2549c39332cfdb7edaa92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:34:37.060909 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-668b188e-fe07-47cf-bf31-2b4155c4c3a0 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] 10.222.0.121 "GET /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e" status: 200 len: 1525 microversion: 2.1 time: 0.171583 Aug 04 10:34:37.061880 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 168/318] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:34:36 2022] GET /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e => generated 1525 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:34:38.095066 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-c694c279-ef26-4f87-ab66-cb7cf3df046f tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:34:38.095846 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-c694c279-ef26-4f87-ab66-cb7cf3df046f tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] [instance: 2583b630-2f89-45ba-b781-c0b7c206d61e] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:34:38.103532 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-c694c279-ef26-4f87-ab66-cb7cf3df046f tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:38.104071 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-c694c279-ef26-4f87-ab66-cb7cf3df046f tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:38.104914 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-c694c279-ef26-4f87-ab66-cb7cf3df046f tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:38.105374 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-c694c279-ef26-4f87-ab66-cb7cf3df046f tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:38.260528 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-c694c279-ef26-4f87-ab66-cb7cf3df046f tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3170dc3323f54512bc8819c8efa86b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7121bd118a2549c39332cfdb7edaa92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:34:38.270129 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-c694c279-ef26-4f87-ab66-cb7cf3df046f tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] 10.222.0.121 "GET /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e" status: 200 len: 1525 microversion: 2.1 time: 0.179312 Aug 04 10:34:38.270768 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 151/319] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:34:38 2022] GET /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e => generated 1525 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:34:39.291489 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-f837ee44-7099-4f33-ac7e-f25167f978f0 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:34:39.292214 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-f837ee44-7099-4f33-ac7e-f25167f978f0 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] [instance: 2583b630-2f89-45ba-b781-c0b7c206d61e] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:34:39.299264 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-f837ee44-7099-4f33-ac7e-f25167f978f0 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:39.299790 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-f837ee44-7099-4f33-ac7e-f25167f978f0 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:39.300646 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-f837ee44-7099-4f33-ac7e-f25167f978f0 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:39.301097 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-f837ee44-7099-4f33-ac7e-f25167f978f0 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:39.451589 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-f837ee44-7099-4f33-ac7e-f25167f978f0 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3170dc3323f54512bc8819c8efa86b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7121bd118a2549c39332cfdb7edaa92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:34:39.460579 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-f837ee44-7099-4f33-ac7e-f25167f978f0 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] 10.222.0.121 "GET /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e" status: 200 len: 1525 microversion: 2.1 time: 0.173310 Aug 04 10:34:39.461192 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 169/320] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:34:39 2022] GET /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e => generated 1525 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:34:40.483815 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-a78ebb24-9519-4630-b5d4-6c7b0ec04c90 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:34:40.484591 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-a78ebb24-9519-4630-b5d4-6c7b0ec04c90 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] [instance: 2583b630-2f89-45ba-b781-c0b7c206d61e] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:34:40.491758 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-a78ebb24-9519-4630-b5d4-6c7b0ec04c90 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:40.492332 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-a78ebb24-9519-4630-b5d4-6c7b0ec04c90 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:40.493128 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-a78ebb24-9519-4630-b5d4-6c7b0ec04c90 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:40.493596 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-a78ebb24-9519-4630-b5d4-6c7b0ec04c90 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:40.655261 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-a78ebb24-9519-4630-b5d4-6c7b0ec04c90 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3170dc3323f54512bc8819c8efa86b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7121bd118a2549c39332cfdb7edaa92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:34:40.663497 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-a78ebb24-9519-4630-b5d4-6c7b0ec04c90 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] 10.222.0.121 "GET /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e" status: 200 len: 1525 microversion: 2.1 time: 0.183783 Aug 04 10:34:40.664144 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 152/321] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:34:40 2022] GET /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e => generated 1525 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:34:41.685962 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-a708d02b-2f00-4076-98fb-af6e75a4cfff tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:34:41.686585 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-a708d02b-2f00-4076-98fb-af6e75a4cfff tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] [instance: 2583b630-2f89-45ba-b781-c0b7c206d61e] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:34:41.694187 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-a708d02b-2f00-4076-98fb-af6e75a4cfff tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:41.694636 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-a708d02b-2f00-4076-98fb-af6e75a4cfff tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:41.695484 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-a708d02b-2f00-4076-98fb-af6e75a4cfff tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:41.695924 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-a708d02b-2f00-4076-98fb-af6e75a4cfff tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:42.065426 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-a708d02b-2f00-4076-98fb-af6e75a4cfff tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3170dc3323f54512bc8819c8efa86b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7121bd118a2549c39332cfdb7edaa92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:34:42.073927 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-a708d02b-2f00-4076-98fb-af6e75a4cfff tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] 10.222.0.121 "GET /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e" status: 200 len: 1525 microversion: 2.1 time: 0.391939 Aug 04 10:34:42.074537 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 170/322] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:34:41 2022] GET /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e => generated 1525 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:34:43.096295 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-37cd1936-2b19-4821-ba16-b5849966acc2 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:34:43.097046 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-37cd1936-2b19-4821-ba16-b5849966acc2 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] [instance: 2583b630-2f89-45ba-b781-c0b7c206d61e] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:34:43.104589 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-37cd1936-2b19-4821-ba16-b5849966acc2 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:43.105030 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-37cd1936-2b19-4821-ba16-b5849966acc2 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:43.106080 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-37cd1936-2b19-4821-ba16-b5849966acc2 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:43.106742 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-37cd1936-2b19-4821-ba16-b5849966acc2 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:43.275005 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-37cd1936-2b19-4821-ba16-b5849966acc2 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3170dc3323f54512bc8819c8efa86b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7121bd118a2549c39332cfdb7edaa92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:34:43.278723 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG dbcounter [-] [124456] Writing DB stats nova_cell1:SELECT=100 {{(pid=124456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:34:43.284008 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-37cd1936-2b19-4821-ba16-b5849966acc2 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] 10.222.0.121 "GET /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e" status: 200 len: 1525 microversion: 2.1 time: 0.192449 Aug 04 10:34:43.289640 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 153/323] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:34:43 2022] GET /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e => generated 1525 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:34:44.306874 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-24e82047-5698-4a65-a145-85817537e81a tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:34:44.307588 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-24e82047-5698-4a65-a145-85817537e81a tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] [instance: 2583b630-2f89-45ba-b781-c0b7c206d61e] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:34:44.314518 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-24e82047-5698-4a65-a145-85817537e81a tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:44.314970 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-24e82047-5698-4a65-a145-85817537e81a tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:44.315756 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-24e82047-5698-4a65-a145-85817537e81a tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:44.316338 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-24e82047-5698-4a65-a145-85817537e81a tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:44.473736 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-24e82047-5698-4a65-a145-85817537e81a tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3170dc3323f54512bc8819c8efa86b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7121bd118a2549c39332cfdb7edaa92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:34:44.482075 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-24e82047-5698-4a65-a145-85817537e81a tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] 10.222.0.121 "GET /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e" status: 200 len: 1525 microversion: 2.1 time: 0.179739 Aug 04 10:34:44.482647 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 171/324] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:34:44 2022] GET /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e => generated 1525 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:34:45.504004 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-47bf2576-ab80-432a-8897-2ecd0286ce67 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:34:45.504694 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-47bf2576-ab80-432a-8897-2ecd0286ce67 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] [instance: 2583b630-2f89-45ba-b781-c0b7c206d61e] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:34:45.513217 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-47bf2576-ab80-432a-8897-2ecd0286ce67 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:45.514023 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-47bf2576-ab80-432a-8897-2ecd0286ce67 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:45.515080 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-47bf2576-ab80-432a-8897-2ecd0286ce67 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:45.515716 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-47bf2576-ab80-432a-8897-2ecd0286ce67 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:45.675234 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-47bf2576-ab80-432a-8897-2ecd0286ce67 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3170dc3323f54512bc8819c8efa86b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7121bd118a2549c39332cfdb7edaa92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:34:45.683127 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-47bf2576-ab80-432a-8897-2ecd0286ce67 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] 10.222.0.121 "GET /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e" status: 200 len: 1525 microversion: 2.1 time: 0.183200 Aug 04 10:34:45.683914 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 154/325] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:34:45 2022] GET /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e => generated 1525 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:34:46.705576 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-35c1d318-c3a9-4fd3-ab21-9aa10e566416 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:34:46.706626 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-35c1d318-c3a9-4fd3-ab21-9aa10e566416 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] [instance: 2583b630-2f89-45ba-b781-c0b7c206d61e] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:34:46.714384 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-35c1d318-c3a9-4fd3-ab21-9aa10e566416 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:46.714818 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-35c1d318-c3a9-4fd3-ab21-9aa10e566416 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:46.715700 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-35c1d318-c3a9-4fd3-ab21-9aa10e566416 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:46.716228 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-35c1d318-c3a9-4fd3-ab21-9aa10e566416 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:46.856544 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-35c1d318-c3a9-4fd3-ab21-9aa10e566416 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3170dc3323f54512bc8819c8efa86b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7121bd118a2549c39332cfdb7edaa92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:34:46.865344 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-35c1d318-c3a9-4fd3-ab21-9aa10e566416 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] 10.222.0.121 "GET /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e" status: 200 len: 1525 microversion: 2.1 time: 0.164691 Aug 04 10:34:46.865917 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 172/326] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:34:46 2022] GET /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e => generated 1525 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:34:47.891379 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-4b657e34-5935-4ad8-8658-89c59b07d345 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:34:47.892139 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-4b657e34-5935-4ad8-8658-89c59b07d345 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] [instance: 2583b630-2f89-45ba-b781-c0b7c206d61e] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:34:47.904427 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-4b657e34-5935-4ad8-8658-89c59b07d345 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:47.904988 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-4b657e34-5935-4ad8-8658-89c59b07d345 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:47.905801 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-4b657e34-5935-4ad8-8658-89c59b07d345 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:47.906254 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-4b657e34-5935-4ad8-8658-89c59b07d345 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:48.329250 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-4b657e34-5935-4ad8-8658-89c59b07d345 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3170dc3323f54512bc8819c8efa86b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7121bd118a2549c39332cfdb7edaa92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:34:48.337575 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-4b657e34-5935-4ad8-8658-89c59b07d345 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] 10.222.0.121 "GET /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e" status: 200 len: 1525 microversion: 2.1 time: 0.452939 Aug 04 10:34:48.338507 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 155/327] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:34:47 2022] GET /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e => generated 1525 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:34:49.359830 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-7ed199f6-a990-4968-9f09-16f17ed374ad tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:34:49.360612 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-7ed199f6-a990-4968-9f09-16f17ed374ad tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] [instance: 2583b630-2f89-45ba-b781-c0b7c206d61e] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:34:49.367557 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-7ed199f6-a990-4968-9f09-16f17ed374ad tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:49.368031 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-7ed199f6-a990-4968-9f09-16f17ed374ad tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:49.368847 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-7ed199f6-a990-4968-9f09-16f17ed374ad tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:49.369309 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-7ed199f6-a990-4968-9f09-16f17ed374ad tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:49.511899 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-7ed199f6-a990-4968-9f09-16f17ed374ad tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3170dc3323f54512bc8819c8efa86b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7121bd118a2549c39332cfdb7edaa92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:34:49.521793 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-7ed199f6-a990-4968-9f09-16f17ed374ad tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] 10.222.0.121 "GET /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e" status: 200 len: 1525 microversion: 2.1 time: 0.166084 Aug 04 10:34:49.522451 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 173/328] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:34:49 2022] GET /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e => generated 1525 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:34:50.557912 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-9370a9bb-0bc0-4973-bf13-5318765c8ca8 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:34:50.557912 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-9370a9bb-0bc0-4973-bf13-5318765c8ca8 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] [instance: 2583b630-2f89-45ba-b781-c0b7c206d61e] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:34:50.563231 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG dbcounter [-] [124456] Writing DB stats nova_api:SELECT=56 {{(pid=124456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:34:50.564815 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-9370a9bb-0bc0-4973-bf13-5318765c8ca8 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:50.567696 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-9370a9bb-0bc0-4973-bf13-5318765c8ca8 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:50.568599 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-9370a9bb-0bc0-4973-bf13-5318765c8ca8 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:50.569569 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-9370a9bb-0bc0-4973-bf13-5318765c8ca8 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:50.764432 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-ff068400-e717-4beb-a3cb-4ce111aa4d65 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cbf33575-7cca-4119-8541-5e70d2800d83"}} {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:34:50.767089 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-ff068400-e717-4beb-a3cb-4ce111aa4d65 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] [instance: cabceac5-859e-4c28-86c2-aa9b63953009] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:34:50.773978 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-ff068400-e717-4beb-a3cb-4ce111aa4d65 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:50.774437 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-ff068400-e717-4beb-a3cb-4ce111aa4d65 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:50.775581 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-ff068400-e717-4beb-a3cb-4ce111aa4d65 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:50.775745 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-ff068400-e717-4beb-a3cb-4ce111aa4d65 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:50.831759 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-9370a9bb-0bc0-4973-bf13-5318765c8ca8 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3170dc3323f54512bc8819c8efa86b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7121bd118a2549c39332cfdb7edaa92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:34:50.840515 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-9370a9bb-0bc0-4973-bf13-5318765c8ca8 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] 10.222.0.121 "GET /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e" status: 200 len: 1525 microversion: 2.1 time: 0.288404 Aug 04 10:34:50.841108 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 156/329] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:34:50 2022] GET /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e => generated 1525 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:34:51.305690 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-ff068400-e717-4beb-a3cb-4ce111aa4d65 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] 10.222.0.121 "POST /compute/v2.1/servers/cabceac5-859e-4c28-86c2-aa9b63953009/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.544724 Aug 04 10:34:51.306592 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 174/330] 10.222.0.121 () {60 vars in 1328 bytes} [Thu Aug 4 10:34:50 2022] POST /compute/v2.1/servers/cabceac5-859e-4c28-86c2-aa9b63953009/os-volume_attachments => generated 194 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 10:34:51.864474 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-f55d8388-a0fd-428c-923b-548dc12e5250 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:34:51.865244 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-f55d8388-a0fd-428c-923b-548dc12e5250 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] [instance: 2583b630-2f89-45ba-b781-c0b7c206d61e] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:34:51.873137 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-f55d8388-a0fd-428c-923b-548dc12e5250 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:51.873920 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-f55d8388-a0fd-428c-923b-548dc12e5250 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:51.876030 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-f55d8388-a0fd-428c-923b-548dc12e5250 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:51.876774 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-f55d8388-a0fd-428c-923b-548dc12e5250 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:52.035192 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-f55d8388-a0fd-428c-923b-548dc12e5250 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3170dc3323f54512bc8819c8efa86b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7121bd118a2549c39332cfdb7edaa92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:34:52.045935 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-f55d8388-a0fd-428c-923b-548dc12e5250 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] 10.222.0.121 "GET /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e" status: 200 len: 1525 microversion: 2.1 time: 0.186652 Aug 04 10:34:52.047304 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 157/331] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:34:51 2022] GET /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e => generated 1525 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 10:34:53.069297 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-eb3dd343-0c50-46b9-9636-01da14b397bd tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:34:53.070077 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-eb3dd343-0c50-46b9-9636-01da14b397bd tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] [instance: 2583b630-2f89-45ba-b781-c0b7c206d61e] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:34:53.073112 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG dbcounter [-] [124457] Writing DB stats nova_api:SELECT=56 {{(pid=124457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:34:53.082535 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-eb3dd343-0c50-46b9-9636-01da14b397bd tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:53.082966 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-eb3dd343-0c50-46b9-9636-01da14b397bd tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:53.084298 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-eb3dd343-0c50-46b9-9636-01da14b397bd tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:53.084895 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-eb3dd343-0c50-46b9-9636-01da14b397bd tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:53.295374 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-eb3dd343-0c50-46b9-9636-01da14b397bd tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3170dc3323f54512bc8819c8efa86b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7121bd118a2549c39332cfdb7edaa92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:34:53.303583 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-eb3dd343-0c50-46b9-9636-01da14b397bd tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] 10.222.0.121 "GET /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e" status: 200 len: 1525 microversion: 2.1 time: 0.239303 Aug 04 10:34:53.317776 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 175/332] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:34:53 2022] GET /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e => generated 1525 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:34:54.327040 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-92699c11-073c-4f2f-9dc8-f308f0126c49 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:34:54.328128 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-92699c11-073c-4f2f-9dc8-f308f0126c49 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] [instance: 2583b630-2f89-45ba-b781-c0b7c206d61e] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:34:54.336548 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-92699c11-073c-4f2f-9dc8-f308f0126c49 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:54.337449 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-92699c11-073c-4f2f-9dc8-f308f0126c49 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:54.338266 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-92699c11-073c-4f2f-9dc8-f308f0126c49 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:54.338705 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-92699c11-073c-4f2f-9dc8-f308f0126c49 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:54.508120 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-92699c11-073c-4f2f-9dc8-f308f0126c49 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3170dc3323f54512bc8819c8efa86b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7121bd118a2549c39332cfdb7edaa92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:34:54.517549 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-92699c11-073c-4f2f-9dc8-f308f0126c49 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] 10.222.0.121 "GET /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e" status: 200 len: 1525 microversion: 2.1 time: 0.194801 Aug 04 10:34:54.518407 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 158/333] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:34:54 2022] GET /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e => generated 1525 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:34:55.539038 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-24d6ba17-1c76-49ea-80be-779db78665b2 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:34:55.539667 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-24d6ba17-1c76-49ea-80be-779db78665b2 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] [instance: 2583b630-2f89-45ba-b781-c0b7c206d61e] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:34:55.547100 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-24d6ba17-1c76-49ea-80be-779db78665b2 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:55.547658 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-24d6ba17-1c76-49ea-80be-779db78665b2 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:55.548540 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-24d6ba17-1c76-49ea-80be-779db78665b2 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:55.549099 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-24d6ba17-1c76-49ea-80be-779db78665b2 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:55.894604 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-24d6ba17-1c76-49ea-80be-779db78665b2 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3170dc3323f54512bc8819c8efa86b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7121bd118a2549c39332cfdb7edaa92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:34:55.906351 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-24d6ba17-1c76-49ea-80be-779db78665b2 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] 10.222.0.121 "GET /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e" status: 200 len: 1525 microversion: 2.1 time: 0.370512 Aug 04 10:34:55.906964 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 176/334] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:34:55 2022] GET /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e => generated 1525 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:34:56.928994 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-a71f93fb-ef46-41e2-bfb0-7293ec517d58 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:34:56.929674 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-a71f93fb-ef46-41e2-bfb0-7293ec517d58 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] [instance: 2583b630-2f89-45ba-b781-c0b7c206d61e] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:34:56.936478 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-a71f93fb-ef46-41e2-bfb0-7293ec517d58 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:56.936953 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-a71f93fb-ef46-41e2-bfb0-7293ec517d58 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:56.937762 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-a71f93fb-ef46-41e2-bfb0-7293ec517d58 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:56.938231 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-a71f93fb-ef46-41e2-bfb0-7293ec517d58 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:57.096837 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-a71f93fb-ef46-41e2-bfb0-7293ec517d58 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3170dc3323f54512bc8819c8efa86b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7121bd118a2549c39332cfdb7edaa92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:34:57.106498 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-a71f93fb-ef46-41e2-bfb0-7293ec517d58 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] 10.222.0.121 "GET /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e" status: 200 len: 1525 microversion: 2.1 time: 0.181539 Aug 04 10:34:57.107638 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 159/335] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:34:56 2022] GET /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e => generated 1525 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:34:58.128226 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-f129d25e-6113-40db-bd64-4f5dea126c7d tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:34:58.128905 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-f129d25e-6113-40db-bd64-4f5dea126c7d tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] [instance: 2583b630-2f89-45ba-b781-c0b7c206d61e] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:34:58.136283 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-f129d25e-6113-40db-bd64-4f5dea126c7d tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:58.136750 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-f129d25e-6113-40db-bd64-4f5dea126c7d tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:58.137547 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-f129d25e-6113-40db-bd64-4f5dea126c7d tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:58.138000 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-f129d25e-6113-40db-bd64-4f5dea126c7d tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:58.288486 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-f129d25e-6113-40db-bd64-4f5dea126c7d tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3170dc3323f54512bc8819c8efa86b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7121bd118a2549c39332cfdb7edaa92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:34:58.301623 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-f129d25e-6113-40db-bd64-4f5dea126c7d tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] 10.222.0.121 "GET /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e" status: 200 len: 1525 microversion: 2.1 time: 0.177484 Aug 04 10:34:58.302237 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 177/336] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:34:58 2022] GET /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e => generated 1525 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:34:59.325218 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-5f1b3d15-1ae1-47f9-950e-0af7b7f6db06 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:34:59.325882 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-5f1b3d15-1ae1-47f9-950e-0af7b7f6db06 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] [instance: 2583b630-2f89-45ba-b781-c0b7c206d61e] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:34:59.333619 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-5f1b3d15-1ae1-47f9-950e-0af7b7f6db06 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:59.334071 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-5f1b3d15-1ae1-47f9-950e-0af7b7f6db06 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:59.335001 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-5f1b3d15-1ae1-47f9-950e-0af7b7f6db06 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:34:59.335356 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-5f1b3d15-1ae1-47f9-950e-0af7b7f6db06 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:34:59.499617 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-5f1b3d15-1ae1-47f9-950e-0af7b7f6db06 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3170dc3323f54512bc8819c8efa86b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7121bd118a2549c39332cfdb7edaa92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:34:59.508644 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-5f1b3d15-1ae1-47f9-950e-0af7b7f6db06 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] 10.222.0.121 "GET /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e" status: 200 len: 1525 microversion: 2.1 time: 0.188410 Aug 04 10:34:59.509691 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 160/337] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:34:59 2022] GET /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e => generated 1525 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:35:00.531179 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-e93281d3-77f1-4625-a982-8dadb5dc99d8 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:35:00.531765 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-e93281d3-77f1-4625-a982-8dadb5dc99d8 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] [instance: 2583b630-2f89-45ba-b781-c0b7c206d61e] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:35:00.538939 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-e93281d3-77f1-4625-a982-8dadb5dc99d8 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:35:00.539402 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-e93281d3-77f1-4625-a982-8dadb5dc99d8 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:35:00.540226 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-e93281d3-77f1-4625-a982-8dadb5dc99d8 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:35:00.540686 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-e93281d3-77f1-4625-a982-8dadb5dc99d8 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:35:00.693445 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-e93281d3-77f1-4625-a982-8dadb5dc99d8 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3170dc3323f54512bc8819c8efa86b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7121bd118a2549c39332cfdb7edaa92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:35:00.702914 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-e93281d3-77f1-4625-a982-8dadb5dc99d8 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] 10.222.0.121 "GET /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e" status: 200 len: 1525 microversion: 2.1 time: 0.175865 Aug 04 10:35:00.703993 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 178/338] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:35:00 2022] GET /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e => generated 1525 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:35:01.725296 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-399db5b4-597b-484c-84ea-92379be8b2e7 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:35:01.725942 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-399db5b4-597b-484c-84ea-92379be8b2e7 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] [instance: 2583b630-2f89-45ba-b781-c0b7c206d61e] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:35:01.733524 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-399db5b4-597b-484c-84ea-92379be8b2e7 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:35:01.734052 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-399db5b4-597b-484c-84ea-92379be8b2e7 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:35:01.734844 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-399db5b4-597b-484c-84ea-92379be8b2e7 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:35:01.735287 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-399db5b4-597b-484c-84ea-92379be8b2e7 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:35:01.887779 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-399db5b4-597b-484c-84ea-92379be8b2e7 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3170dc3323f54512bc8819c8efa86b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7121bd118a2549c39332cfdb7edaa92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:35:01.897808 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-399db5b4-597b-484c-84ea-92379be8b2e7 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] 10.222.0.121 "GET /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e" status: 200 len: 1525 microversion: 2.1 time: 0.176741 Aug 04 10:35:01.898417 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 161/339] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:35:01 2022] GET /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e => generated 1525 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:35:02.391061 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-616175df-a60f-4ffd-9ab7-cd44d01ddafd tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:35:02.391784 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-616175df-a60f-4ffd-9ab7-cd44d01ddafd tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] [instance: cabceac5-859e-4c28-86c2-aa9b63953009] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:35:02.402018 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-616175df-a60f-4ffd-9ab7-cd44d01ddafd tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:35:02.402475 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-616175df-a60f-4ffd-9ab7-cd44d01ddafd tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:35:02.403416 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-616175df-a60f-4ffd-9ab7-cd44d01ddafd tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:35:02.403863 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-616175df-a60f-4ffd-9ab7-cd44d01ddafd tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:35:02.438904 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-616175df-a60f-4ffd-9ab7-cd44d01ddafd tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] [instance: cabceac5-859e-4c28-86c2-aa9b63953009] Going to try to terminate instance {{(pid=124457) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 10:35:02.582838 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-616175df-a60f-4ffd-9ab7-cd44d01ddafd tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] 10.222.0.121 "DELETE /compute/v2.1/servers/cabceac5-859e-4c28-86c2-aa9b63953009" status: 204 len: 0 microversion: 2.1 time: 0.194673 Aug 04 10:35:02.590394 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 179/340] 10.222.0.121 () {58 vars in 1244 bytes} [Thu Aug 4 10:35:02 2022] DELETE /compute/v2.1/servers/cabceac5-859e-4c28-86c2-aa9b63953009 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 04 10:35:02.599652 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-48f16dd3-41b0-4a44-8aec-53581949c204 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:35:02.600217 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-48f16dd3-41b0-4a44-8aec-53581949c204 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] [instance: cabceac5-859e-4c28-86c2-aa9b63953009] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:35:02.607536 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-48f16dd3-41b0-4a44-8aec-53581949c204 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:35:02.608023 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-48f16dd3-41b0-4a44-8aec-53581949c204 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:35:02.609159 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-48f16dd3-41b0-4a44-8aec-53581949c204 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:35:02.609280 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-48f16dd3-41b0-4a44-8aec-53581949c204 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:35:02.765698 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-48f16dd3-41b0-4a44-8aec-53581949c204 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9520a49687b24281b78f08d43cb27dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c167faad577d47dfaf0d010a3f983fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:35:02.774491 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-48f16dd3-41b0-4a44-8aec-53581949c204 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] 10.222.0.121 "GET /compute/v2.1/servers/cabceac5-859e-4c28-86c2-aa9b63953009" status: 200 len: 1557 microversion: 2.1 time: 0.179507 Aug 04 10:35:02.775108 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 162/341] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:35:02 2022] GET /compute/v2.1/servers/cabceac5-859e-4c28-86c2-aa9b63953009 => generated 1557 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:35:02.921036 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-d942f0e2-b3cc-41d1-952e-2e113da7baa1 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:35:02.921792 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-d942f0e2-b3cc-41d1-952e-2e113da7baa1 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] [instance: 2583b630-2f89-45ba-b781-c0b7c206d61e] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:35:02.928815 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-d942f0e2-b3cc-41d1-952e-2e113da7baa1 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:35:02.929277 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-d942f0e2-b3cc-41d1-952e-2e113da7baa1 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:35:02.930156 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-d942f0e2-b3cc-41d1-952e-2e113da7baa1 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:35:02.930700 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-d942f0e2-b3cc-41d1-952e-2e113da7baa1 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:35:03.114218 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-d942f0e2-b3cc-41d1-952e-2e113da7baa1 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3170dc3323f54512bc8819c8efa86b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7121bd118a2549c39332cfdb7edaa92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:35:03.122862 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-d942f0e2-b3cc-41d1-952e-2e113da7baa1 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] 10.222.0.121 "GET /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e" status: 200 len: 1525 microversion: 2.1 time: 0.207114 Aug 04 10:35:03.123482 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 180/342] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:35:02 2022] GET /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e => generated 1525 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:35:03.800849 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-4e50891d-3c24-4b80-b21e-5cec77851282 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:35:03.802399 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-4e50891d-3c24-4b80-b21e-5cec77851282 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] [instance: cabceac5-859e-4c28-86c2-aa9b63953009] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:35:03.809711 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-4e50891d-3c24-4b80-b21e-5cec77851282 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:35:03.810169 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-4e50891d-3c24-4b80-b21e-5cec77851282 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:35:03.810961 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-4e50891d-3c24-4b80-b21e-5cec77851282 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:35:03.811589 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-4e50891d-3c24-4b80-b21e-5cec77851282 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:35:03.995395 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-4e50891d-3c24-4b80-b21e-5cec77851282 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9520a49687b24281b78f08d43cb27dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c167faad577d47dfaf0d010a3f983fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:35:04.004116 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-4e50891d-3c24-4b80-b21e-5cec77851282 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] 10.222.0.121 "GET /compute/v2.1/servers/cabceac5-859e-4c28-86c2-aa9b63953009" status: 200 len: 1557 microversion: 2.1 time: 0.211892 Aug 04 10:35:04.004706 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 163/343] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:35:03 2022] GET /compute/v2.1/servers/cabceac5-859e-4c28-86c2-aa9b63953009 => generated 1557 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:35:04.145497 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-7255c1f7-bfcd-4092-8a7a-68d583e2bd50 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:35:04.146185 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-7255c1f7-bfcd-4092-8a7a-68d583e2bd50 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] [instance: 2583b630-2f89-45ba-b781-c0b7c206d61e] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:35:04.154649 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-7255c1f7-bfcd-4092-8a7a-68d583e2bd50 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:35:04.155281 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-7255c1f7-bfcd-4092-8a7a-68d583e2bd50 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:35:04.156384 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-7255c1f7-bfcd-4092-8a7a-68d583e2bd50 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:35:04.157041 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-7255c1f7-bfcd-4092-8a7a-68d583e2bd50 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:35:04.182840 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG dbcounter [-] [124457] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:35:04.314963 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-7255c1f7-bfcd-4092-8a7a-68d583e2bd50 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3170dc3323f54512bc8819c8efa86b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7121bd118a2549c39332cfdb7edaa92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:35:04.323448 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-7255c1f7-bfcd-4092-8a7a-68d583e2bd50 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] 10.222.0.121 "GET /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e" status: 200 len: 1525 microversion: 2.1 time: 0.182413 Aug 04 10:35:04.324046 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 181/344] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:35:04 2022] GET /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e => generated 1525 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:35:05.026706 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-195e836e-f836-4c08-8f3f-a3f44ecd3d69 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:35:05.027994 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-195e836e-f836-4c08-8f3f-a3f44ecd3d69 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] [instance: cabceac5-859e-4c28-86c2-aa9b63953009] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:35:05.036158 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-195e836e-f836-4c08-8f3f-a3f44ecd3d69 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:35:05.036636 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-195e836e-f836-4c08-8f3f-a3f44ecd3d69 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:35:05.037730 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-195e836e-f836-4c08-8f3f-a3f44ecd3d69 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:35:05.038186 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-195e836e-f836-4c08-8f3f-a3f44ecd3d69 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:35:05.191854 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-195e836e-f836-4c08-8f3f-a3f44ecd3d69 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9520a49687b24281b78f08d43cb27dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c167faad577d47dfaf0d010a3f983fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:35:05.201652 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-195e836e-f836-4c08-8f3f-a3f44ecd3d69 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] 10.222.0.121 "GET /compute/v2.1/servers/cabceac5-859e-4c28-86c2-aa9b63953009" status: 200 len: 1557 microversion: 2.1 time: 0.179592 Aug 04 10:35:05.204244 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 164/345] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:35:05 2022] GET /compute/v2.1/servers/cabceac5-859e-4c28-86c2-aa9b63953009 => generated 1557 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:35:05.345769 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-9123c97e-e23e-4d54-9b45-c24efe720ecf tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:35:05.346701 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-9123c97e-e23e-4d54-9b45-c24efe720ecf tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] [instance: 2583b630-2f89-45ba-b781-c0b7c206d61e] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:35:05.356964 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-9123c97e-e23e-4d54-9b45-c24efe720ecf tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:35:05.357693 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-9123c97e-e23e-4d54-9b45-c24efe720ecf tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:35:05.358925 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-9123c97e-e23e-4d54-9b45-c24efe720ecf tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:35:05.359640 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-9123c97e-e23e-4d54-9b45-c24efe720ecf tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:35:05.511716 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-9123c97e-e23e-4d54-9b45-c24efe720ecf tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3170dc3323f54512bc8819c8efa86b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7121bd118a2549c39332cfdb7edaa92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:35:05.520312 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-9123c97e-e23e-4d54-9b45-c24efe720ecf tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] 10.222.0.121 "GET /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e" status: 200 len: 1525 microversion: 2.1 time: 0.178635 Aug 04 10:35:05.520914 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 182/346] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:35:05 2022] GET /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e => generated 1525 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:35:06.224656 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-f6460767-d8ce-422a-9ab0-af3d180920c4 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:35:06.225603 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-f6460767-d8ce-422a-9ab0-af3d180920c4 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] [instance: cabceac5-859e-4c28-86c2-aa9b63953009] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:35:06.233800 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-f6460767-d8ce-422a-9ab0-af3d180920c4 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:35:06.234264 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-f6460767-d8ce-422a-9ab0-af3d180920c4 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:35:06.235606 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-f6460767-d8ce-422a-9ab0-af3d180920c4 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:35:06.236265 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-f6460767-d8ce-422a-9ab0-af3d180920c4 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:35:06.511820 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-f6460767-d8ce-422a-9ab0-af3d180920c4 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9520a49687b24281b78f08d43cb27dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c167faad577d47dfaf0d010a3f983fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:35:06.523276 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-f6460767-d8ce-422a-9ab0-af3d180920c4 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] 10.222.0.121 "GET /compute/v2.1/servers/cabceac5-859e-4c28-86c2-aa9b63953009" status: 200 len: 1557 microversion: 2.1 time: 0.303116 Aug 04 10:35:06.523984 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 165/347] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:35:06 2022] GET /compute/v2.1/servers/cabceac5-859e-4c28-86c2-aa9b63953009 => generated 1557 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:35:06.549989 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-709cf2fd-8a5b-4a7e-b6cc-c609b835a39e tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:35:06.550679 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-709cf2fd-8a5b-4a7e-b6cc-c609b835a39e tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] [instance: 2583b630-2f89-45ba-b781-c0b7c206d61e] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:35:06.557793 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-709cf2fd-8a5b-4a7e-b6cc-c609b835a39e tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:35:06.558409 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-709cf2fd-8a5b-4a7e-b6cc-c609b835a39e tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:35:06.559687 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-709cf2fd-8a5b-4a7e-b6cc-c609b835a39e tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:35:06.560177 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-709cf2fd-8a5b-4a7e-b6cc-c609b835a39e tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:35:06.699685 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [req-00ea83b2-afe0-46c5-9667-c96a3b4bf4f1 req-40d37116-501a-4691-87a1-f8218ff19941 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cabceac5-859e-4c28-86c2-aa9b63953009", "name": "network-vif-deleted", "tag": "a3861873-99d9-49b7-9745-14f9834dfd57"}]} {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:35:06.712694 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [req-00ea83b2-afe0-46c5-9667-c96a3b4bf4f1 req-40d37116-501a-4691-87a1-f8218ff19941 service nova] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:35:06.713252 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [req-00ea83b2-afe0-46c5-9667-c96a3b4bf4f1 req-40d37116-501a-4691-87a1-f8218ff19941 service nova] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:35:06.738090 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.compute.server_external_events [req-00ea83b2-afe0-46c5-9667-c96a3b4bf4f1 req-40d37116-501a-4691-87a1-f8218ff19941 service nova] Creating event network-vif-deleted:a3861873-99d9-49b7-9745-14f9834dfd57 for instance cabceac5-859e-4c28-86c2-aa9b63953009 on hv-cinder-85200 Aug 04 10:35:06.749856 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [req-00ea83b2-afe0-46c5-9667-c96a3b4bf4f1 req-40d37116-501a-4691-87a1-f8218ff19941 service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057339 Aug 04 10:35:06.750706 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 166/348] 10.222.0.121 () {64 vars in 1322 bytes} [Thu Aug 4 10:35:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:35:06.855827 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-709cf2fd-8a5b-4a7e-b6cc-c609b835a39e tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3170dc3323f54512bc8819c8efa86b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7121bd118a2549c39332cfdb7edaa92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:35:06.864308 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-709cf2fd-8a5b-4a7e-b6cc-c609b835a39e tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] 10.222.0.121 "GET /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e" status: 200 len: 1525 microversion: 2.1 time: 0.327110 Aug 04 10:35:06.864908 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 183/349] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:35:06 2022] GET /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e => generated 1525 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:35:07.546521 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-f5ac7f5f-ccd7-4747-9e94-07fa6f1d4f93 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:35:07.547450 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-f5ac7f5f-ccd7-4747-9e94-07fa6f1d4f93 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] [instance: cabceac5-859e-4c28-86c2-aa9b63953009] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:35:07.562310 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-f5ac7f5f-ccd7-4747-9e94-07fa6f1d4f93 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:35:07.563520 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-f5ac7f5f-ccd7-4747-9e94-07fa6f1d4f93 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:35:07.564939 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-f5ac7f5f-ccd7-4747-9e94-07fa6f1d4f93 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:35:07.565638 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-f5ac7f5f-ccd7-4747-9e94-07fa6f1d4f93 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:35:07.655042 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-f5ac7f5f-ccd7-4747-9e94-07fa6f1d4f93 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9520a49687b24281b78f08d43cb27dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c167faad577d47dfaf0d010a3f983fe3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:35:07.670884 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-f5ac7f5f-ccd7-4747-9e94-07fa6f1d4f93 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] 10.222.0.121 "GET /compute/v2.1/servers/cabceac5-859e-4c28-86c2-aa9b63953009" status: 200 len: 1349 microversion: 2.1 time: 0.128681 Aug 04 10:35:07.675277 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 167/350] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:35:07 2022] GET /compute/v2.1/servers/cabceac5-859e-4c28-86c2-aa9b63953009 => generated 1349 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:35:07.888120 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-419808ad-969e-457a-8dd2-78264fc6d5c8 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:35:07.888756 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-419808ad-969e-457a-8dd2-78264fc6d5c8 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] [instance: 2583b630-2f89-45ba-b781-c0b7c206d61e] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:35:07.896695 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-419808ad-969e-457a-8dd2-78264fc6d5c8 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:35:07.897142 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-419808ad-969e-457a-8dd2-78264fc6d5c8 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:35:07.897931 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-419808ad-969e-457a-8dd2-78264fc6d5c8 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:35:07.898444 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-419808ad-969e-457a-8dd2-78264fc6d5c8 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:35:08.082508 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-419808ad-969e-457a-8dd2-78264fc6d5c8 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3170dc3323f54512bc8819c8efa86b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7121bd118a2549c39332cfdb7edaa92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:35:08.092678 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-419808ad-969e-457a-8dd2-78264fc6d5c8 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] 10.222.0.121 "GET /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e" status: 200 len: 1525 microversion: 2.1 time: 0.210027 Aug 04 10:35:08.093285 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 184/351] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:35:07 2022] GET /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e => generated 1525 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:35:08.695564 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-43b321c4-501d-4859-a4e6-ecb5f983b0e0 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:35:08.696310 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-43b321c4-501d-4859-a4e6-ecb5f983b0e0 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] [instance: cabceac5-859e-4c28-86c2-aa9b63953009] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:35:08.703284 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-43b321c4-501d-4859-a4e6-ecb5f983b0e0 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:35:08.703885 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-43b321c4-501d-4859-a4e6-ecb5f983b0e0 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:35:08.704941 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-43b321c4-501d-4859-a4e6-ecb5f983b0e0 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:35:08.705391 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-43b321c4-501d-4859-a4e6-ecb5f983b0e0 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:35:08.720943 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.wsgi [None req-43b321c4-501d-4859-a4e6-ecb5f983b0e0 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] HTTP exception thrown: Instance cabceac5-859e-4c28-86c2-aa9b63953009 could not be found. Aug 04 10:35:08.736638 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-43b321c4-501d-4859-a4e6-ecb5f983b0e0 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Request method failure captured: Aug 04 10:35:08.736638 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: request: GET /compute/v2.1/servers/cabceac5-859e-4c28-86c2-aa9b63953009 HTTP/1.1 Aug 04 10:35:08.736638 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: Accept: application/json Aug 04 10:35:08.736638 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: Accept-Encoding: identity Aug 04 10:35:08.736638 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: Connection: close Aug 04 10:35:08.736638 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: Content-Length: 0 Aug 04 10:35:08.736638 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: Content-Type: application/json Aug 04 10:35:08.736638 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: Host: 10.222.0.121 Aug 04 10:35:08.736638 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: Openstack-System-Scope: None Aug 04 10:35:08.736638 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: User-Agent: python-urllib3/1.26.11 Aug 04 10:35:08.736638 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Auth-Token: gAAAAABi66BdQTEi-TjjN9D2iQmSslgTLjbV5UHjvJipmLH4V7E9izdvzKsKu0OGksdrZN5JlTvt6Kt51cyMiO9zrLxnQVl-SDF7duCBvsS5Bw_8jELCN-YX6iqB_HbmfAbEixYYMzINmJBlqdWuPzgU433CxIP27Igy4J0NDGcRm9zfzq7Q62M Aug 04 10:35:08.736638 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Domain-Id: None Aug 04 10:35:08.736638 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Domain-Name: None Aug 04 10:35:08.736638 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Identity-Status: Confirmed Aug 04 10:35:08.736638 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Is-Admin-Project: True Aug 04 10:35:08.736638 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Project-Domain-Id: default Aug 04 10:35:08.736638 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Project-Domain-Name: Default Aug 04 10:35:08.736638 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Project-Id: c167faad577d47dfaf0d010a3f983fe3 Aug 04 10:35:08.736638 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Project-Name: tempest-DeleteServersTestJSON-1058389927 Aug 04 10:35:08.736638 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Role: reader,member Aug 04 10:35:08.736638 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Roles: reader,member Aug 04 10:35:08.738147 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/c167faad577d47dfaf0d010a3f983fe3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/c167faad577d47dfaf0d010a3f983fe3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.121:8080", "publicURL": "http://10.222.0.121:8080/v1/AUTH_c167faad577d47dfaf0d010a3f983fe3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2/c167faad577d47dfaf0d010a3f983fe3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:9696/networking"}]}] Aug 04 10:35:08.738147 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Tenant: tempest-DeleteServersTestJSON-1058389927 Aug 04 10:35:08.738147 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Tenant-Id: c167faad577d47dfaf0d010a3f983fe3 Aug 04 10:35:08.738147 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Tenant-Name: tempest-DeleteServersTestJSON-1058389927 Aug 04 10:35:08.738147 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-User: tempest-DeleteServersTestJSON-1058389927-project Aug 04 10:35:08.738147 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-User-Domain-Id: default Aug 04 10:35:08.738147 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-User-Domain-Name: Default Aug 04 10:35:08.738147 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-User-Id: 9520a49687b24281b78f08d43cb27dc3 Aug 04 10:35:08.738147 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-User-Name: tempest-DeleteServersTestJSON-1058389927-project Aug 04 10:35:08.738147 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: method: > Aug 04 10:35:08.738147 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: exception: Instance cabceac5-859e-4c28-86c2-aa9b63953009 could not be found. Aug 04 10:35:08.738147 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: action_args: {'id': 'cabceac5-859e-4c28-86c2-aa9b63953009'} Aug 04 10:35:08.738913 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 10:35:08.738913 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:35:08.738913 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 10:35:08.738913 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 10:35:08.738913 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 10:35:08.738913 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 10:35:08.738913 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 10:35:08.738913 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 10:35:08.738913 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 10:35:08.738913 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 10:35:08.738913 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cabceac5-859e-4c28-86c2-aa9b63953009 could not be found. Aug 04 10:35:08.738913 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi Aug 04 10:35:08.738913 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:35:08.738913 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi Aug 04 10:35:08.738913 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:35:08.738913 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:35:08.738913 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:35:08.738913 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 10:35:08.738913 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 10:35:08.738913 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 10:35:08.740928 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 10:35:08.740928 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 10:35:08.740928 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 10:35:08.740928 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 10:35:08.740928 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 10:35:08.740928 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 10:35:08.740928 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 10:35:08.740928 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cabceac5-859e-4c28-86c2-aa9b63953009 could not be found. Aug 04 10:35:08.740928 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi Aug 04 10:35:08.740928 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:35:08.740928 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi Aug 04 10:35:08.740928 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:35:08.740928 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:35:08.740928 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:35:08.740928 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 10:35:08.740928 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 10:35:08.740928 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cabceac5-859e-4c28-86c2-aa9b63953009 could not be found. Aug 04 10:35:08.740928 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi Aug 04 10:35:08.742007 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-43b321c4-501d-4859-a4e6-ecb5f983b0e0 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Returning 404 to user: Instance cabceac5-859e-4c28-86c2-aa9b63953009 could not be found. {{(pid=124456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 10:35:08.742007 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-43b321c4-501d-4859-a4e6-ecb5f983b0e0 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] 10.222.0.121 "GET /compute/v2.1/servers/cabceac5-859e-4c28-86c2-aa9b63953009" status: 404 len: 111 microversion: 2.1 time: 0.047433 Aug 04 10:35:08.742007 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 168/352] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:35:08 2022] GET /compute/v2.1/servers/cabceac5-859e-4c28-86c2-aa9b63953009 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 10:35:08.897427 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-496fef05-4e5e-43bb-9d42-599a202528ed tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:35:08.901327 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-496fef05-4e5e-43bb-9d42-599a202528ed tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] [instance: cabceac5-859e-4c28-86c2-aa9b63953009] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:35:08.913859 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-496fef05-4e5e-43bb-9d42-599a202528ed tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:35:08.914841 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-496fef05-4e5e-43bb-9d42-599a202528ed tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:35:08.916402 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-496fef05-4e5e-43bb-9d42-599a202528ed tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:35:08.917310 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-496fef05-4e5e-43bb-9d42-599a202528ed tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:35:08.943500 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.wsgi [None req-496fef05-4e5e-43bb-9d42-599a202528ed tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] HTTP exception thrown: Instance cabceac5-859e-4c28-86c2-aa9b63953009 could not be found. Aug 04 10:35:08.952099 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-496fef05-4e5e-43bb-9d42-599a202528ed tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Request method failure captured: Aug 04 10:35:08.952099 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: request: GET /compute/v2.1/servers/cabceac5-859e-4c28-86c2-aa9b63953009/os-volume_attachments HTTP/1.1 Aug 04 10:35:08.952099 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: Accept: application/json Aug 04 10:35:08.952099 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: Accept-Encoding: identity Aug 04 10:35:08.952099 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: Connection: close Aug 04 10:35:08.952099 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: Content-Length: 0 Aug 04 10:35:08.952099 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: Content-Type: application/json Aug 04 10:35:08.952099 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: Host: 10.222.0.121 Aug 04 10:35:08.952099 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: Openstack-System-Scope: None Aug 04 10:35:08.952099 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: User-Agent: python-urllib3/1.26.11 Aug 04 10:35:08.952099 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Auth-Token: gAAAAABi66BdQTEi-TjjN9D2iQmSslgTLjbV5UHjvJipmLH4V7E9izdvzKsKu0OGksdrZN5JlTvt6Kt51cyMiO9zrLxnQVl-SDF7duCBvsS5Bw_8jELCN-YX6iqB_HbmfAbEixYYMzINmJBlqdWuPzgU433CxIP27Igy4J0NDGcRm9zfzq7Q62M Aug 04 10:35:08.952099 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Domain-Id: None Aug 04 10:35:08.952099 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Domain-Name: None Aug 04 10:35:08.952099 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Identity-Status: Confirmed Aug 04 10:35:08.952099 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Is-Admin-Project: True Aug 04 10:35:08.952099 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Project-Domain-Id: default Aug 04 10:35:08.952099 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Project-Domain-Name: Default Aug 04 10:35:08.952099 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Project-Id: c167faad577d47dfaf0d010a3f983fe3 Aug 04 10:35:08.952099 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Project-Name: tempest-DeleteServersTestJSON-1058389927 Aug 04 10:35:08.952099 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Role: reader,member Aug 04 10:35:08.952099 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Roles: reader,member Aug 04 10:35:08.953968 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/c167faad577d47dfaf0d010a3f983fe3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/c167faad577d47dfaf0d010a3f983fe3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.121:8080", "publicURL": "http://10.222.0.121:8080/v1/AUTH_c167faad577d47dfaf0d010a3f983fe3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2/c167faad577d47dfaf0d010a3f983fe3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:9696/networking"}]}] Aug 04 10:35:08.953968 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Tenant: tempest-DeleteServersTestJSON-1058389927 Aug 04 10:35:08.953968 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Tenant-Id: c167faad577d47dfaf0d010a3f983fe3 Aug 04 10:35:08.953968 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Tenant-Name: tempest-DeleteServersTestJSON-1058389927 Aug 04 10:35:08.953968 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-User: tempest-DeleteServersTestJSON-1058389927-project Aug 04 10:35:08.953968 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-User-Domain-Id: default Aug 04 10:35:08.953968 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-User-Domain-Name: Default Aug 04 10:35:08.953968 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-User-Id: 9520a49687b24281b78f08d43cb27dc3 Aug 04 10:35:08.953968 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-User-Name: tempest-DeleteServersTestJSON-1058389927-project Aug 04 10:35:08.953968 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: method: > Aug 04 10:35:08.953968 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: exception: Instance cabceac5-859e-4c28-86c2-aa9b63953009 could not be found. Aug 04 10:35:08.953968 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: action_args: {'server_id': 'cabceac5-859e-4c28-86c2-aa9b63953009'} Aug 04 10:35:08.954749 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 10:35:08.954749 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:35:08.954749 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 10:35:08.954749 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 10:35:08.954749 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 10:35:08.954749 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 10:35:08.954749 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 10:35:08.954749 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 10:35:08.954749 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 10:35:08.954749 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 10:35:08.954749 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cabceac5-859e-4c28-86c2-aa9b63953009 could not be found. Aug 04 10:35:08.954749 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Aug 04 10:35:08.954749 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:35:08.954749 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Aug 04 10:35:08.954749 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:35:08.954749 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:35:08.954749 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:35:08.954749 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 10:35:08.954749 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 10:35:08.954749 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 10:35:08.955894 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 10:35:08.955894 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 04 10:35:08.955894 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 10:35:08.955894 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 04 10:35:08.955894 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 10:35:08.955894 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 04 10:35:08.955894 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 04 10:35:08.955894 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 10:35:08.955894 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 10:35:08.955894 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cabceac5-859e-4c28-86c2-aa9b63953009 could not be found. Aug 04 10:35:08.955894 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Aug 04 10:35:08.955894 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:35:08.955894 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Aug 04 10:35:08.955894 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:35:08.955894 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:35:08.955894 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:35:08.955894 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 10:35:08.955894 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 10:35:08.955894 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cabceac5-859e-4c28-86c2-aa9b63953009 could not be found. Aug 04 10:35:08.955894 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Aug 04 10:35:08.957052 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-496fef05-4e5e-43bb-9d42-599a202528ed tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Returning 404 to user: Instance cabceac5-859e-4c28-86c2-aa9b63953009 could not be found. {{(pid=124457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 10:35:08.957052 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-496fef05-4e5e-43bb-9d42-599a202528ed tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] 10.222.0.121 "GET /compute/v2.1/servers/cabceac5-859e-4c28-86c2-aa9b63953009/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.065753 Aug 04 10:35:08.957052 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 185/353] 10.222.0.121 () {58 vars in 1307 bytes} [Thu Aug 4 10:35:08 2022] GET /compute/v2.1/servers/cabceac5-859e-4c28-86c2-aa9b63953009/os-volume_attachments => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 10:35:09.115309 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-0a1f45da-0535-430c-bf4a-9bedd0ff085c tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:35:09.116023 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-0a1f45da-0535-430c-bf4a-9bedd0ff085c tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] [instance: 2583b630-2f89-45ba-b781-c0b7c206d61e] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:35:09.122671 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-0a1f45da-0535-430c-bf4a-9bedd0ff085c tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:35:09.123503 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-0a1f45da-0535-430c-bf4a-9bedd0ff085c tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:35:09.124525 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-0a1f45da-0535-430c-bf4a-9bedd0ff085c tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:35:09.124960 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-0a1f45da-0535-430c-bf4a-9bedd0ff085c tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:35:09.296681 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-0a1f45da-0535-430c-bf4a-9bedd0ff085c tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3170dc3323f54512bc8819c8efa86b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7121bd118a2549c39332cfdb7edaa92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:35:09.305268 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-0a1f45da-0535-430c-bf4a-9bedd0ff085c tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] 10.222.0.121 "GET /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e" status: 200 len: 1525 microversion: 2.1 time: 0.194362 Aug 04 10:35:09.305772 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 169/354] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:35:09 2022] GET /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e => generated 1525 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:35:10.328497 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-3f0e349f-683f-459c-80be-c230b5324333 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:35:10.329554 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-3f0e349f-683f-459c-80be-c230b5324333 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] [instance: 2583b630-2f89-45ba-b781-c0b7c206d61e] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:35:10.338076 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-3f0e349f-683f-459c-80be-c230b5324333 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:35:10.338834 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-3f0e349f-683f-459c-80be-c230b5324333 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:35:10.339422 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-3f0e349f-683f-459c-80be-c230b5324333 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:35:10.339884 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-3f0e349f-683f-459c-80be-c230b5324333 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:35:10.545896 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-3f0e349f-683f-459c-80be-c230b5324333 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3170dc3323f54512bc8819c8efa86b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7121bd118a2549c39332cfdb7edaa92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:35:10.555964 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-3f0e349f-683f-459c-80be-c230b5324333 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] 10.222.0.121 "GET /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e" status: 200 len: 1525 microversion: 2.1 time: 0.232546 Aug 04 10:35:10.556591 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 186/355] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:35:10 2022] GET /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e => generated 1525 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 10:35:11.591755 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-c44bb1bc-c576-4997-acb0-257045b49224 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:35:11.593313 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-c44bb1bc-c576-4997-acb0-257045b49224 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] [instance: 2583b630-2f89-45ba-b781-c0b7c206d61e] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:35:11.600644 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-c44bb1bc-c576-4997-acb0-257045b49224 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:35:11.601132 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-c44bb1bc-c576-4997-acb0-257045b49224 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:35:11.602394 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-c44bb1bc-c576-4997-acb0-257045b49224 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:35:11.602880 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-c44bb1bc-c576-4997-acb0-257045b49224 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:35:11.800577 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-c44bb1bc-c576-4997-acb0-257045b49224 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3170dc3323f54512bc8819c8efa86b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7121bd118a2549c39332cfdb7edaa92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:35:11.812058 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-c44bb1bc-c576-4997-acb0-257045b49224 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] 10.222.0.121 "GET /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e" status: 200 len: 1525 microversion: 2.1 time: 0.227450 Aug 04 10:35:11.817432 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 170/356] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:35:11 2022] GET /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e => generated 1525 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:35:12.856130 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-c577ce99-0d73-4f14-83a5-20e6b7ff6f75 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:35:12.857437 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-c577ce99-0d73-4f14-83a5-20e6b7ff6f75 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] [instance: 2583b630-2f89-45ba-b781-c0b7c206d61e] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:35:12.868715 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-c577ce99-0d73-4f14-83a5-20e6b7ff6f75 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:35:12.869398 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-c577ce99-0d73-4f14-83a5-20e6b7ff6f75 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:35:12.870640 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-c577ce99-0d73-4f14-83a5-20e6b7ff6f75 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:35:12.871316 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-c577ce99-0d73-4f14-83a5-20e6b7ff6f75 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:35:13.065801 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-c577ce99-0d73-4f14-83a5-20e6b7ff6f75 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3170dc3323f54512bc8819c8efa86b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7121bd118a2549c39332cfdb7edaa92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:35:13.079117 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-c577ce99-0d73-4f14-83a5-20e6b7ff6f75 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] 10.222.0.121 "GET /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e" status: 200 len: 1525 microversion: 2.1 time: 0.229334 Aug 04 10:35:13.080244 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 187/357] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:35:12 2022] GET /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e => generated 1525 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:35:14.116899 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-bc8859e2-ee68-4103-b10e-44f0d5706ac3 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:35:14.117813 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-bc8859e2-ee68-4103-b10e-44f0d5706ac3 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] [instance: 2583b630-2f89-45ba-b781-c0b7c206d61e] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:35:14.132475 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-bc8859e2-ee68-4103-b10e-44f0d5706ac3 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:35:14.132475 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-bc8859e2-ee68-4103-b10e-44f0d5706ac3 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:35:14.132475 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-bc8859e2-ee68-4103-b10e-44f0d5706ac3 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:35:14.132475 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-bc8859e2-ee68-4103-b10e-44f0d5706ac3 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:35:14.274522 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-bc8859e2-ee68-4103-b10e-44f0d5706ac3 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3170dc3323f54512bc8819c8efa86b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7121bd118a2549c39332cfdb7edaa92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:35:14.278235 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG dbcounter [-] [124456] Writing DB stats nova_cell1:SELECT=100 {{(pid=124456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:35:14.283232 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-bc8859e2-ee68-4103-b10e-44f0d5706ac3 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] 10.222.0.121 "GET /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e" status: 200 len: 1525 microversion: 2.1 time: 0.172506 Aug 04 10:35:14.283849 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 171/358] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:35:14 2022] GET /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e => generated 1525 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 10:35:15.305344 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-f62f9831-cca0-4ae9-a509-d1ca2cf6c468 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:35:15.305979 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-f62f9831-cca0-4ae9-a509-d1ca2cf6c468 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] [instance: 2583b630-2f89-45ba-b781-c0b7c206d61e] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:35:15.313323 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-f62f9831-cca0-4ae9-a509-d1ca2cf6c468 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:35:15.313787 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-f62f9831-cca0-4ae9-a509-d1ca2cf6c468 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:35:15.314627 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-f62f9831-cca0-4ae9-a509-d1ca2cf6c468 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:35:15.315077 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-f62f9831-cca0-4ae9-a509-d1ca2cf6c468 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:35:15.466318 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-f62f9831-cca0-4ae9-a509-d1ca2cf6c468 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3170dc3323f54512bc8819c8efa86b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7121bd118a2549c39332cfdb7edaa92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:35:15.474905 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-f62f9831-cca0-4ae9-a509-d1ca2cf6c468 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] 10.222.0.121 "GET /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e" status: 200 len: 1525 microversion: 2.1 time: 0.173618 Aug 04 10:35:15.475510 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 188/359] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:35:15 2022] GET /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e => generated 1525 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:35:16.498515 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-c27f06df-6834-4383-84cc-c646670b95e7 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:35:16.499261 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-c27f06df-6834-4383-84cc-c646670b95e7 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] [instance: 2583b630-2f89-45ba-b781-c0b7c206d61e] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:35:16.506765 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-c27f06df-6834-4383-84cc-c646670b95e7 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:35:16.507211 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-c27f06df-6834-4383-84cc-c646670b95e7 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:35:16.515877 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-c27f06df-6834-4383-84cc-c646670b95e7 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:35:16.515877 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-c27f06df-6834-4383-84cc-c646670b95e7 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:35:16.680579 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-c27f06df-6834-4383-84cc-c646670b95e7 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3170dc3323f54512bc8819c8efa86b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7121bd118a2549c39332cfdb7edaa92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:35:16.689891 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-c27f06df-6834-4383-84cc-c646670b95e7 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] 10.222.0.121 "GET /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e" status: 200 len: 1525 microversion: 2.1 time: 0.195598 Aug 04 10:35:16.690558 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 172/360] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:35:16 2022] GET /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e => generated 1525 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:35:17.717736 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-8b0a3f32-8412-444d-ae36-6def067e526e tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:35:17.718411 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-8b0a3f32-8412-444d-ae36-6def067e526e tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] [instance: 2583b630-2f89-45ba-b781-c0b7c206d61e] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:35:17.726516 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-8b0a3f32-8412-444d-ae36-6def067e526e tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:35:17.727319 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-8b0a3f32-8412-444d-ae36-6def067e526e tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:35:17.728166 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-8b0a3f32-8412-444d-ae36-6def067e526e tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:35:17.728606 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-8b0a3f32-8412-444d-ae36-6def067e526e tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:35:17.882823 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-8b0a3f32-8412-444d-ae36-6def067e526e tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3170dc3323f54512bc8819c8efa86b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7121bd118a2549c39332cfdb7edaa92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:35:17.896849 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-8b0a3f32-8412-444d-ae36-6def067e526e tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] 10.222.0.121 "GET /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e" status: 200 len: 1525 microversion: 2.1 time: 0.184800 Aug 04 10:35:17.897797 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 189/361] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:35:17 2022] GET /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e => generated 1525 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:35:18.927420 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-904293a6-ae30-40c4-be69-c4af0a678bf6 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:35:18.928103 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-904293a6-ae30-40c4-be69-c4af0a678bf6 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] [instance: 2583b630-2f89-45ba-b781-c0b7c206d61e] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:35:18.934635 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-904293a6-ae30-40c4-be69-c4af0a678bf6 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:35:18.935083 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-904293a6-ae30-40c4-be69-c4af0a678bf6 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:35:18.935863 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-904293a6-ae30-40c4-be69-c4af0a678bf6 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:35:18.936338 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-904293a6-ae30-40c4-be69-c4af0a678bf6 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:35:19.077496 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-904293a6-ae30-40c4-be69-c4af0a678bf6 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3170dc3323f54512bc8819c8efa86b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7121bd118a2549c39332cfdb7edaa92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:35:19.086387 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-904293a6-ae30-40c4-be69-c4af0a678bf6 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] 10.222.0.121 "GET /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e" status: 200 len: 1525 microversion: 2.1 time: 0.163174 Aug 04 10:35:19.087023 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 173/362] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:35:18 2022] GET /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e => generated 1525 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:35:20.108341 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-56f06df5-8551-4523-94e4-aa8d4c518a5d tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:35:20.109028 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-56f06df5-8551-4523-94e4-aa8d4c518a5d tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] [instance: 2583b630-2f89-45ba-b781-c0b7c206d61e] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:35:20.118868 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-56f06df5-8551-4523-94e4-aa8d4c518a5d tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:35:20.118868 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-56f06df5-8551-4523-94e4-aa8d4c518a5d tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:35:20.118868 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-56f06df5-8551-4523-94e4-aa8d4c518a5d tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:35:20.118868 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-56f06df5-8551-4523-94e4-aa8d4c518a5d tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:35:20.260857 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-56f06df5-8551-4523-94e4-aa8d4c518a5d tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3170dc3323f54512bc8819c8efa86b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7121bd118a2549c39332cfdb7edaa92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:35:20.270444 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-56f06df5-8551-4523-94e4-aa8d4c518a5d tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] 10.222.0.121 "GET /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e" status: 200 len: 1525 microversion: 2.1 time: 0.166531 Aug 04 10:35:20.271353 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 190/363] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:35:20 2022] GET /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e => generated 1525 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:35:20.902053 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-efd56f1e-8bcd-4b8b-9481-9aa23c6e7715 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:35:20.902630 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-efd56f1e-8bcd-4b8b-9481-9aa23c6e7715 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] [instance: cabceac5-859e-4c28-86c2-aa9b63953009] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:35:20.905219 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG dbcounter [-] [124456] Writing DB stats nova_api:SELECT=36 {{(pid=124456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:35:20.910473 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-9a73d7ef-feb3-4863-9df9-507eef9039cd tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-572899381", "imageRef": "46724bb5-955f-4f3f-bd6a-b561fdde55e3", "flavorRef": "452", "networks": [{"uuid": "99e987b2-437b-4fd9-a5b4-feb93bfcea0d"}]}} {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:35:20.913211 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-efd56f1e-8bcd-4b8b-9481-9aa23c6e7715 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:35:20.913675 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-efd56f1e-8bcd-4b8b-9481-9aa23c6e7715 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:35:20.914487 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-efd56f1e-8bcd-4b8b-9481-9aa23c6e7715 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:35:20.914965 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-efd56f1e-8bcd-4b8b-9481-9aa23c6e7715 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:35:20.935611 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.wsgi [None req-efd56f1e-8bcd-4b8b-9481-9aa23c6e7715 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] HTTP exception thrown: Instance cabceac5-859e-4c28-86c2-aa9b63953009 could not be found. Aug 04 10:35:20.937585 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-efd56f1e-8bcd-4b8b-9481-9aa23c6e7715 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Request method failure captured: Aug 04 10:35:20.937585 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: request: DELETE /compute/v2.1/servers/cabceac5-859e-4c28-86c2-aa9b63953009 HTTP/1.1 Aug 04 10:35:20.937585 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: Accept: application/json Aug 04 10:35:20.937585 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: Accept-Encoding: identity Aug 04 10:35:20.937585 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: Connection: close Aug 04 10:35:20.937585 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: Content-Length: 0 Aug 04 10:35:20.937585 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: Content-Type: application/json Aug 04 10:35:20.937585 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: Host: 10.222.0.121 Aug 04 10:35:20.937585 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: Openstack-System-Scope: None Aug 04 10:35:20.937585 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: User-Agent: python-urllib3/1.26.11 Aug 04 10:35:20.937585 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Auth-Token: gAAAAABi66BdQTEi-TjjN9D2iQmSslgTLjbV5UHjvJipmLH4V7E9izdvzKsKu0OGksdrZN5JlTvt6Kt51cyMiO9zrLxnQVl-SDF7duCBvsS5Bw_8jELCN-YX6iqB_HbmfAbEixYYMzINmJBlqdWuPzgU433CxIP27Igy4J0NDGcRm9zfzq7Q62M Aug 04 10:35:20.937585 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Domain-Id: None Aug 04 10:35:20.937585 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Domain-Name: None Aug 04 10:35:20.937585 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Identity-Status: Confirmed Aug 04 10:35:20.937585 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Is-Admin-Project: True Aug 04 10:35:20.937585 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Project-Domain-Id: default Aug 04 10:35:20.937585 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Project-Domain-Name: Default Aug 04 10:35:20.937585 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Project-Id: c167faad577d47dfaf0d010a3f983fe3 Aug 04 10:35:20.937585 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Project-Name: tempest-DeleteServersTestJSON-1058389927 Aug 04 10:35:20.937585 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Role: reader,member Aug 04 10:35:20.937585 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Roles: reader,member Aug 04 10:35:20.938932 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/c167faad577d47dfaf0d010a3f983fe3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/c167faad577d47dfaf0d010a3f983fe3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.121:8080", "publicURL": "http://10.222.0.121:8080/v1/AUTH_c167faad577d47dfaf0d010a3f983fe3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2/c167faad577d47dfaf0d010a3f983fe3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:9696/networking"}]}] Aug 04 10:35:20.938932 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Tenant: tempest-DeleteServersTestJSON-1058389927 Aug 04 10:35:20.938932 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Tenant-Id: c167faad577d47dfaf0d010a3f983fe3 Aug 04 10:35:20.938932 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Tenant-Name: tempest-DeleteServersTestJSON-1058389927 Aug 04 10:35:20.938932 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-User: tempest-DeleteServersTestJSON-1058389927-project Aug 04 10:35:20.938932 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-User-Domain-Id: default Aug 04 10:35:20.938932 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-User-Domain-Name: Default Aug 04 10:35:20.938932 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-User-Id: 9520a49687b24281b78f08d43cb27dc3 Aug 04 10:35:20.938932 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-User-Name: tempest-DeleteServersTestJSON-1058389927-project Aug 04 10:35:20.938932 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: method: > Aug 04 10:35:20.938932 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: exception: Instance cabceac5-859e-4c28-86c2-aa9b63953009 could not be found. Aug 04 10:35:20.938932 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: action_args: {'id': 'cabceac5-859e-4c28-86c2-aa9b63953009'} Aug 04 10:35:20.939626 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 10:35:20.939626 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:35:20.939626 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 10:35:20.939626 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 10:35:20.939626 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 10:35:20.939626 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 10:35:20.939626 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 10:35:20.939626 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 10:35:20.939626 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 10:35:20.939626 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 10:35:20.939626 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cabceac5-859e-4c28-86c2-aa9b63953009 could not be found. Aug 04 10:35:20.939626 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi Aug 04 10:35:20.939626 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:35:20.939626 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi Aug 04 10:35:20.939626 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:35:20.939626 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:35:20.939626 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:35:20.939626 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 10:35:20.939626 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 10:35:20.939626 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 10:35:20.940937 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 10:35:20.940937 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 10:35:20.940937 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 10:35:20.940937 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 10:35:20.940937 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 10:35:20.940937 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 10:35:20.940937 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 10:35:20.940937 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 10:35:20.940937 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 10:35:20.940937 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cabceac5-859e-4c28-86c2-aa9b63953009 could not be found. Aug 04 10:35:20.940937 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi Aug 04 10:35:20.940937 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:35:20.940937 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi Aug 04 10:35:20.940937 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:35:20.940937 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:35:20.940937 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:35:20.940937 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 10:35:20.940937 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 10:35:20.940937 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cabceac5-859e-4c28-86c2-aa9b63953009 could not be found. Aug 04 10:35:20.940937 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi Aug 04 10:35:20.942084 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-efd56f1e-8bcd-4b8b-9481-9aa23c6e7715 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Returning 404 to user: Instance cabceac5-859e-4c28-86c2-aa9b63953009 could not be found. {{(pid=124456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 10:35:20.942084 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-efd56f1e-8bcd-4b8b-9481-9aa23c6e7715 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] 10.222.0.121 "DELETE /compute/v2.1/servers/cabceac5-859e-4c28-86c2-aa9b63953009" status: 404 len: 111 microversion: 2.1 time: 0.045847 Aug 04 10:35:20.942084 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 174/364] 10.222.0.121 () {58 vars in 1244 bytes} [Thu Aug 4 10:35:20 2022] DELETE /compute/v2.1/servers/cabceac5-859e-4c28-86c2-aa9b63953009 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 10:35:20.949931 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-f3ad4e36-fb5d-45d0-8958-8c007dda62a3 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:35:20.950644 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-f3ad4e36-fb5d-45d0-8958-8c007dda62a3 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] [instance: cabceac5-859e-4c28-86c2-aa9b63953009] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:35:20.957949 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-f3ad4e36-fb5d-45d0-8958-8c007dda62a3 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:35:20.958425 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-f3ad4e36-fb5d-45d0-8958-8c007dda62a3 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:35:20.959222 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-f3ad4e36-fb5d-45d0-8958-8c007dda62a3 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:35:20.960056 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-f3ad4e36-fb5d-45d0-8958-8c007dda62a3 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:35:20.972139 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.network.neutron [None req-9a73d7ef-feb3-4863-9df9-507eef9039cd tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] validate_networks() for [('99e987b2-437b-4fd9-a5b4-feb93bfcea0d', None, None, None, None, None)] {{(pid=124457) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 10:35:20.976300 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.wsgi [None req-f3ad4e36-fb5d-45d0-8958-8c007dda62a3 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] HTTP exception thrown: Instance cabceac5-859e-4c28-86c2-aa9b63953009 could not be found. Aug 04 10:35:20.978633 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-f3ad4e36-fb5d-45d0-8958-8c007dda62a3 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Request method failure captured: Aug 04 10:35:20.978633 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: request: GET /compute/v2.1/servers/cabceac5-859e-4c28-86c2-aa9b63953009 HTTP/1.1 Aug 04 10:35:20.978633 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: Accept: application/json Aug 04 10:35:20.978633 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: Accept-Encoding: identity Aug 04 10:35:20.978633 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: Connection: close Aug 04 10:35:20.978633 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: Content-Length: 0 Aug 04 10:35:20.978633 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: Content-Type: application/json Aug 04 10:35:20.978633 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: Host: 10.222.0.121 Aug 04 10:35:20.978633 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: Openstack-System-Scope: None Aug 04 10:35:20.978633 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: User-Agent: python-urllib3/1.26.11 Aug 04 10:35:20.978633 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Auth-Token: gAAAAABi66BdQTEi-TjjN9D2iQmSslgTLjbV5UHjvJipmLH4V7E9izdvzKsKu0OGksdrZN5JlTvt6Kt51cyMiO9zrLxnQVl-SDF7duCBvsS5Bw_8jELCN-YX6iqB_HbmfAbEixYYMzINmJBlqdWuPzgU433CxIP27Igy4J0NDGcRm9zfzq7Q62M Aug 04 10:35:20.978633 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Domain-Id: None Aug 04 10:35:20.978633 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Domain-Name: None Aug 04 10:35:20.978633 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Identity-Status: Confirmed Aug 04 10:35:20.978633 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Is-Admin-Project: True Aug 04 10:35:20.978633 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Project-Domain-Id: default Aug 04 10:35:20.978633 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Project-Domain-Name: Default Aug 04 10:35:20.978633 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Project-Id: c167faad577d47dfaf0d010a3f983fe3 Aug 04 10:35:20.978633 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Project-Name: tempest-DeleteServersTestJSON-1058389927 Aug 04 10:35:20.978633 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Role: reader,member Aug 04 10:35:20.978633 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Roles: reader,member Aug 04 10:35:20.980265 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/c167faad577d47dfaf0d010a3f983fe3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/c167faad577d47dfaf0d010a3f983fe3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.121:8080", "publicURL": "http://10.222.0.121:8080/v1/AUTH_c167faad577d47dfaf0d010a3f983fe3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2/c167faad577d47dfaf0d010a3f983fe3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:9696/networking"}]}] Aug 04 10:35:20.980265 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Tenant: tempest-DeleteServersTestJSON-1058389927 Aug 04 10:35:20.980265 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Tenant-Id: c167faad577d47dfaf0d010a3f983fe3 Aug 04 10:35:20.980265 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Tenant-Name: tempest-DeleteServersTestJSON-1058389927 Aug 04 10:35:20.980265 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-User: tempest-DeleteServersTestJSON-1058389927-project Aug 04 10:35:20.980265 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-User-Domain-Id: default Aug 04 10:35:20.980265 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-User-Domain-Name: Default Aug 04 10:35:20.980265 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-User-Id: 9520a49687b24281b78f08d43cb27dc3 Aug 04 10:35:20.980265 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-User-Name: tempest-DeleteServersTestJSON-1058389927-project Aug 04 10:35:20.980265 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: method: > Aug 04 10:35:20.980265 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: exception: Instance cabceac5-859e-4c28-86c2-aa9b63953009 could not be found. Aug 04 10:35:20.980265 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: action_args: {'id': 'cabceac5-859e-4c28-86c2-aa9b63953009'} Aug 04 10:35:20.981118 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 10:35:20.981118 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:35:20.981118 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 10:35:20.981118 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 10:35:20.981118 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 10:35:20.981118 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 10:35:20.981118 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 10:35:20.981118 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 10:35:20.981118 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 10:35:20.981118 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 10:35:20.981118 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cabceac5-859e-4c28-86c2-aa9b63953009 could not be found. Aug 04 10:35:20.981118 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi Aug 04 10:35:20.981118 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:35:20.981118 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi Aug 04 10:35:20.981118 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:35:20.981118 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:35:20.981118 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:35:20.981118 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 10:35:20.981118 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 10:35:20.981118 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 10:35:20.982611 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 10:35:20.982611 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 10:35:20.982611 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 10:35:20.982611 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 10:35:20.982611 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 10:35:20.982611 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 10:35:20.982611 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 10:35:20.982611 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cabceac5-859e-4c28-86c2-aa9b63953009 could not be found. Aug 04 10:35:20.982611 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi Aug 04 10:35:20.982611 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:35:20.982611 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi Aug 04 10:35:20.982611 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:35:20.982611 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:35:20.982611 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:35:20.982611 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 10:35:20.982611 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 10:35:20.982611 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cabceac5-859e-4c28-86c2-aa9b63953009 could not be found. Aug 04 10:35:20.982611 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi Aug 04 10:35:20.984505 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-f3ad4e36-fb5d-45d0-8958-8c007dda62a3 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] Returning 404 to user: Instance cabceac5-859e-4c28-86c2-aa9b63953009 could not be found. {{(pid=124456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 10:35:20.984505 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-f3ad4e36-fb5d-45d0-8958-8c007dda62a3 tempest-DeleteServersTestJSON-1058389927 tempest-DeleteServersTestJSON-1058389927-project] 10.222.0.121 "GET /compute/v2.1/servers/cabceac5-859e-4c28-86c2-aa9b63953009" status: 404 len: 111 microversion: 2.1 time: 0.035164 Aug 04 10:35:20.984505 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 175/365] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:35:20 2022] GET /compute/v2.1/servers/cabceac5-859e-4c28-86c2-aa9b63953009 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 10:35:21.302307 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-cfd645c6-304f-401f-85eb-a3cc115db272 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:35:21.303553 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-cfd645c6-304f-401f-85eb-a3cc115db272 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] [instance: 2583b630-2f89-45ba-b781-c0b7c206d61e] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:35:21.310847 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-cfd645c6-304f-401f-85eb-a3cc115db272 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:35:21.311507 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-cfd645c6-304f-401f-85eb-a3cc115db272 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:35:21.312451 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-cfd645c6-304f-401f-85eb-a3cc115db272 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:35:21.313277 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-cfd645c6-304f-401f-85eb-a3cc115db272 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:35:21.677326 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.virt.hardware [None req-9a73d7ef-feb3-4863-9df9-507eef9039cd tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Flavor limits 0:0:0 {{(pid=124457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 10:35:21.678675 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.virt.hardware [None req-9a73d7ef-feb3-4863-9df9-507eef9039cd tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Image limits 0:0:0 {{(pid=124457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 10:35:21.679401 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.virt.hardware [None req-9a73d7ef-feb3-4863-9df9-507eef9039cd tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Flavor pref 0:0:0 {{(pid=124457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 10:35:21.679888 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.virt.hardware [None req-9a73d7ef-feb3-4863-9df9-507eef9039cd tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Image pref 0:0:0 {{(pid=124457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 10:35:21.680405 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.virt.hardware [None req-9a73d7ef-feb3-4863-9df9-507eef9039cd tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 10:35:21.706375 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-9a73d7ef-feb3-4863-9df9-507eef9039cd tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:35:21.707164 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-9a73d7ef-feb3-4863-9df9-507eef9039cd tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:35:21.708385 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-9a73d7ef-feb3-4863-9df9-507eef9039cd tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:35:21.709075 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-9a73d7ef-feb3-4863-9df9-507eef9039cd tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:35:21.734549 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.quota [None req-9a73d7ef-feb3-4863-9df9-507eef9039cd tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Getting quotas for project 99b1be624402454ba326a7d7a8754a25. Resources: {'ram', 'instances', 'cores'} {{(pid=124457) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 10:35:21.743403 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.quota [None req-9a73d7ef-feb3-4863-9df9-507eef9039cd tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Getting quotas for user a025ea88db864b55b7537311d20f4808 and project 99b1be624402454ba326a7d7a8754a25. Resources: {'ram', 'instances', 'cores'} {{(pid=124457) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 10:35:21.772357 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-9a73d7ef-feb3-4863-9df9-507eef9039cd tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Going to run 1 instances... {{(pid=124457) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 10:35:21.774821 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-9a73d7ef-feb3-4863-9df9-507eef9039cd tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] [instance: d7dac030-31a6-430e-9099-4f7117d7384a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='46724bb5-955f-4f3f-bd6a-b561fdde55e3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124457) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 10:35:21.782874 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-cfd645c6-304f-401f-85eb-a3cc115db272 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3170dc3323f54512bc8819c8efa86b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7121bd118a2549c39332cfdb7edaa92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:35:21.794868 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-cfd645c6-304f-401f-85eb-a3cc115db272 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] 10.222.0.121 "GET /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e" status: 200 len: 1525 microversion: 2.1 time: 0.502404 Aug 04 10:35:21.796974 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 176/366] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:35:21 2022] GET /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e => generated 1525 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:35:21.839875 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-9a73d7ef-feb3-4863-9df9-507eef9039cd tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] 10.222.0.121 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 0.933404 Aug 04 10:35:21.841297 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 191/367] 10.222.0.121 () {60 vars in 1152 bytes} [Thu Aug 4 10:35:20 2022] POST /compute/v2.1/servers => generated 382 bytes in 935 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Aug 04 10:35:21.860772 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-4cd63d01-7488-4297-80bb-10953d3db384 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:35:21.862005 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-4cd63d01-7488-4297-80bb-10953d3db384 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] [instance: d7dac030-31a6-430e-9099-4f7117d7384a] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:35:21.953712 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-4cd63d01-7488-4297-80bb-10953d3db384 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a025ea88db864b55b7537311d20f4808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b1be624402454ba326a7d7a8754a25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:35:21.963890 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-4cd63d01-7488-4297-80bb-10953d3db384 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] 10.222.0.121 "GET /compute/v2.1/servers/d7dac030-31a6-430e-9099-4f7117d7384a" status: 200 len: 1217 microversion: 2.1 time: 0.111739 Aug 04 10:35:21.965416 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 177/368] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:35:21 2022] GET /compute/v2.1/servers/d7dac030-31a6-430e-9099-4f7117d7384a => generated 1217 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:35:22.819623 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-f6b79492-994e-4d35-8c0e-5645cc035d7a tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:35:22.820352 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-f6b79492-994e-4d35-8c0e-5645cc035d7a tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] [instance: 2583b630-2f89-45ba-b781-c0b7c206d61e] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:35:22.828585 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-f6b79492-994e-4d35-8c0e-5645cc035d7a tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:35:22.829042 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-f6b79492-994e-4d35-8c0e-5645cc035d7a tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:35:22.830067 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-f6b79492-994e-4d35-8c0e-5645cc035d7a tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:35:22.830525 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-f6b79492-994e-4d35-8c0e-5645cc035d7a tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:35:22.984047 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-f6b79492-994e-4d35-8c0e-5645cc035d7a tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3170dc3323f54512bc8819c8efa86b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7121bd118a2549c39332cfdb7edaa92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:35:22.996168 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-f6b79492-994e-4d35-8c0e-5645cc035d7a tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] 10.222.0.121 "GET /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e" status: 200 len: 1525 microversion: 2.1 time: 0.180376 Aug 04 10:35:22.997136 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 192/369] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:35:22 2022] GET /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e => generated 1525 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:35:23.005397 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-aad6462c-a078-4d85-9d37-e2b2d5049a54 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:35:23.007215 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-aad6462c-a078-4d85-9d37-e2b2d5049a54 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] [instance: d7dac030-31a6-430e-9099-4f7117d7384a] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:35:23.014625 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-aad6462c-a078-4d85-9d37-e2b2d5049a54 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:35:23.015074 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-aad6462c-a078-4d85-9d37-e2b2d5049a54 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:35:23.015922 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-aad6462c-a078-4d85-9d37-e2b2d5049a54 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:35:23.016399 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-aad6462c-a078-4d85-9d37-e2b2d5049a54 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:35:23.092133 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-aad6462c-a078-4d85-9d37-e2b2d5049a54 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a025ea88db864b55b7537311d20f4808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b1be624402454ba326a7d7a8754a25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:35:23.102894 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-aad6462c-a078-4d85-9d37-e2b2d5049a54 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] 10.222.0.121 "GET /compute/v2.1/servers/d7dac030-31a6-430e-9099-4f7117d7384a" status: 200 len: 1269 microversion: 2.1 time: 0.108691 Aug 04 10:35:23.103681 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 178/370] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:35:22 2022] GET /compute/v2.1/servers/d7dac030-31a6-430e-9099-4f7117d7384a => generated 1269 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:35:24.035721 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-2cd34738-b127-4625-ac33-7cf5837a651e tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:35:24.038175 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-2cd34738-b127-4625-ac33-7cf5837a651e tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] [instance: 2583b630-2f89-45ba-b781-c0b7c206d61e] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:35:24.045131 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG dbcounter [-] [124457] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=124457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:35:24.065398 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-2cd34738-b127-4625-ac33-7cf5837a651e tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:35:24.066230 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-2cd34738-b127-4625-ac33-7cf5837a651e tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:35:24.067720 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-2cd34738-b127-4625-ac33-7cf5837a651e tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:35:24.068580 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-2cd34738-b127-4625-ac33-7cf5837a651e tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:35:24.140604 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-7f228363-3667-4938-8ce5-7e8d2c74726c tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:35:24.144110 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-7f228363-3667-4938-8ce5-7e8d2c74726c tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] [instance: d7dac030-31a6-430e-9099-4f7117d7384a] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:35:24.167517 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-7f228363-3667-4938-8ce5-7e8d2c74726c tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:35:24.167517 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-7f228363-3667-4938-8ce5-7e8d2c74726c tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:35:24.173717 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-7f228363-3667-4938-8ce5-7e8d2c74726c tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:35:24.180890 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-7f228363-3667-4938-8ce5-7e8d2c74726c tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:35:24.407292 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-2cd34738-b127-4625-ac33-7cf5837a651e tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3170dc3323f54512bc8819c8efa86b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7121bd118a2549c39332cfdb7edaa92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:35:24.420616 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-2cd34738-b127-4625-ac33-7cf5837a651e tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] 10.222.0.121 "GET /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e" status: 200 len: 1525 microversion: 2.1 time: 0.405643 Aug 04 10:35:24.422743 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 193/371] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:35:24 2022] GET /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e => generated 1525 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:35:24.592335 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-7f228363-3667-4938-8ce5-7e8d2c74726c tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a025ea88db864b55b7537311d20f4808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b1be624402454ba326a7d7a8754a25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:35:24.604564 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-7f228363-3667-4938-8ce5-7e8d2c74726c tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] 10.222.0.121 "GET /compute/v2.1/servers/d7dac030-31a6-430e-9099-4f7117d7384a" status: 200 len: 1317 microversion: 2.1 time: 0.481756 Aug 04 10:35:24.605166 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 179/372] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:35:24 2022] GET /compute/v2.1/servers/d7dac030-31a6-430e-9099-4f7117d7384a => generated 1317 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 10:35:25.229483 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [req-139c32e9-38d0-45aa-8316-f1c06b239ca2 req-bb2b0088-f057-48dd-ba94-4feb0d02efa6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7dac030-31a6-430e-9099-4f7117d7384a", "tag": "c4972808-e85a-4918-b524-710ad51084cb"}]} {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:35:25.262678 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [req-139c32e9-38d0-45aa-8316-f1c06b239ca2 req-bb2b0088-f057-48dd-ba94-4feb0d02efa6 service nova] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:35:25.263126 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [req-139c32e9-38d0-45aa-8316-f1c06b239ca2 req-bb2b0088-f057-48dd-ba94-4feb0d02efa6 service nova] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:35:25.294838 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.compute.server_external_events [req-139c32e9-38d0-45aa-8316-f1c06b239ca2 req-bb2b0088-f057-48dd-ba94-4feb0d02efa6 service nova] Creating event network-changed:c4972808-e85a-4918-b524-710ad51084cb for instance d7dac030-31a6-430e-9099-4f7117d7384a on hv-cinder-85200 Aug 04 10:35:25.303669 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [req-139c32e9-38d0-45aa-8316-f1c06b239ca2 req-bb2b0088-f057-48dd-ba94-4feb0d02efa6 service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076709 Aug 04 10:35:25.308595 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 194/373] 10.222.0.121 () {64 vars in 1322 bytes} [Thu Aug 4 10:35:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:35:25.452806 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-c163f599-28ae-4e55-85b5-8eb5b56b9f60 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:35:25.454754 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-c163f599-28ae-4e55-85b5-8eb5b56b9f60 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] [instance: 2583b630-2f89-45ba-b781-c0b7c206d61e] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:35:25.464616 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-c163f599-28ae-4e55-85b5-8eb5b56b9f60 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:35:25.465563 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-c163f599-28ae-4e55-85b5-8eb5b56b9f60 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:35:25.467316 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-c163f599-28ae-4e55-85b5-8eb5b56b9f60 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:35:25.468116 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-c163f599-28ae-4e55-85b5-8eb5b56b9f60 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:35:25.634142 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-4d7075fb-ceac-4801-ae1f-1e9b399c5c36 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:35:25.636392 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-4d7075fb-ceac-4801-ae1f-1e9b399c5c36 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] [instance: d7dac030-31a6-430e-9099-4f7117d7384a] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:35:25.660211 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-4d7075fb-ceac-4801-ae1f-1e9b399c5c36 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:35:25.660787 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-4d7075fb-ceac-4801-ae1f-1e9b399c5c36 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:35:25.661700 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-4d7075fb-ceac-4801-ae1f-1e9b399c5c36 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:35:25.662241 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-4d7075fb-ceac-4801-ae1f-1e9b399c5c36 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:35:25.835000 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-c163f599-28ae-4e55-85b5-8eb5b56b9f60 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3170dc3323f54512bc8819c8efa86b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7121bd118a2549c39332cfdb7edaa92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:35:25.851246 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-c163f599-28ae-4e55-85b5-8eb5b56b9f60 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] 10.222.0.121 "GET /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e" status: 200 len: 1525 microversion: 2.1 time: 0.403925 Aug 04 10:35:25.864501 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 180/374] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:35:25 2022] GET /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e => generated 1525 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 10:35:25.984970 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-4d7075fb-ceac-4801-ae1f-1e9b399c5c36 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a025ea88db864b55b7537311d20f4808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b1be624402454ba326a7d7a8754a25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:35:26.000449 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-4d7075fb-ceac-4801-ae1f-1e9b399c5c36 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] 10.222.0.121 "GET /compute/v2.1/servers/d7dac030-31a6-430e-9099-4f7117d7384a" status: 200 len: 1317 microversion: 2.1 time: 0.373951 Aug 04 10:35:26.002091 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 195/375] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:35:25 2022] GET /compute/v2.1/servers/d7dac030-31a6-430e-9099-4f7117d7384a => generated 1317 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:35:26.882131 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-eeec77ed-32d8-4cf2-9de0-571b014024ac tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:35:26.882935 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-eeec77ed-32d8-4cf2-9de0-571b014024ac tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] [instance: 2583b630-2f89-45ba-b781-c0b7c206d61e] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:35:26.890568 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-eeec77ed-32d8-4cf2-9de0-571b014024ac tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:35:26.891235 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-eeec77ed-32d8-4cf2-9de0-571b014024ac tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:35:26.892192 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-eeec77ed-32d8-4cf2-9de0-571b014024ac tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:35:26.892748 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-eeec77ed-32d8-4cf2-9de0-571b014024ac tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:35:27.027280 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-355b060b-d503-4641-96a4-4e7e5b5eca4f tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:35:27.034904 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-355b060b-d503-4641-96a4-4e7e5b5eca4f tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] [instance: d7dac030-31a6-430e-9099-4f7117d7384a] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:35:27.053471 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-355b060b-d503-4641-96a4-4e7e5b5eca4f tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:35:27.054221 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-355b060b-d503-4641-96a4-4e7e5b5eca4f tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:35:27.055399 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-355b060b-d503-4641-96a4-4e7e5b5eca4f tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:35:27.056171 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-355b060b-d503-4641-96a4-4e7e5b5eca4f tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:35:27.081112 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-eeec77ed-32d8-4cf2-9de0-571b014024ac tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3170dc3323f54512bc8819c8efa86b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7121bd118a2549c39332cfdb7edaa92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:35:27.093423 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-eeec77ed-32d8-4cf2-9de0-571b014024ac tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] 10.222.0.121 "GET /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e" status: 200 len: 1525 microversion: 2.1 time: 0.218792 Aug 04 10:35:27.096704 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 181/376] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:35:26 2022] GET /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e => generated 1525 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:35:27.241057 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-355b060b-d503-4641-96a4-4e7e5b5eca4f tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a025ea88db864b55b7537311d20f4808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b1be624402454ba326a7d7a8754a25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:35:27.251111 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-355b060b-d503-4641-96a4-4e7e5b5eca4f tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] 10.222.0.121 "GET /compute/v2.1/servers/d7dac030-31a6-430e-9099-4f7117d7384a" status: 200 len: 1317 microversion: 2.1 time: 0.228868 Aug 04 10:35:27.256079 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 196/377] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:35:27 2022] GET /compute/v2.1/servers/d7dac030-31a6-430e-9099-4f7117d7384a => generated 1317 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:35:28.123220 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-3db61936-ac42-4e9f-b012-c9c7feb99dac tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:35:28.124345 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-3db61936-ac42-4e9f-b012-c9c7feb99dac tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] [instance: 2583b630-2f89-45ba-b781-c0b7c206d61e] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:35:28.143722 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-3db61936-ac42-4e9f-b012-c9c7feb99dac tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:35:28.144254 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-3db61936-ac42-4e9f-b012-c9c7feb99dac tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:35:28.145129 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-3db61936-ac42-4e9f-b012-c9c7feb99dac tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:35:28.145583 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-3db61936-ac42-4e9f-b012-c9c7feb99dac tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:35:28.276581 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-eb6fd30f-c8bd-489f-8981-d8c632e960a8 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:35:28.279705 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-eb6fd30f-c8bd-489f-8981-d8c632e960a8 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] [instance: d7dac030-31a6-430e-9099-4f7117d7384a] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:35:28.288991 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-eb6fd30f-c8bd-489f-8981-d8c632e960a8 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:35:28.289889 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-eb6fd30f-c8bd-489f-8981-d8c632e960a8 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:35:28.291323 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-eb6fd30f-c8bd-489f-8981-d8c632e960a8 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:35:28.291925 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-eb6fd30f-c8bd-489f-8981-d8c632e960a8 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:35:28.359695 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-3db61936-ac42-4e9f-b012-c9c7feb99dac tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3170dc3323f54512bc8819c8efa86b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7121bd118a2549c39332cfdb7edaa92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:35:28.370390 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-3db61936-ac42-4e9f-b012-c9c7feb99dac tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] 10.222.0.121 "GET /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e" status: 200 len: 1525 microversion: 2.1 time: 0.253994 Aug 04 10:35:28.371776 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 182/378] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:35:28 2022] GET /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e => generated 1525 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:35:28.559113 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-eb6fd30f-c8bd-489f-8981-d8c632e960a8 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a025ea88db864b55b7537311d20f4808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b1be624402454ba326a7d7a8754a25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:35:28.568590 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-eb6fd30f-c8bd-489f-8981-d8c632e960a8 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] 10.222.0.121 "GET /compute/v2.1/servers/d7dac030-31a6-430e-9099-4f7117d7384a" status: 200 len: 1317 microversion: 2.1 time: 0.297742 Aug 04 10:35:28.569253 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 197/379] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:35:28 2022] GET /compute/v2.1/servers/d7dac030-31a6-430e-9099-4f7117d7384a => generated 1317 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:35:29.398775 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-ed4dd43a-bb61-4234-a05d-0fe391371f63 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:35:29.399370 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-ed4dd43a-bb61-4234-a05d-0fe391371f63 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] [instance: 2583b630-2f89-45ba-b781-c0b7c206d61e] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:35:29.407009 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-ed4dd43a-bb61-4234-a05d-0fe391371f63 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:35:29.407737 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-ed4dd43a-bb61-4234-a05d-0fe391371f63 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:35:29.408554 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-ed4dd43a-bb61-4234-a05d-0fe391371f63 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:35:29.409007 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-ed4dd43a-bb61-4234-a05d-0fe391371f63 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:35:29.594848 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-ed4dd43a-bb61-4234-a05d-0fe391371f63 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3170dc3323f54512bc8819c8efa86b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7121bd118a2549c39332cfdb7edaa92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:35:29.597820 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-3a61f5e6-962b-433b-a09f-41f808b139a8 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:35:29.601228 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-3a61f5e6-962b-433b-a09f-41f808b139a8 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] [instance: d7dac030-31a6-430e-9099-4f7117d7384a] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:35:29.610969 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-3a61f5e6-962b-433b-a09f-41f808b139a8 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:35:29.612041 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-ed4dd43a-bb61-4234-a05d-0fe391371f63 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] 10.222.0.121 "GET /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e" status: 200 len: 1525 microversion: 2.1 time: 0.219679 Aug 04 10:35:29.612923 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-3a61f5e6-962b-433b-a09f-41f808b139a8 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:35:29.613088 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 183/380] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:35:29 2022] GET /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e => generated 1525 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:35:29.614199 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-3a61f5e6-962b-433b-a09f-41f808b139a8 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:35:29.614703 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-3a61f5e6-962b-433b-a09f-41f808b139a8 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:35:29.791370 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-3a61f5e6-962b-433b-a09f-41f808b139a8 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a025ea88db864b55b7537311d20f4808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b1be624402454ba326a7d7a8754a25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:35:29.800881 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-3a61f5e6-962b-433b-a09f-41f808b139a8 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] 10.222.0.121 "GET /compute/v2.1/servers/d7dac030-31a6-430e-9099-4f7117d7384a" status: 200 len: 1317 microversion: 2.1 time: 0.213271 Aug 04 10:35:29.801502 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 198/381] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:35:29 2022] GET /compute/v2.1/servers/d7dac030-31a6-430e-9099-4f7117d7384a => generated 1317 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 10:35:30.634765 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-1ac05dd4-333d-443a-ad38-aad4cc6e470b tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:35:30.635438 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-1ac05dd4-333d-443a-ad38-aad4cc6e470b tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] [instance: 2583b630-2f89-45ba-b781-c0b7c206d61e] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:35:30.644181 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-1ac05dd4-333d-443a-ad38-aad4cc6e470b tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:35:30.645049 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-1ac05dd4-333d-443a-ad38-aad4cc6e470b tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:35:30.646450 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-1ac05dd4-333d-443a-ad38-aad4cc6e470b tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:35:30.647267 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-1ac05dd4-333d-443a-ad38-aad4cc6e470b tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:35:30.830429 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-24e434cc-1a0d-47fb-b8ff-599b75f9e4f3 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:35:30.833241 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-24e434cc-1a0d-47fb-b8ff-599b75f9e4f3 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] [instance: d7dac030-31a6-430e-9099-4f7117d7384a] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:35:30.843828 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-24e434cc-1a0d-47fb-b8ff-599b75f9e4f3 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:35:30.844362 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-24e434cc-1a0d-47fb-b8ff-599b75f9e4f3 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:35:30.845395 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-24e434cc-1a0d-47fb-b8ff-599b75f9e4f3 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:35:30.846263 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-24e434cc-1a0d-47fb-b8ff-599b75f9e4f3 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:35:30.847283 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-1ac05dd4-333d-443a-ad38-aad4cc6e470b tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3170dc3323f54512bc8819c8efa86b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7121bd118a2549c39332cfdb7edaa92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:35:30.861854 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-1ac05dd4-333d-443a-ad38-aad4cc6e470b tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] 10.222.0.121 "GET /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e" status: 200 len: 1525 microversion: 2.1 time: 0.230814 Aug 04 10:35:30.863348 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 184/382] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:35:30 2022] GET /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e => generated 1525 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 10:35:31.023318 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-24e434cc-1a0d-47fb-b8ff-599b75f9e4f3 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a025ea88db864b55b7537311d20f4808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b1be624402454ba326a7d7a8754a25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:35:31.034416 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-24e434cc-1a0d-47fb-b8ff-599b75f9e4f3 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] 10.222.0.121 "GET /compute/v2.1/servers/d7dac030-31a6-430e-9099-4f7117d7384a" status: 200 len: 1317 microversion: 2.1 time: 0.212825 Aug 04 10:35:31.035125 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 199/383] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:35:30 2022] GET /compute/v2.1/servers/d7dac030-31a6-430e-9099-4f7117d7384a => generated 1317 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:35:31.905704 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-19f80f09-ffc9-4d37-8cc8-ff5bc37f9c60 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:35:31.907436 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-19f80f09-ffc9-4d37-8cc8-ff5bc37f9c60 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] [instance: 2583b630-2f89-45ba-b781-c0b7c206d61e] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:35:31.923254 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-19f80f09-ffc9-4d37-8cc8-ff5bc37f9c60 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:35:31.924993 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-19f80f09-ffc9-4d37-8cc8-ff5bc37f9c60 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:35:31.927168 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-19f80f09-ffc9-4d37-8cc8-ff5bc37f9c60 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:35:31.928925 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-19f80f09-ffc9-4d37-8cc8-ff5bc37f9c60 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:35:31.958892 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG dbcounter [-] [124456] Writing DB stats nova_cell0:SELECT=2 {{(pid=124456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:35:32.059666 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-bcec7de8-1fee-436d-86bb-e117522f074a tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:35:32.060628 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-bcec7de8-1fee-436d-86bb-e117522f074a tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] [instance: d7dac030-31a6-430e-9099-4f7117d7384a] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:35:32.065663 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG dbcounter [-] [124457] Writing DB stats nova_cell0:SELECT=2 {{(pid=124457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:35:32.067116 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG dbcounter [-] [124457] Writing DB stats nova_cell0:SELECT=6 {{(pid=124457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:35:32.074641 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-bcec7de8-1fee-436d-86bb-e117522f074a tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:35:32.075353 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-bcec7de8-1fee-436d-86bb-e117522f074a tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:35:32.076420 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-bcec7de8-1fee-436d-86bb-e117522f074a tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:35:32.077026 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-bcec7de8-1fee-436d-86bb-e117522f074a tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:35:32.104359 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG dbcounter [-] [124457] Writing DB stats nova_cell1:SELECT=100 {{(pid=124457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:35:32.214789 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-19f80f09-ffc9-4d37-8cc8-ff5bc37f9c60 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3170dc3323f54512bc8819c8efa86b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7121bd118a2549c39332cfdb7edaa92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:35:32.225501 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-19f80f09-ffc9-4d37-8cc8-ff5bc37f9c60 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] 10.222.0.121 "GET /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e" status: 200 len: 1525 microversion: 2.1 time: 0.328287 Aug 04 10:35:32.225501 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 185/384] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:35:31 2022] GET /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e => generated 1525 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:35:32.312251 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-bcec7de8-1fee-436d-86bb-e117522f074a tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a025ea88db864b55b7537311d20f4808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b1be624402454ba326a7d7a8754a25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:35:32.323062 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-bcec7de8-1fee-436d-86bb-e117522f074a tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] 10.222.0.121 "GET /compute/v2.1/servers/d7dac030-31a6-430e-9099-4f7117d7384a" status: 200 len: 1317 microversion: 2.1 time: 0.268325 Aug 04 10:35:32.323868 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 200/385] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:35:32 2022] GET /compute/v2.1/servers/d7dac030-31a6-430e-9099-4f7117d7384a => generated 1317 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:35:33.248019 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-d3fa2aeb-a751-4ae4-a0d5-707647e5b160 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:35:33.249120 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-d3fa2aeb-a751-4ae4-a0d5-707647e5b160 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] [instance: 2583b630-2f89-45ba-b781-c0b7c206d61e] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:35:33.256602 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-d3fa2aeb-a751-4ae4-a0d5-707647e5b160 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:35:33.257439 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-d3fa2aeb-a751-4ae4-a0d5-707647e5b160 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:35:33.258304 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-d3fa2aeb-a751-4ae4-a0d5-707647e5b160 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:35:33.259087 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-d3fa2aeb-a751-4ae4-a0d5-707647e5b160 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:35:33.346117 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-755ffd89-afd3-4c28-9ae6-9def10a52f00 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:35:33.346711 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-755ffd89-afd3-4c28-9ae6-9def10a52f00 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] [instance: d7dac030-31a6-430e-9099-4f7117d7384a] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:35:33.355328 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-755ffd89-afd3-4c28-9ae6-9def10a52f00 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:35:33.356398 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-755ffd89-afd3-4c28-9ae6-9def10a52f00 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:35:33.358083 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-755ffd89-afd3-4c28-9ae6-9def10a52f00 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:35:33.358673 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-755ffd89-afd3-4c28-9ae6-9def10a52f00 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:35:33.473547 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-d3fa2aeb-a751-4ae4-a0d5-707647e5b160 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3170dc3323f54512bc8819c8efa86b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7121bd118a2549c39332cfdb7edaa92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:35:33.482150 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-d3fa2aeb-a751-4ae4-a0d5-707647e5b160 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] 10.222.0.121 "GET /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e" status: 200 len: 1525 microversion: 2.1 time: 0.238767 Aug 04 10:35:33.483003 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 186/386] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:35:33 2022] GET /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e => generated 1525 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:35:33.559068 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-755ffd89-afd3-4c28-9ae6-9def10a52f00 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a025ea88db864b55b7537311d20f4808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b1be624402454ba326a7d7a8754a25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:35:33.573020 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-755ffd89-afd3-4c28-9ae6-9def10a52f00 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] 10.222.0.121 "GET /compute/v2.1/servers/d7dac030-31a6-430e-9099-4f7117d7384a" status: 200 len: 1317 microversion: 2.1 time: 0.230795 Aug 04 10:35:33.574008 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 201/387] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:35:33 2022] GET /compute/v2.1/servers/d7dac030-31a6-430e-9099-4f7117d7384a => generated 1317 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:35:34.505602 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-96a10728-6b6b-4275-bf37-ebccf0551ad4 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:35:34.506282 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-96a10728-6b6b-4275-bf37-ebccf0551ad4 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] [instance: 2583b630-2f89-45ba-b781-c0b7c206d61e] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:35:34.513112 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-96a10728-6b6b-4275-bf37-ebccf0551ad4 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:35:34.513571 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-96a10728-6b6b-4275-bf37-ebccf0551ad4 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:35:34.514366 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-96a10728-6b6b-4275-bf37-ebccf0551ad4 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:35:34.514817 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-96a10728-6b6b-4275-bf37-ebccf0551ad4 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:35:34.605438 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-fe72b61b-a8e4-4d4a-b838-d9b3644930ee tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:35:34.607847 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-fe72b61b-a8e4-4d4a-b838-d9b3644930ee tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] [instance: d7dac030-31a6-430e-9099-4f7117d7384a] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:35:34.621088 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-fe72b61b-a8e4-4d4a-b838-d9b3644930ee tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:35:34.622020 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-fe72b61b-a8e4-4d4a-b838-d9b3644930ee tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:35:34.623530 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-fe72b61b-a8e4-4d4a-b838-d9b3644930ee tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:35:34.624576 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-fe72b61b-a8e4-4d4a-b838-d9b3644930ee tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:35:34.689163 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-96a10728-6b6b-4275-bf37-ebccf0551ad4 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3170dc3323f54512bc8819c8efa86b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7121bd118a2549c39332cfdb7edaa92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:35:34.698208 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-96a10728-6b6b-4275-bf37-ebccf0551ad4 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] 10.222.0.121 "GET /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e" status: 200 len: 1525 microversion: 2.1 time: 0.197422 Aug 04 10:35:34.699178 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 187/388] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:35:34 2022] GET /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e => generated 1525 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:35:34.803271 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-fe72b61b-a8e4-4d4a-b838-d9b3644930ee tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a025ea88db864b55b7537311d20f4808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b1be624402454ba326a7d7a8754a25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:35:34.815279 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-fe72b61b-a8e4-4d4a-b838-d9b3644930ee tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] 10.222.0.121 "GET /compute/v2.1/servers/d7dac030-31a6-430e-9099-4f7117d7384a" status: 200 len: 1317 microversion: 2.1 time: 0.217984 Aug 04 10:35:34.816336 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 202/389] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:35:34 2022] GET /compute/v2.1/servers/d7dac030-31a6-430e-9099-4f7117d7384a => generated 1317 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:35:35.721606 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-a5b621d4-63c6-44da-8069-ed602f906fbd tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:35:35.722467 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-a5b621d4-63c6-44da-8069-ed602f906fbd tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] [instance: 2583b630-2f89-45ba-b781-c0b7c206d61e] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:35:35.730159 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-a5b621d4-63c6-44da-8069-ed602f906fbd tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:35:35.730609 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-a5b621d4-63c6-44da-8069-ed602f906fbd tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:35:35.731406 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-a5b621d4-63c6-44da-8069-ed602f906fbd tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:35:35.731849 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-a5b621d4-63c6-44da-8069-ed602f906fbd tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:35:35.838703 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-6acfd8d9-4568-4190-b52d-0ec2ef7518f8 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:35:35.839421 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-6acfd8d9-4568-4190-b52d-0ec2ef7518f8 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] [instance: d7dac030-31a6-430e-9099-4f7117d7384a] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:35:35.847296 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-6acfd8d9-4568-4190-b52d-0ec2ef7518f8 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:35:35.847753 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-6acfd8d9-4568-4190-b52d-0ec2ef7518f8 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:35:35.849018 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-6acfd8d9-4568-4190-b52d-0ec2ef7518f8 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:35:35.849470 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-6acfd8d9-4568-4190-b52d-0ec2ef7518f8 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:35:35.945159 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-a5b621d4-63c6-44da-8069-ed602f906fbd tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3170dc3323f54512bc8819c8efa86b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7121bd118a2549c39332cfdb7edaa92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:35:35.956912 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-a5b621d4-63c6-44da-8069-ed602f906fbd tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] 10.222.0.121 "GET /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e" status: 200 len: 1525 microversion: 2.1 time: 0.240625 Aug 04 10:35:35.958025 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 188/390] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:35:35 2022] GET /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e => generated 1525 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:35:36.082485 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-6acfd8d9-4568-4190-b52d-0ec2ef7518f8 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a025ea88db864b55b7537311d20f4808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b1be624402454ba326a7d7a8754a25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:35:36.093530 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-6acfd8d9-4568-4190-b52d-0ec2ef7518f8 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] 10.222.0.121 "GET /compute/v2.1/servers/d7dac030-31a6-430e-9099-4f7117d7384a" status: 200 len: 1317 microversion: 2.1 time: 0.258912 Aug 04 10:35:36.094205 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 203/391] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:35:35 2022] GET /compute/v2.1/servers/d7dac030-31a6-430e-9099-4f7117d7384a => generated 1317 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 10:35:36.508834 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [req-dc4e76f0-a9e2-4551-8439-2fbe9d53e7e0 req-0dbb0e9a-3dac-434d-8d1f-e20792bd2da5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7dac030-31a6-430e-9099-4f7117d7384a", "name": "network-vif-plugged", "status": "completed", "tag": "c4972808-e85a-4918-b524-710ad51084cb"}]} {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:35:36.524475 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [req-dc4e76f0-a9e2-4551-8439-2fbe9d53e7e0 req-0dbb0e9a-3dac-434d-8d1f-e20792bd2da5 service nova] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:35:36.525797 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [req-dc4e76f0-a9e2-4551-8439-2fbe9d53e7e0 req-0dbb0e9a-3dac-434d-8d1f-e20792bd2da5 service nova] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:35:36.554658 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.compute.server_external_events [req-dc4e76f0-a9e2-4551-8439-2fbe9d53e7e0 req-0dbb0e9a-3dac-434d-8d1f-e20792bd2da5 service nova] Creating event network-vif-plugged:c4972808-e85a-4918-b524-710ad51084cb for instance d7dac030-31a6-430e-9099-4f7117d7384a on hv-cinder-85200 Aug 04 10:35:36.563339 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [req-dc4e76f0-a9e2-4551-8439-2fbe9d53e7e0 req-0dbb0e9a-3dac-434d-8d1f-e20792bd2da5 service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058680 Aug 04 10:35:36.565916 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 189/392] 10.222.0.121 () {64 vars in 1322 bytes} [Thu Aug 4 10:35:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:35:36.992483 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-952e1dca-776b-4588-a747-fa27dcfb53a5 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:35:36.993905 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-952e1dca-776b-4588-a747-fa27dcfb53a5 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] [instance: 2583b630-2f89-45ba-b781-c0b7c206d61e] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:35:37.005853 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-952e1dca-776b-4588-a747-fa27dcfb53a5 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:35:37.009384 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-952e1dca-776b-4588-a747-fa27dcfb53a5 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:35:37.010993 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-952e1dca-776b-4588-a747-fa27dcfb53a5 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:35:37.013327 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-952e1dca-776b-4588-a747-fa27dcfb53a5 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:35:37.124481 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-f4974113-a10c-4fee-9661-9590d9589ff1 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:35:37.125667 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-f4974113-a10c-4fee-9661-9590d9589ff1 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] [instance: d7dac030-31a6-430e-9099-4f7117d7384a] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:35:37.139246 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-f4974113-a10c-4fee-9661-9590d9589ff1 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:35:37.140809 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-f4974113-a10c-4fee-9661-9590d9589ff1 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:35:37.142336 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-f4974113-a10c-4fee-9661-9590d9589ff1 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:35:37.143306 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-f4974113-a10c-4fee-9661-9590d9589ff1 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:35:37.735796 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-952e1dca-776b-4588-a747-fa27dcfb53a5 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3170dc3323f54512bc8819c8efa86b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7121bd118a2549c39332cfdb7edaa92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:35:37.753762 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-952e1dca-776b-4588-a747-fa27dcfb53a5 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] 10.222.0.121 "GET /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e" status: 200 len: 1525 microversion: 2.1 time: 0.769721 Aug 04 10:35:37.755652 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 204/393] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:35:36 2022] GET /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e => generated 1525 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:35:37.840476 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-f4974113-a10c-4fee-9661-9590d9589ff1 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a025ea88db864b55b7537311d20f4808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b1be624402454ba326a7d7a8754a25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:35:37.849783 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-f4974113-a10c-4fee-9661-9590d9589ff1 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] 10.222.0.121 "GET /compute/v2.1/servers/d7dac030-31a6-430e-9099-4f7117d7384a" status: 200 len: 1317 microversion: 2.1 time: 0.733698 Aug 04 10:35:37.850831 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 190/394] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:35:37 2022] GET /compute/v2.1/servers/d7dac030-31a6-430e-9099-4f7117d7384a => generated 1317 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:35:38.786619 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-5707647f-0985-4e0c-bff7-b4fdda093383 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:35:38.787428 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-5707647f-0985-4e0c-bff7-b4fdda093383 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] [instance: 2583b630-2f89-45ba-b781-c0b7c206d61e] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:35:38.796496 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-5707647f-0985-4e0c-bff7-b4fdda093383 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:35:38.796839 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-5707647f-0985-4e0c-bff7-b4fdda093383 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:35:38.797869 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-5707647f-0985-4e0c-bff7-b4fdda093383 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:35:38.798438 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-5707647f-0985-4e0c-bff7-b4fdda093383 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:35:38.902021 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-f1aee994-93e5-4833-acf9-4d6dbe604201 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:35:38.904833 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-f1aee994-93e5-4833-acf9-4d6dbe604201 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] [instance: d7dac030-31a6-430e-9099-4f7117d7384a] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:35:38.919849 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-f1aee994-93e5-4833-acf9-4d6dbe604201 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:35:38.920382 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-f1aee994-93e5-4833-acf9-4d6dbe604201 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:35:38.921263 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-f1aee994-93e5-4833-acf9-4d6dbe604201 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:35:38.921699 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-f1aee994-93e5-4833-acf9-4d6dbe604201 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:35:38.946946 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG dbcounter [-] [124456] Writing DB stats nova_cell1:SELECT=100 {{(pid=124456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:35:39.063544 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-5707647f-0985-4e0c-bff7-b4fdda093383 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3170dc3323f54512bc8819c8efa86b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7121bd118a2549c39332cfdb7edaa92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:35:39.077861 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-5707647f-0985-4e0c-bff7-b4fdda093383 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] 10.222.0.121 "GET /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e" status: 200 len: 1525 microversion: 2.1 time: 0.301069 Aug 04 10:35:39.078820 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 205/395] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:35:38 2022] GET /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e => generated 1525 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:35:39.124737 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-f1aee994-93e5-4833-acf9-4d6dbe604201 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a025ea88db864b55b7537311d20f4808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b1be624402454ba326a7d7a8754a25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:35:39.142899 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-f1aee994-93e5-4833-acf9-4d6dbe604201 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] 10.222.0.121 "GET /compute/v2.1/servers/d7dac030-31a6-430e-9099-4f7117d7384a" status: 200 len: 1317 microversion: 2.1 time: 0.262503 Aug 04 10:35:39.144438 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 191/396] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:35:38 2022] GET /compute/v2.1/servers/d7dac030-31a6-430e-9099-4f7117d7384a => generated 1317 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 10:35:40.112730 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-3995adc1-f319-4cb2-ba33-d9340af8da3c tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:35:40.113937 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-3995adc1-f319-4cb2-ba33-d9340af8da3c tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] [instance: 2583b630-2f89-45ba-b781-c0b7c206d61e] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:35:40.124142 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-3995adc1-f319-4cb2-ba33-d9340af8da3c tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:35:40.124869 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-3995adc1-f319-4cb2-ba33-d9340af8da3c tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:35:40.126163 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-3995adc1-f319-4cb2-ba33-d9340af8da3c tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:35:40.126890 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-3995adc1-f319-4cb2-ba33-d9340af8da3c tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:35:40.169188 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-835e8b4f-204f-444a-a768-968de922c69d tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:35:40.170136 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-835e8b4f-204f-444a-a768-968de922c69d tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] [instance: d7dac030-31a6-430e-9099-4f7117d7384a] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:35:40.182532 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-835e8b4f-204f-444a-a768-968de922c69d tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:35:40.183287 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-835e8b4f-204f-444a-a768-968de922c69d tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:35:40.185482 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-835e8b4f-204f-444a-a768-968de922c69d tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:35:40.186164 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-835e8b4f-204f-444a-a768-968de922c69d tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:35:40.431853 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-3995adc1-f319-4cb2-ba33-d9340af8da3c tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3170dc3323f54512bc8819c8efa86b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7121bd118a2549c39332cfdb7edaa92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:35:40.442346 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-3995adc1-f319-4cb2-ba33-d9340af8da3c tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] 10.222.0.121 "GET /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e" status: 200 len: 1525 microversion: 2.1 time: 0.337756 Aug 04 10:35:40.443462 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 206/397] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:35:40 2022] GET /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e => generated 1525 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 10:35:40.487223 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-835e8b4f-204f-444a-a768-968de922c69d tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a025ea88db864b55b7537311d20f4808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b1be624402454ba326a7d7a8754a25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:35:40.492644 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-835e8b4f-204f-444a-a768-968de922c69d tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] 10.222.0.121 "GET /compute/v2.1/servers/d7dac030-31a6-430e-9099-4f7117d7384a" status: 200 len: 1317 microversion: 2.1 time: 0.330348 Aug 04 10:35:40.493637 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 192/398] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:35:40 2022] GET /compute/v2.1/servers/d7dac030-31a6-430e-9099-4f7117d7384a => generated 1317 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:35:41.479571 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-238509c3-1dfd-48bd-8d43-d362d0fbfd0c tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:35:41.480533 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-238509c3-1dfd-48bd-8d43-d362d0fbfd0c tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] [instance: 2583b630-2f89-45ba-b781-c0b7c206d61e] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:35:41.491497 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-238509c3-1dfd-48bd-8d43-d362d0fbfd0c tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:35:41.492332 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-238509c3-1dfd-48bd-8d43-d362d0fbfd0c tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:35:41.493212 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-238509c3-1dfd-48bd-8d43-d362d0fbfd0c tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:35:41.493914 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-238509c3-1dfd-48bd-8d43-d362d0fbfd0c tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:35:41.518496 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-3b4e8989-43fc-47cf-8d9c-595e24218f1c tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:35:41.520420 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-3b4e8989-43fc-47cf-8d9c-595e24218f1c tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] [instance: d7dac030-31a6-430e-9099-4f7117d7384a] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:35:41.537895 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-3b4e8989-43fc-47cf-8d9c-595e24218f1c tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:35:41.539522 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-3b4e8989-43fc-47cf-8d9c-595e24218f1c tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:35:41.541937 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-3b4e8989-43fc-47cf-8d9c-595e24218f1c tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:35:41.543459 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-3b4e8989-43fc-47cf-8d9c-595e24218f1c tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:35:41.773290 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-238509c3-1dfd-48bd-8d43-d362d0fbfd0c tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3170dc3323f54512bc8819c8efa86b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7121bd118a2549c39332cfdb7edaa92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:35:41.786803 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-238509c3-1dfd-48bd-8d43-d362d0fbfd0c tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] 10.222.0.121 "GET /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e" status: 200 len: 1525 microversion: 2.1 time: 0.313847 Aug 04 10:35:41.787923 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 207/399] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:35:41 2022] GET /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e => generated 1525 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:35:41.811990 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-3b4e8989-43fc-47cf-8d9c-595e24218f1c tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a025ea88db864b55b7537311d20f4808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b1be624402454ba326a7d7a8754a25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:35:41.820358 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-3b4e8989-43fc-47cf-8d9c-595e24218f1c tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] 10.222.0.121 "GET /compute/v2.1/servers/d7dac030-31a6-430e-9099-4f7117d7384a" status: 200 len: 1500 microversion: 2.1 time: 0.308673 Aug 04 10:35:41.821014 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 193/400] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:35:41 2022] GET /compute/v2.1/servers/d7dac030-31a6-430e-9099-4f7117d7384a => generated 1500 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:35:42.815541 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-c29c6438-f15c-46d1-b0f2-f25b1d4e9c00 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:35:42.816261 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-c29c6438-f15c-46d1-b0f2-f25b1d4e9c00 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] [instance: 2583b630-2f89-45ba-b781-c0b7c206d61e] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:35:42.824644 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-c29c6438-f15c-46d1-b0f2-f25b1d4e9c00 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:35:42.825328 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-c29c6438-f15c-46d1-b0f2-f25b1d4e9c00 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:35:42.826380 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-c29c6438-f15c-46d1-b0f2-f25b1d4e9c00 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:35:42.826862 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-c29c6438-f15c-46d1-b0f2-f25b1d4e9c00 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:35:42.992428 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-c29c6438-f15c-46d1-b0f2-f25b1d4e9c00 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3170dc3323f54512bc8819c8efa86b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7121bd118a2549c39332cfdb7edaa92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:35:43.001569 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-c29c6438-f15c-46d1-b0f2-f25b1d4e9c00 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] 10.222.0.121 "GET /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e" status: 200 len: 1505 microversion: 2.1 time: 0.190754 Aug 04 10:35:43.002245 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 208/401] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:35:42 2022] GET /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e => generated 1505 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 10:35:43.026502 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-c7cd0227-c9cb-429d-a913-b0c3869c0767 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:35:43.027626 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-c7cd0227-c9cb-429d-a913-b0c3869c0767 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] [instance: 9b09b542-5b10-4244-88af-cb6de23588d8] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:35:43.039578 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-c7cd0227-c9cb-429d-a913-b0c3869c0767 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:35:43.040575 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-c7cd0227-c9cb-429d-a913-b0c3869c0767 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:35:43.042754 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-c7cd0227-c9cb-429d-a913-b0c3869c0767 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:35:43.043232 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-c7cd0227-c9cb-429d-a913-b0c3869c0767 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:35:43.226070 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-c7cd0227-c9cb-429d-a913-b0c3869c0767 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3170dc3323f54512bc8819c8efa86b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7121bd118a2549c39332cfdb7edaa92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:35:43.236517 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-c7cd0227-c9cb-429d-a913-b0c3869c0767 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] 10.222.0.121 "GET /compute/v2.1/servers/9b09b542-5b10-4244-88af-cb6de23588d8" status: 200 len: 1519 microversion: 2.1 time: 0.217121 Aug 04 10:35:43.237510 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 194/402] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:35:43 2022] GET /compute/v2.1/servers/9b09b542-5b10-4244-88af-cb6de23588d8 => generated 1519 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:35:49.030043 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-2d597dbf-5120-40ef-bc68-d3fab84e8cf9 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:35:49.031035 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-2d597dbf-5120-40ef-bc68-d3fab84e8cf9 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] [instance: d7dac030-31a6-430e-9099-4f7117d7384a] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:35:49.041143 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-2d597dbf-5120-40ef-bc68-d3fab84e8cf9 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:35:49.041614 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-2d597dbf-5120-40ef-bc68-d3fab84e8cf9 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:35:49.042408 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-2d597dbf-5120-40ef-bc68-d3fab84e8cf9 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:35:49.043206 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-2d597dbf-5120-40ef-bc68-d3fab84e8cf9 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:35:49.081771 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-2d597dbf-5120-40ef-bc68-d3fab84e8cf9 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] [instance: d7dac030-31a6-430e-9099-4f7117d7384a] Going to try to terminate instance {{(pid=124457) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 10:35:49.274761 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-2d597dbf-5120-40ef-bc68-d3fab84e8cf9 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] 10.222.0.121 "DELETE /compute/v2.1/servers/d7dac030-31a6-430e-9099-4f7117d7384a" status: 204 len: 0 microversion: 2.1 time: 0.249300 Aug 04 10:35:49.275678 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 209/403] 10.222.0.121 () {58 vars in 1244 bytes} [Thu Aug 4 10:35:49 2022] DELETE /compute/v2.1/servers/d7dac030-31a6-430e-9099-4f7117d7384a => generated 0 bytes in 252 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 04 10:35:49.289543 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-d713b658-e221-49ca-aad2-b4fd5500761e tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:35:49.291692 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-d713b658-e221-49ca-aad2-b4fd5500761e tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] [instance: d7dac030-31a6-430e-9099-4f7117d7384a] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:35:49.302538 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-d713b658-e221-49ca-aad2-b4fd5500761e tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:35:49.303503 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-d713b658-e221-49ca-aad2-b4fd5500761e tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:35:49.304154 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-d713b658-e221-49ca-aad2-b4fd5500761e tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:35:49.304731 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-d713b658-e221-49ca-aad2-b4fd5500761e tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:35:49.522620 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-d713b658-e221-49ca-aad2-b4fd5500761e tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a025ea88db864b55b7537311d20f4808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b1be624402454ba326a7d7a8754a25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:35:49.537430 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-d713b658-e221-49ca-aad2-b4fd5500761e tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] 10.222.0.121 "GET /compute/v2.1/servers/d7dac030-31a6-430e-9099-4f7117d7384a" status: 200 len: 1506 microversion: 2.1 time: 0.256107 Aug 04 10:35:49.550438 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 195/404] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:35:49 2022] GET /compute/v2.1/servers/d7dac030-31a6-430e-9099-4f7117d7384a => generated 1506 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:35:50.182447 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-a3ecab66-e6f6-4e86-b390-d8746136a7d3 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:35:50.184982 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-a3ecab66-e6f6-4e86-b390-d8746136a7d3 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] [instance: 9b09b542-5b10-4244-88af-cb6de23588d8] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:35:50.194968 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-a3ecab66-e6f6-4e86-b390-d8746136a7d3 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:35:50.195427 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-a3ecab66-e6f6-4e86-b390-d8746136a7d3 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:35:50.196411 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-a3ecab66-e6f6-4e86-b390-d8746136a7d3 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:35:50.196770 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-a3ecab66-e6f6-4e86-b390-d8746136a7d3 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:35:50.230958 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.objects.instance [None req-a3ecab66-e6f6-4e86-b390-d8746136a7d3 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lazy-loading 'flavor' on Instance uuid 9b09b542-5b10-4244-88af-cb6de23588d8 {{(pid=124457) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 10:35:50.341098 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-a3ecab66-e6f6-4e86-b390-d8746136a7d3 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] 10.222.0.121 "POST /compute/v2.1/servers/9b09b542-5b10-4244-88af-cb6de23588d8/action" status: 200 len: 32 microversion: 2.1 time: 0.164052 Aug 04 10:35:50.342214 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 210/405] 10.222.0.121 () {60 vars in 1283 bytes} [Thu Aug 4 10:35:50 2022] POST /compute/v2.1/servers/9b09b542-5b10-4244-88af-cb6de23588d8/action => generated 32 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 10:35:50.352815 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-41a2d0a4-bf8a-454c-89fd-7e92e3764bbd tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:35:50.353622 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-41a2d0a4-bf8a-454c-89fd-7e92e3764bbd tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] [instance: 9b09b542-5b10-4244-88af-cb6de23588d8] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:35:50.361052 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-41a2d0a4-bf8a-454c-89fd-7e92e3764bbd tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:35:50.361802 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-41a2d0a4-bf8a-454c-89fd-7e92e3764bbd tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:35:50.362477 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-41a2d0a4-bf8a-454c-89fd-7e92e3764bbd tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:35:50.363199 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-41a2d0a4-bf8a-454c-89fd-7e92e3764bbd tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:35:50.560733 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-41a2d0a4-bf8a-454c-89fd-7e92e3764bbd tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3170dc3323f54512bc8819c8efa86b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7121bd118a2549c39332cfdb7edaa92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:35:50.569750 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-c83d29d2-2182-422a-a561-c95d41018937 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:35:50.570875 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-c83d29d2-2182-422a-a561-c95d41018937 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] [instance: d7dac030-31a6-430e-9099-4f7117d7384a] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:35:50.577495 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-41a2d0a4-bf8a-454c-89fd-7e92e3764bbd tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] 10.222.0.121 "GET /compute/v2.1/servers/9b09b542-5b10-4244-88af-cb6de23588d8" status: 200 len: 1525 microversion: 2.1 time: 0.228812 Aug 04 10:35:50.579468 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 196/406] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:35:50 2022] GET /compute/v2.1/servers/9b09b542-5b10-4244-88af-cb6de23588d8 => generated 1525 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:35:50.594063 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-c83d29d2-2182-422a-a561-c95d41018937 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:35:50.594914 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-c83d29d2-2182-422a-a561-c95d41018937 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:35:50.596634 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-c83d29d2-2182-422a-a561-c95d41018937 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:35:50.597707 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-c83d29d2-2182-422a-a561-c95d41018937 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:35:50.841642 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-c83d29d2-2182-422a-a561-c95d41018937 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a025ea88db864b55b7537311d20f4808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b1be624402454ba326a7d7a8754a25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:35:50.852081 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-c83d29d2-2182-422a-a561-c95d41018937 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] 10.222.0.121 "GET /compute/v2.1/servers/d7dac030-31a6-430e-9099-4f7117d7384a" status: 200 len: 1506 microversion: 2.1 time: 0.287899 Aug 04 10:35:50.852906 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 211/407] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:35:50 2022] GET /compute/v2.1/servers/d7dac030-31a6-430e-9099-4f7117d7384a => generated 1506 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:35:51.615977 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-95e5529d-be77-4cff-951b-d8d44a07128c tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:35:51.616840 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-95e5529d-be77-4cff-951b-d8d44a07128c tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] [instance: 9b09b542-5b10-4244-88af-cb6de23588d8] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:35:51.618814 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG dbcounter [-] [124456] Writing DB stats nova_api:SELECT=48 {{(pid=124456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:35:51.625055 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-95e5529d-be77-4cff-951b-d8d44a07128c tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:35:51.625491 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-95e5529d-be77-4cff-951b-d8d44a07128c tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:35:51.626344 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-95e5529d-be77-4cff-951b-d8d44a07128c tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:35:51.626792 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-95e5529d-be77-4cff-951b-d8d44a07128c tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:35:51.849657 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-95e5529d-be77-4cff-951b-d8d44a07128c tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3170dc3323f54512bc8819c8efa86b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7121bd118a2549c39332cfdb7edaa92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:35:51.866355 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-95e5529d-be77-4cff-951b-d8d44a07128c tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] 10.222.0.121 "GET /compute/v2.1/servers/9b09b542-5b10-4244-88af-cb6de23588d8" status: 200 len: 1525 microversion: 2.1 time: 0.254251 Aug 04 10:35:51.867875 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 197/408] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:35:51 2022] GET /compute/v2.1/servers/9b09b542-5b10-4244-88af-cb6de23588d8 => generated 1525 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:35:51.892704 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-3b9d03b4-f8d6-4e1a-a5e6-1c669747ee42 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:35:51.893642 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-3b9d03b4-f8d6-4e1a-a5e6-1c669747ee42 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] [instance: d7dac030-31a6-430e-9099-4f7117d7384a] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:35:51.900715 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-3b9d03b4-f8d6-4e1a-a5e6-1c669747ee42 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:35:51.901334 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-3b9d03b4-f8d6-4e1a-a5e6-1c669747ee42 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:35:51.902602 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-3b9d03b4-f8d6-4e1a-a5e6-1c669747ee42 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:35:51.903085 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-3b9d03b4-f8d6-4e1a-a5e6-1c669747ee42 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:35:52.455650 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-3b9d03b4-f8d6-4e1a-a5e6-1c669747ee42 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a025ea88db864b55b7537311d20f4808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b1be624402454ba326a7d7a8754a25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:35:52.470940 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-3b9d03b4-f8d6-4e1a-a5e6-1c669747ee42 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] 10.222.0.121 "GET /compute/v2.1/servers/d7dac030-31a6-430e-9099-4f7117d7384a" status: 200 len: 1506 microversion: 2.1 time: 0.583518 Aug 04 10:35:52.472351 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 212/409] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:35:51 2022] GET /compute/v2.1/servers/d7dac030-31a6-430e-9099-4f7117d7384a => generated 1506 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:35:52.917618 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-432ee1a9-0b02-4af2-b657-90685d22c617 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:35:52.919473 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-432ee1a9-0b02-4af2-b657-90685d22c617 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] [instance: 9b09b542-5b10-4244-88af-cb6de23588d8] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:35:52.936396 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-432ee1a9-0b02-4af2-b657-90685d22c617 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:35:52.936396 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-432ee1a9-0b02-4af2-b657-90685d22c617 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:35:52.936396 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-432ee1a9-0b02-4af2-b657-90685d22c617 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:35:52.936396 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-432ee1a9-0b02-4af2-b657-90685d22c617 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:35:53.235881 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-432ee1a9-0b02-4af2-b657-90685d22c617 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3170dc3323f54512bc8819c8efa86b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7121bd118a2549c39332cfdb7edaa92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:35:53.252314 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-432ee1a9-0b02-4af2-b657-90685d22c617 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] 10.222.0.121 "GET /compute/v2.1/servers/9b09b542-5b10-4244-88af-cb6de23588d8" status: 200 len: 1525 microversion: 2.1 time: 0.356225 Aug 04 10:35:53.253381 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 198/410] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:35:52 2022] GET /compute/v2.1/servers/9b09b542-5b10-4244-88af-cb6de23588d8 => generated 1525 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:35:53.312346 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [req-a7974144-396c-4065-a6da-83fed683bda6 req-9d35c769-8e9e-4605-a906-d7b5f176a00b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7dac030-31a6-430e-9099-4f7117d7384a", "name": "network-vif-deleted", "tag": "c4972808-e85a-4918-b524-710ad51084cb"}]} {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:35:53.333242 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [req-a7974144-396c-4065-a6da-83fed683bda6 req-9d35c769-8e9e-4605-a906-d7b5f176a00b service nova] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:35:53.333731 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [req-a7974144-396c-4065-a6da-83fed683bda6 req-9d35c769-8e9e-4605-a906-d7b5f176a00b service nova] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:35:53.339277 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG dbcounter [-] [124457] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:35:53.351062 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.compute.server_external_events [req-a7974144-396c-4065-a6da-83fed683bda6 req-9d35c769-8e9e-4605-a906-d7b5f176a00b service nova] Creating event network-vif-deleted:c4972808-e85a-4918-b524-710ad51084cb for instance d7dac030-31a6-430e-9099-4f7117d7384a on hv-cinder-85200 Aug 04 10:35:53.357844 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [req-a7974144-396c-4065-a6da-83fed683bda6 req-9d35c769-8e9e-4605-a906-d7b5f176a00b service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051841 Aug 04 10:35:53.358489 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 213/411] 10.222.0.121 () {64 vars in 1322 bytes} [Thu Aug 4 10:35:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:35:53.510090 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-f55c2e37-2186-48c9-8ab3-6d7e7fc5bd05 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:35:53.511638 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-f55c2e37-2186-48c9-8ab3-6d7e7fc5bd05 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] [instance: d7dac030-31a6-430e-9099-4f7117d7384a] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:35:53.528850 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-f55c2e37-2186-48c9-8ab3-6d7e7fc5bd05 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:35:53.529732 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-f55c2e37-2186-48c9-8ab3-6d7e7fc5bd05 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:35:53.532104 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-f55c2e37-2186-48c9-8ab3-6d7e7fc5bd05 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:35:53.533035 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-f55c2e37-2186-48c9-8ab3-6d7e7fc5bd05 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:35:53.651670 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-f55c2e37-2186-48c9-8ab3-6d7e7fc5bd05 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a025ea88db864b55b7537311d20f4808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b1be624402454ba326a7d7a8754a25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:35:53.671386 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-f55c2e37-2186-48c9-8ab3-6d7e7fc5bd05 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] 10.222.0.121 "GET /compute/v2.1/servers/d7dac030-31a6-430e-9099-4f7117d7384a" status: 200 len: 1464 microversion: 2.1 time: 0.171970 Aug 04 10:35:53.672878 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 199/412] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:35:53 2022] GET /compute/v2.1/servers/d7dac030-31a6-430e-9099-4f7117d7384a => generated 1464 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:35:54.290773 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-15fa0849-9593-4679-92d2-92a7593b935e tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:35:54.291546 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-15fa0849-9593-4679-92d2-92a7593b935e tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] [instance: 9b09b542-5b10-4244-88af-cb6de23588d8] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:35:54.294108 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG dbcounter [-] [124457] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1 {{(pid=124457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:35:54.301024 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-15fa0849-9593-4679-92d2-92a7593b935e tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:35:54.301733 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-15fa0849-9593-4679-92d2-92a7593b935e tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:35:54.302867 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-15fa0849-9593-4679-92d2-92a7593b935e tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:35:54.303392 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-15fa0849-9593-4679-92d2-92a7593b935e tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:35:54.478838 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-15fa0849-9593-4679-92d2-92a7593b935e tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3170dc3323f54512bc8819c8efa86b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7121bd118a2549c39332cfdb7edaa92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:35:54.488991 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-15fa0849-9593-4679-92d2-92a7593b935e tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] 10.222.0.121 "GET /compute/v2.1/servers/9b09b542-5b10-4244-88af-cb6de23588d8" status: 200 len: 1525 microversion: 2.1 time: 0.202664 Aug 04 10:35:54.489882 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 214/413] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:35:54 2022] GET /compute/v2.1/servers/9b09b542-5b10-4244-88af-cb6de23588d8 => generated 1525 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:35:54.696377 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-43b1a62e-6a5d-46a0-a7c4-a7c55f1cc9a4 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:35:54.697091 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-43b1a62e-6a5d-46a0-a7c4-a7c55f1cc9a4 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] [instance: d7dac030-31a6-430e-9099-4f7117d7384a] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:35:54.707070 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-43b1a62e-6a5d-46a0-a7c4-a7c55f1cc9a4 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:35:54.707865 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-43b1a62e-6a5d-46a0-a7c4-a7c55f1cc9a4 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:35:54.709404 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-43b1a62e-6a5d-46a0-a7c4-a7c55f1cc9a4 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:35:54.710202 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-43b1a62e-6a5d-46a0-a7c4-a7c55f1cc9a4 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:35:54.793627 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-43b1a62e-6a5d-46a0-a7c4-a7c55f1cc9a4 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a025ea88db864b55b7537311d20f4808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b1be624402454ba326a7d7a8754a25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:35:54.802376 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-43b1a62e-6a5d-46a0-a7c4-a7c55f1cc9a4 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] 10.222.0.121 "GET /compute/v2.1/servers/d7dac030-31a6-430e-9099-4f7117d7384a" status: 200 len: 1302 microversion: 2.1 time: 0.110684 Aug 04 10:35:54.802989 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 200/414] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:35:54 2022] GET /compute/v2.1/servers/d7dac030-31a6-430e-9099-4f7117d7384a => generated 1302 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:35:55.517368 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-07b54631-2a4a-491a-9c55-8cea9f0506d2 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:35:55.518065 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-07b54631-2a4a-491a-9c55-8cea9f0506d2 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] [instance: 9b09b542-5b10-4244-88af-cb6de23588d8] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:35:55.526639 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-07b54631-2a4a-491a-9c55-8cea9f0506d2 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:35:55.527169 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-07b54631-2a4a-491a-9c55-8cea9f0506d2 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:35:55.528153 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-07b54631-2a4a-491a-9c55-8cea9f0506d2 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:35:55.528704 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-07b54631-2a4a-491a-9c55-8cea9f0506d2 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:35:55.725448 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-07b54631-2a4a-491a-9c55-8cea9f0506d2 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3170dc3323f54512bc8819c8efa86b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7121bd118a2549c39332cfdb7edaa92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:35:55.735395 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-07b54631-2a4a-491a-9c55-8cea9f0506d2 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] 10.222.0.121 "GET /compute/v2.1/servers/9b09b542-5b10-4244-88af-cb6de23588d8" status: 200 len: 1525 microversion: 2.1 time: 0.222423 Aug 04 10:35:55.736260 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 215/415] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:35:55 2022] GET /compute/v2.1/servers/9b09b542-5b10-4244-88af-cb6de23588d8 => generated 1525 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:35:55.826573 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-167bb25a-44fe-48a1-8c70-26f50696dcca tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:35:55.827227 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-167bb25a-44fe-48a1-8c70-26f50696dcca tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] [instance: d7dac030-31a6-430e-9099-4f7117d7384a] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:35:55.836505 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-167bb25a-44fe-48a1-8c70-26f50696dcca tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:35:55.837177 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-167bb25a-44fe-48a1-8c70-26f50696dcca tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:35:55.838142 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-167bb25a-44fe-48a1-8c70-26f50696dcca tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:35:55.838647 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-167bb25a-44fe-48a1-8c70-26f50696dcca tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:35:55.908475 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-167bb25a-44fe-48a1-8c70-26f50696dcca tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a025ea88db864b55b7537311d20f4808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b1be624402454ba326a7d7a8754a25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:35:55.917136 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-167bb25a-44fe-48a1-8c70-26f50696dcca tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] 10.222.0.121 "GET /compute/v2.1/servers/d7dac030-31a6-430e-9099-4f7117d7384a" status: 200 len: 1302 microversion: 2.1 time: 0.096045 Aug 04 10:35:55.918468 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 201/416] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:35:55 2022] GET /compute/v2.1/servers/d7dac030-31a6-430e-9099-4f7117d7384a => generated 1302 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:35:56.763243 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-b44900f0-58d0-4cfc-aab4-64d8d9013beb tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:35:56.763903 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-b44900f0-58d0-4cfc-aab4-64d8d9013beb tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] [instance: 9b09b542-5b10-4244-88af-cb6de23588d8] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:35:56.771832 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-b44900f0-58d0-4cfc-aab4-64d8d9013beb tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:35:56.772310 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-b44900f0-58d0-4cfc-aab4-64d8d9013beb tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:35:56.773407 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-b44900f0-58d0-4cfc-aab4-64d8d9013beb tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:35:56.773567 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-b44900f0-58d0-4cfc-aab4-64d8d9013beb tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:35:56.927390 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-b44900f0-58d0-4cfc-aab4-64d8d9013beb tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3170dc3323f54512bc8819c8efa86b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7121bd118a2549c39332cfdb7edaa92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:35:56.937501 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-b44900f0-58d0-4cfc-aab4-64d8d9013beb tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] 10.222.0.121 "GET /compute/v2.1/servers/9b09b542-5b10-4244-88af-cb6de23588d8" status: 200 len: 1525 microversion: 2.1 time: 0.178449 Aug 04 10:35:56.938143 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 216/417] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:35:56 2022] GET /compute/v2.1/servers/9b09b542-5b10-4244-88af-cb6de23588d8 => generated 1525 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:35:56.938318 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-2a2b98de-0e29-4764-ae30-54ee1d2fd03a tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:35:56.938937 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-2a2b98de-0e29-4764-ae30-54ee1d2fd03a tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] [instance: d7dac030-31a6-430e-9099-4f7117d7384a] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:35:56.946133 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-2a2b98de-0e29-4764-ae30-54ee1d2fd03a tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:35:56.946729 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-2a2b98de-0e29-4764-ae30-54ee1d2fd03a tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:35:56.947701 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-2a2b98de-0e29-4764-ae30-54ee1d2fd03a tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:35:56.948147 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-2a2b98de-0e29-4764-ae30-54ee1d2fd03a tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:35:57.015469 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-2a2b98de-0e29-4764-ae30-54ee1d2fd03a tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a025ea88db864b55b7537311d20f4808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b1be624402454ba326a7d7a8754a25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:35:57.024871 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-2a2b98de-0e29-4764-ae30-54ee1d2fd03a tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] 10.222.0.121 "GET /compute/v2.1/servers/d7dac030-31a6-430e-9099-4f7117d7384a" status: 200 len: 1302 microversion: 2.1 time: 0.090565 Aug 04 10:35:57.025542 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 202/418] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:35:56 2022] GET /compute/v2.1/servers/d7dac030-31a6-430e-9099-4f7117d7384a => generated 1302 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 10:35:57.972560 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-0c5161c4-0f91-4e47-9bb5-58a54df9fa24 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:35:57.973815 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-0c5161c4-0f91-4e47-9bb5-58a54df9fa24 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] [instance: 9b09b542-5b10-4244-88af-cb6de23588d8] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:35:58.000032 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-0c5161c4-0f91-4e47-9bb5-58a54df9fa24 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:35:58.001978 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-0c5161c4-0f91-4e47-9bb5-58a54df9fa24 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:35:58.003857 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-0c5161c4-0f91-4e47-9bb5-58a54df9fa24 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:35:58.004634 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-0c5161c4-0f91-4e47-9bb5-58a54df9fa24 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:35:58.051369 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-7dc5ace0-8b8b-45f5-adbe-b568d6d64338 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:35:58.053956 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-7dc5ace0-8b8b-45f5-adbe-b568d6d64338 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] [instance: d7dac030-31a6-430e-9099-4f7117d7384a] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:35:58.062359 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-7dc5ace0-8b8b-45f5-adbe-b568d6d64338 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:35:58.062601 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-7dc5ace0-8b8b-45f5-adbe-b568d6d64338 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:35:58.063705 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-7dc5ace0-8b8b-45f5-adbe-b568d6d64338 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:35:58.065023 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-7dc5ace0-8b8b-45f5-adbe-b568d6d64338 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:35:58.113114 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-7dc5ace0-8b8b-45f5-adbe-b568d6d64338 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:35:58.114700 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-7dc5ace0-8b8b-45f5-adbe-b568d6d64338 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:35:58.115547 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.objects.instance [None req-7dc5ace0-8b8b-45f5-adbe-b568d6d64338 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Lazy-loading 'fault' on Instance uuid d7dac030-31a6-430e-9099-4f7117d7384a {{(pid=124456) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 10:35:58.209830 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-7dc5ace0-8b8b-45f5-adbe-b568d6d64338 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a025ea88db864b55b7537311d20f4808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b1be624402454ba326a7d7a8754a25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:35:58.220809 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-7dc5ace0-8b8b-45f5-adbe-b568d6d64338 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] 10.222.0.121 "GET /compute/v2.1/servers/d7dac030-31a6-430e-9099-4f7117d7384a" status: 200 len: 1307 microversion: 2.1 time: 0.178418 Aug 04 10:35:58.222135 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 203/419] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:35:58 2022] GET /compute/v2.1/servers/d7dac030-31a6-430e-9099-4f7117d7384a => generated 1307 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:35:58.288192 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-0c5161c4-0f91-4e47-9bb5-58a54df9fa24 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3170dc3323f54512bc8819c8efa86b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7121bd118a2549c39332cfdb7edaa92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:35:58.301047 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-0c5161c4-0f91-4e47-9bb5-58a54df9fa24 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] 10.222.0.121 "GET /compute/v2.1/servers/9b09b542-5b10-4244-88af-cb6de23588d8" status: 200 len: 1525 microversion: 2.1 time: 0.337682 Aug 04 10:35:58.308015 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 217/420] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:35:57 2022] GET /compute/v2.1/servers/9b09b542-5b10-4244-88af-cb6de23588d8 => generated 1525 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:35:59.243760 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-542281ce-3fe1-4758-8653-e1e0f48259eb tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:35:59.244458 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-542281ce-3fe1-4758-8653-e1e0f48259eb tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] [instance: d7dac030-31a6-430e-9099-4f7117d7384a] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:35:59.251458 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-542281ce-3fe1-4758-8653-e1e0f48259eb tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:35:59.251969 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-542281ce-3fe1-4758-8653-e1e0f48259eb tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:35:59.252882 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-542281ce-3fe1-4758-8653-e1e0f48259eb tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:35:59.253332 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-542281ce-3fe1-4758-8653-e1e0f48259eb tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:35:59.274438 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.wsgi [None req-542281ce-3fe1-4758-8653-e1e0f48259eb tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] HTTP exception thrown: Instance d7dac030-31a6-430e-9099-4f7117d7384a could not be found. Aug 04 10:35:59.277049 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-542281ce-3fe1-4758-8653-e1e0f48259eb tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Request method failure captured: Aug 04 10:35:59.277049 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: request: GET /compute/v2.1/servers/d7dac030-31a6-430e-9099-4f7117d7384a HTTP/1.1 Aug 04 10:35:59.277049 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: Accept: application/json Aug 04 10:35:59.277049 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: Accept-Encoding: identity Aug 04 10:35:59.277049 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: Connection: close Aug 04 10:35:59.277049 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: Content-Length: 0 Aug 04 10:35:59.277049 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: Content-Type: application/json Aug 04 10:35:59.277049 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: Host: 10.222.0.121 Aug 04 10:35:59.277049 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: Openstack-System-Scope: None Aug 04 10:35:59.277049 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: User-Agent: python-urllib3/1.26.11 Aug 04 10:35:59.277049 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Auth-Token: gAAAAABi66DfJ8Zu7pLpiELeTHqKMCMVnubsiJhY3rbjSSIT9jyOBJ-HbfSQyiuThw8B1IUlXZ2X4VRvGXW-m1YuNPlnZMIbWuDPSZ38vBGOeAh2M20rQo3exzIPAuEkNoQD4PVlYHYv9PupPi7S9n3OEdY__-mkJoS0JqLgVnT0cA2uiz0zsHw Aug 04 10:35:59.277049 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Domain-Id: None Aug 04 10:35:59.277049 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Domain-Name: None Aug 04 10:35:59.277049 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Identity-Status: Confirmed Aug 04 10:35:59.277049 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Is-Admin-Project: True Aug 04 10:35:59.277049 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Project-Domain-Id: default Aug 04 10:35:59.277049 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Project-Domain-Name: Default Aug 04 10:35:59.277049 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Project-Id: 99b1be624402454ba326a7d7a8754a25 Aug 04 10:35:59.277049 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Project-Name: tempest-VolumesActionsTest-1450193640 Aug 04 10:35:59.277049 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Role: reader,member Aug 04 10:35:59.277049 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Roles: reader,member Aug 04 10:35:59.278914 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/99b1be624402454ba326a7d7a8754a25"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/99b1be624402454ba326a7d7a8754a25"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.121:8080", "publicURL": "http://10.222.0.121:8080/v1/AUTH_99b1be624402454ba326a7d7a8754a25"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2/99b1be624402454ba326a7d7a8754a25"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:9696/networking"}]}] Aug 04 10:35:59.278914 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Tenant: tempest-VolumesActionsTest-1450193640 Aug 04 10:35:59.278914 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Tenant-Id: 99b1be624402454ba326a7d7a8754a25 Aug 04 10:35:59.278914 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Tenant-Name: tempest-VolumesActionsTest-1450193640 Aug 04 10:35:59.278914 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-User: tempest-VolumesActionsTest-1450193640-project Aug 04 10:35:59.278914 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-User-Domain-Id: default Aug 04 10:35:59.278914 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-User-Domain-Name: Default Aug 04 10:35:59.278914 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-User-Id: a025ea88db864b55b7537311d20f4808 Aug 04 10:35:59.278914 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-User-Name: tempest-VolumesActionsTest-1450193640-project Aug 04 10:35:59.278914 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: method: > Aug 04 10:35:59.278914 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: exception: Instance d7dac030-31a6-430e-9099-4f7117d7384a could not be found. Aug 04 10:35:59.278914 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: action_args: {'id': 'd7dac030-31a6-430e-9099-4f7117d7384a'} Aug 04 10:35:59.280016 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 10:35:59.280016 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:35:59.280016 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 10:35:59.280016 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 10:35:59.280016 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 10:35:59.280016 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 10:35:59.280016 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 10:35:59.280016 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 10:35:59.280016 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 10:35:59.280016 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 10:35:59.280016 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d7dac030-31a6-430e-9099-4f7117d7384a could not be found. Aug 04 10:35:59.280016 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi Aug 04 10:35:59.280016 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:35:59.280016 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi Aug 04 10:35:59.280016 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:35:59.280016 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:35:59.280016 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:35:59.280016 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 10:35:59.280016 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 10:35:59.280016 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 10:35:59.281929 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 10:35:59.281929 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 10:35:59.281929 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 10:35:59.281929 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 10:35:59.281929 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 10:35:59.281929 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 10:35:59.281929 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 10:35:59.281929 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d7dac030-31a6-430e-9099-4f7117d7384a could not be found. Aug 04 10:35:59.281929 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi Aug 04 10:35:59.281929 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:35:59.281929 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi Aug 04 10:35:59.281929 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:35:59.281929 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:35:59.281929 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:35:59.281929 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 10:35:59.281929 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 10:35:59.281929 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d7dac030-31a6-430e-9099-4f7117d7384a could not be found. Aug 04 10:35:59.281929 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi Aug 04 10:35:59.283104 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-542281ce-3fe1-4758-8653-e1e0f48259eb tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Returning 404 to user: Instance d7dac030-31a6-430e-9099-4f7117d7384a could not be found. {{(pid=124456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 10:35:59.283104 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-542281ce-3fe1-4758-8653-e1e0f48259eb tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] 10.222.0.121 "GET /compute/v2.1/servers/d7dac030-31a6-430e-9099-4f7117d7384a" status: 404 len: 111 microversion: 2.1 time: 0.039053 Aug 04 10:35:59.284032 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 204/421] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:35:59 2022] GET /compute/v2.1/servers/d7dac030-31a6-430e-9099-4f7117d7384a => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 10:35:59.333615 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-7f443c8a-a1bb-4e05-8198-8d3faf63f362 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:35:59.334481 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-7f443c8a-a1bb-4e05-8198-8d3faf63f362 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] [instance: 9b09b542-5b10-4244-88af-cb6de23588d8] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:35:59.343997 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-7f443c8a-a1bb-4e05-8198-8d3faf63f362 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:35:59.343997 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-7f443c8a-a1bb-4e05-8198-8d3faf63f362 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:35:59.344799 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-7f443c8a-a1bb-4e05-8198-8d3faf63f362 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:35:59.345457 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-7f443c8a-a1bb-4e05-8198-8d3faf63f362 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:35:59.426429 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-0f8730d7-768a-4d80-8890-237eb0d5db1d tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1397096955", "imageRef": "46724bb5-955f-4f3f-bd6a-b561fdde55e3", "flavorRef": "452", "networks": [{"uuid": "99e987b2-437b-4fd9-a5b4-feb93bfcea0d"}]}} {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:35:59.507481 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.network.neutron [None req-0f8730d7-768a-4d80-8890-237eb0d5db1d tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] validate_networks() for [('99e987b2-437b-4fd9-a5b4-feb93bfcea0d', None, None, None, None, None)] {{(pid=124456) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 10:35:59.530770 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-7f443c8a-a1bb-4e05-8198-8d3faf63f362 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3170dc3323f54512bc8819c8efa86b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7121bd118a2549c39332cfdb7edaa92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:35:59.542069 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-7f443c8a-a1bb-4e05-8198-8d3faf63f362 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] 10.222.0.121 "GET /compute/v2.1/servers/9b09b542-5b10-4244-88af-cb6de23588d8" status: 200 len: 1525 microversion: 2.1 time: 0.213796 Aug 04 10:35:59.542821 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 218/422] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:35:59 2022] GET /compute/v2.1/servers/9b09b542-5b10-4244-88af-cb6de23588d8 => generated 1525 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:36:00.282765 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.virt.hardware [None req-0f8730d7-768a-4d80-8890-237eb0d5db1d tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Flavor limits 0:0:0 {{(pid=124456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 10:36:00.283582 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.virt.hardware [None req-0f8730d7-768a-4d80-8890-237eb0d5db1d tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Image limits 0:0:0 {{(pid=124456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 10:36:00.285015 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.virt.hardware [None req-0f8730d7-768a-4d80-8890-237eb0d5db1d tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Flavor pref 0:0:0 {{(pid=124456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 10:36:00.285747 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.virt.hardware [None req-0f8730d7-768a-4d80-8890-237eb0d5db1d tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Image pref 0:0:0 {{(pid=124456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 10:36:00.286501 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.virt.hardware [None req-0f8730d7-768a-4d80-8890-237eb0d5db1d tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 10:36:00.306763 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-0f8730d7-768a-4d80-8890-237eb0d5db1d tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:00.308236 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-0f8730d7-768a-4d80-8890-237eb0d5db1d tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:00.310236 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-0f8730d7-768a-4d80-8890-237eb0d5db1d tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:00.311353 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-0f8730d7-768a-4d80-8890-237eb0d5db1d tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:00.356480 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.quota [None req-0f8730d7-768a-4d80-8890-237eb0d5db1d tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Getting quotas for project 99b1be624402454ba326a7d7a8754a25. Resources: {'ram', 'instances', 'cores'} {{(pid=124456) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 10:36:00.365718 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.quota [None req-0f8730d7-768a-4d80-8890-237eb0d5db1d tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Getting quotas for user a025ea88db864b55b7537311d20f4808 and project 99b1be624402454ba326a7d7a8754a25. Resources: {'ram', 'instances', 'cores'} {{(pid=124456) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 10:36:00.388161 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-0f8730d7-768a-4d80-8890-237eb0d5db1d tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Going to run 1 instances... {{(pid=124456) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 10:36:00.391743 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-0f8730d7-768a-4d80-8890-237eb0d5db1d tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] [instance: 5306cee9-db16-4ba8-99e3-c54f401ab11d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='46724bb5-955f-4f3f-bd6a-b561fdde55e3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124456) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 10:36:00.494658 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-0f8730d7-768a-4d80-8890-237eb0d5db1d tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] 10.222.0.121 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 1.071786 Aug 04 10:36:00.496424 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 205/423] 10.222.0.121 () {60 vars in 1152 bytes} [Thu Aug 4 10:35:59 2022] POST /compute/v2.1/servers => generated 382 bytes in 1075 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Aug 04 10:36:00.510604 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-db0f06e9-a138-411b-99a5-df05c6f2ec1a tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:36:00.512504 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-db0f06e9-a138-411b-99a5-df05c6f2ec1a tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] [instance: 5306cee9-db16-4ba8-99e3-c54f401ab11d] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:36:00.578922 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-bdfabe39-ce9c-4774-9628-67d07c7582b7 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:36:00.579861 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-bdfabe39-ce9c-4774-9628-67d07c7582b7 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] [instance: 9b09b542-5b10-4244-88af-cb6de23588d8] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:36:00.592788 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-bdfabe39-ce9c-4774-9628-67d07c7582b7 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:00.593869 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-bdfabe39-ce9c-4774-9628-67d07c7582b7 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:00.595790 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-bdfabe39-ce9c-4774-9628-67d07c7582b7 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:00.597108 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-bdfabe39-ce9c-4774-9628-67d07c7582b7 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:00.698711 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-db0f06e9-a138-411b-99a5-df05c6f2ec1a tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a025ea88db864b55b7537311d20f4808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b1be624402454ba326a7d7a8754a25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:36:00.711627 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-db0f06e9-a138-411b-99a5-df05c6f2ec1a tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] 10.222.0.121 "GET /compute/v2.1/servers/5306cee9-db16-4ba8-99e3-c54f401ab11d" status: 200 len: 1218 microversion: 2.1 time: 0.207364 Aug 04 10:36:00.713398 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 219/424] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:36:00 2022] GET /compute/v2.1/servers/5306cee9-db16-4ba8-99e3-c54f401ab11d => generated 1218 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:36:00.952678 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-bdfabe39-ce9c-4774-9628-67d07c7582b7 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3170dc3323f54512bc8819c8efa86b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7121bd118a2549c39332cfdb7edaa92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:36:00.978371 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-bdfabe39-ce9c-4774-9628-67d07c7582b7 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] 10.222.0.121 "GET /compute/v2.1/servers/9b09b542-5b10-4244-88af-cb6de23588d8" status: 200 len: 1525 microversion: 2.1 time: 0.408632 Aug 04 10:36:00.989336 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 206/425] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:36:00 2022] GET /compute/v2.1/servers/9b09b542-5b10-4244-88af-cb6de23588d8 => generated 1525 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:36:01.736965 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-29599d48-32d3-4297-95d7-74a7c6eca192 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:36:01.738930 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-29599d48-32d3-4297-95d7-74a7c6eca192 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] [instance: 5306cee9-db16-4ba8-99e3-c54f401ab11d] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:36:01.753231 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-29599d48-32d3-4297-95d7-74a7c6eca192 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:01.754193 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-29599d48-32d3-4297-95d7-74a7c6eca192 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:01.755381 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-29599d48-32d3-4297-95d7-74a7c6eca192 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:01.756107 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-29599d48-32d3-4297-95d7-74a7c6eca192 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:01.872704 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-29599d48-32d3-4297-95d7-74a7c6eca192 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a025ea88db864b55b7537311d20f4808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b1be624402454ba326a7d7a8754a25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:36:01.895093 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-29599d48-32d3-4297-95d7-74a7c6eca192 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] 10.222.0.121 "GET /compute/v2.1/servers/5306cee9-db16-4ba8-99e3-c54f401ab11d" status: 200 len: 1270 microversion: 2.1 time: 0.162967 Aug 04 10:36:01.896652 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 220/426] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:36:01 2022] GET /compute/v2.1/servers/5306cee9-db16-4ba8-99e3-c54f401ab11d => generated 1270 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:36:02.012122 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-5638c661-6614-4702-bb69-bacd2a6de7f7 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:36:02.016355 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-5638c661-6614-4702-bb69-bacd2a6de7f7 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] [instance: 9b09b542-5b10-4244-88af-cb6de23588d8] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:36:02.030031 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-5638c661-6614-4702-bb69-bacd2a6de7f7 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:02.033809 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-5638c661-6614-4702-bb69-bacd2a6de7f7 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:02.036244 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-5638c661-6614-4702-bb69-bacd2a6de7f7 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:02.037551 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-5638c661-6614-4702-bb69-bacd2a6de7f7 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:02.726211 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-5638c661-6614-4702-bb69-bacd2a6de7f7 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3170dc3323f54512bc8819c8efa86b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7121bd118a2549c39332cfdb7edaa92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:36:02.738767 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-5638c661-6614-4702-bb69-bacd2a6de7f7 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] 10.222.0.121 "GET /compute/v2.1/servers/9b09b542-5b10-4244-88af-cb6de23588d8" status: 200 len: 1525 microversion: 2.1 time: 0.736513 Aug 04 10:36:02.740026 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 207/427] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:36:02 2022] GET /compute/v2.1/servers/9b09b542-5b10-4244-88af-cb6de23588d8 => generated 1525 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:36:02.948266 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-7fca2315-df93-43e3-a4ba-2b6c7dcb6377 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:36:02.949334 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-7fca2315-df93-43e3-a4ba-2b6c7dcb6377 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] [instance: 5306cee9-db16-4ba8-99e3-c54f401ab11d] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:36:02.969796 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-7fca2315-df93-43e3-a4ba-2b6c7dcb6377 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:02.970503 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-7fca2315-df93-43e3-a4ba-2b6c7dcb6377 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:02.971680 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-7fca2315-df93-43e3-a4ba-2b6c7dcb6377 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:02.975572 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-7fca2315-df93-43e3-a4ba-2b6c7dcb6377 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:03.091492 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-7fca2315-df93-43e3-a4ba-2b6c7dcb6377 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a025ea88db864b55b7537311d20f4808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b1be624402454ba326a7d7a8754a25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:36:03.111102 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-7fca2315-df93-43e3-a4ba-2b6c7dcb6377 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] 10.222.0.121 "GET /compute/v2.1/servers/5306cee9-db16-4ba8-99e3-c54f401ab11d" status: 200 len: 1276 microversion: 2.1 time: 0.172294 Aug 04 10:36:03.128400 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 221/428] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:36:02 2022] GET /compute/v2.1/servers/5306cee9-db16-4ba8-99e3-c54f401ab11d => generated 1276 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:36:03.770936 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-5942ae6d-5162-472e-8c4c-96b5c67e5128 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:36:03.773436 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-5942ae6d-5162-472e-8c4c-96b5c67e5128 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] [instance: 9b09b542-5b10-4244-88af-cb6de23588d8] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:36:03.801449 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-5942ae6d-5162-472e-8c4c-96b5c67e5128 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:03.807660 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-5942ae6d-5162-472e-8c4c-96b5c67e5128 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:03.809745 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-5942ae6d-5162-472e-8c4c-96b5c67e5128 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:03.811571 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-5942ae6d-5162-472e-8c4c-96b5c67e5128 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:04.124730 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-5942ae6d-5162-472e-8c4c-96b5c67e5128 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3170dc3323f54512bc8819c8efa86b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7121bd118a2549c39332cfdb7edaa92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:36:04.144584 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-5942ae6d-5162-472e-8c4c-96b5c67e5128 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] 10.222.0.121 "GET /compute/v2.1/servers/9b09b542-5b10-4244-88af-cb6de23588d8" status: 200 len: 1525 microversion: 2.1 time: 0.384511 Aug 04 10:36:04.147198 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 208/429] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:36:03 2022] GET /compute/v2.1/servers/9b09b542-5b10-4244-88af-cb6de23588d8 => generated 1525 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:36:04.147392 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-eb5ea90c-f211-42bb-96c8-fda308d8baa5 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:36:04.148664 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-eb5ea90c-f211-42bb-96c8-fda308d8baa5 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] [instance: 5306cee9-db16-4ba8-99e3-c54f401ab11d] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:36:04.161861 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-eb5ea90c-f211-42bb-96c8-fda308d8baa5 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:04.163418 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-eb5ea90c-f211-42bb-96c8-fda308d8baa5 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:04.165677 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-eb5ea90c-f211-42bb-96c8-fda308d8baa5 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:04.166977 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-eb5ea90c-f211-42bb-96c8-fda308d8baa5 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:04.453408 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-eb5ea90c-f211-42bb-96c8-fda308d8baa5 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a025ea88db864b55b7537311d20f4808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b1be624402454ba326a7d7a8754a25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:36:04.468833 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-eb5ea90c-f211-42bb-96c8-fda308d8baa5 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] 10.222.0.121 "GET /compute/v2.1/servers/5306cee9-db16-4ba8-99e3-c54f401ab11d" status: 200 len: 1318 microversion: 2.1 time: 0.329087 Aug 04 10:36:04.469932 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 222/430] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:36:04 2022] GET /compute/v2.1/servers/5306cee9-db16-4ba8-99e3-c54f401ab11d => generated 1318 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 10:36:04.662740 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [req-c51b098a-82cc-4476-bb65-e889a080f3ec req-94f13fd6-446e-4168-b01f-d528ef25715d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5306cee9-db16-4ba8-99e3-c54f401ab11d", "tag": "b8c453ef-2fc2-41dd-a0d7-1d19ad8ea1d9"}]} {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:36:04.682030 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [req-c51b098a-82cc-4476-bb65-e889a080f3ec req-94f13fd6-446e-4168-b01f-d528ef25715d service nova] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:04.682487 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [req-c51b098a-82cc-4476-bb65-e889a080f3ec req-94f13fd6-446e-4168-b01f-d528ef25715d service nova] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:04.692915 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG dbcounter [-] [124456] Writing DB stats nova_cell1:SELECT=100 {{(pid=124456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:36:04.707432 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.compute.server_external_events [req-c51b098a-82cc-4476-bb65-e889a080f3ec req-94f13fd6-446e-4168-b01f-d528ef25715d service nova] Creating event network-changed:b8c453ef-2fc2-41dd-a0d7-1d19ad8ea1d9 for instance 5306cee9-db16-4ba8-99e3-c54f401ab11d on hv-cinder-85200 Aug 04 10:36:04.714113 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [req-c51b098a-82cc-4476-bb65-e889a080f3ec req-94f13fd6-446e-4168-b01f-d528ef25715d service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061092 Aug 04 10:36:04.715194 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 209/431] 10.222.0.121 () {64 vars in 1322 bytes} [Thu Aug 4 10:36:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:36:05.174793 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-6ae65daa-43b2-4108-99a3-b12a15f2ee0d tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:36:05.175685 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-6ae65daa-43b2-4108-99a3-b12a15f2ee0d tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] [instance: 9b09b542-5b10-4244-88af-cb6de23588d8] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:36:05.197956 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-6ae65daa-43b2-4108-99a3-b12a15f2ee0d tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:05.199253 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-6ae65daa-43b2-4108-99a3-b12a15f2ee0d tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:05.201323 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-6ae65daa-43b2-4108-99a3-b12a15f2ee0d tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:05.202110 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-6ae65daa-43b2-4108-99a3-b12a15f2ee0d tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:05.494394 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-bd4601d2-15a5-4358-a18a-ed2dd3dc9481 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:36:05.495824 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-bd4601d2-15a5-4358-a18a-ed2dd3dc9481 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] [instance: 5306cee9-db16-4ba8-99e3-c54f401ab11d] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:36:05.508033 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-6ae65daa-43b2-4108-99a3-b12a15f2ee0d tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3170dc3323f54512bc8819c8efa86b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7121bd118a2549c39332cfdb7edaa92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:36:05.511245 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-bd4601d2-15a5-4358-a18a-ed2dd3dc9481 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:05.511718 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-bd4601d2-15a5-4358-a18a-ed2dd3dc9481 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:05.512581 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-bd4601d2-15a5-4358-a18a-ed2dd3dc9481 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:05.513263 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-bd4601d2-15a5-4358-a18a-ed2dd3dc9481 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:05.534366 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-6ae65daa-43b2-4108-99a3-b12a15f2ee0d tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] 10.222.0.121 "GET /compute/v2.1/servers/9b09b542-5b10-4244-88af-cb6de23588d8" status: 200 len: 1525 microversion: 2.1 time: 0.365504 Aug 04 10:36:05.536432 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 223/432] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:36:05 2022] GET /compute/v2.1/servers/9b09b542-5b10-4244-88af-cb6de23588d8 => generated 1525 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:36:05.742354 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-bd4601d2-15a5-4358-a18a-ed2dd3dc9481 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a025ea88db864b55b7537311d20f4808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b1be624402454ba326a7d7a8754a25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:36:05.765477 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-bd4601d2-15a5-4358-a18a-ed2dd3dc9481 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] 10.222.0.121 "GET /compute/v2.1/servers/5306cee9-db16-4ba8-99e3-c54f401ab11d" status: 200 len: 1318 microversion: 2.1 time: 0.277386 Aug 04 10:36:05.766305 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 210/433] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:36:05 2022] GET /compute/v2.1/servers/5306cee9-db16-4ba8-99e3-c54f401ab11d => generated 1318 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:36:06.570691 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-93c64b09-2171-4446-ba11-f16cc0334f10 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:36:06.571670 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-93c64b09-2171-4446-ba11-f16cc0334f10 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] [instance: 9b09b542-5b10-4244-88af-cb6de23588d8] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:36:06.580626 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-93c64b09-2171-4446-ba11-f16cc0334f10 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:06.581103 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-93c64b09-2171-4446-ba11-f16cc0334f10 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:06.582034 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-93c64b09-2171-4446-ba11-f16cc0334f10 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:06.582546 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-93c64b09-2171-4446-ba11-f16cc0334f10 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:06.776342 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-93c64b09-2171-4446-ba11-f16cc0334f10 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3170dc3323f54512bc8819c8efa86b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7121bd118a2549c39332cfdb7edaa92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:36:06.793343 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-08c2ac3f-168d-46a0-be75-96a0999271b2 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:36:06.794133 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-08c2ac3f-168d-46a0-be75-96a0999271b2 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] [instance: 5306cee9-db16-4ba8-99e3-c54f401ab11d] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:36:06.800969 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-93c64b09-2171-4446-ba11-f16cc0334f10 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] 10.222.0.121 "GET /compute/v2.1/servers/9b09b542-5b10-4244-88af-cb6de23588d8" status: 200 len: 1525 microversion: 2.1 time: 0.239416 Aug 04 10:36:06.812492 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 224/434] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:36:06 2022] GET /compute/v2.1/servers/9b09b542-5b10-4244-88af-cb6de23588d8 => generated 1525 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:36:06.817286 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-08c2ac3f-168d-46a0-be75-96a0999271b2 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:06.817286 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-08c2ac3f-168d-46a0-be75-96a0999271b2 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:06.817286 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-08c2ac3f-168d-46a0-be75-96a0999271b2 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:06.817286 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-08c2ac3f-168d-46a0-be75-96a0999271b2 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:07.058630 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-08c2ac3f-168d-46a0-be75-96a0999271b2 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a025ea88db864b55b7537311d20f4808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b1be624402454ba326a7d7a8754a25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:36:07.072849 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-08c2ac3f-168d-46a0-be75-96a0999271b2 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] 10.222.0.121 "GET /compute/v2.1/servers/5306cee9-db16-4ba8-99e3-c54f401ab11d" status: 200 len: 1318 microversion: 2.1 time: 0.283436 Aug 04 10:36:07.074780 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 211/435] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:36:06 2022] GET /compute/v2.1/servers/5306cee9-db16-4ba8-99e3-c54f401ab11d => generated 1318 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:36:07.833052 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-0df859ce-0487-4273-bf36-9e765ac14dfb tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:36:07.834182 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-0df859ce-0487-4273-bf36-9e765ac14dfb tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] [instance: 9b09b542-5b10-4244-88af-cb6de23588d8] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:36:07.845445 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-0df859ce-0487-4273-bf36-9e765ac14dfb tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:07.846173 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-0df859ce-0487-4273-bf36-9e765ac14dfb tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:07.847526 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-0df859ce-0487-4273-bf36-9e765ac14dfb tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:07.848282 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-0df859ce-0487-4273-bf36-9e765ac14dfb tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:08.048858 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-0df859ce-0487-4273-bf36-9e765ac14dfb tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3170dc3323f54512bc8819c8efa86b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7121bd118a2549c39332cfdb7edaa92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:36:08.060756 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-0df859ce-0487-4273-bf36-9e765ac14dfb tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] 10.222.0.121 "GET /compute/v2.1/servers/9b09b542-5b10-4244-88af-cb6de23588d8" status: 200 len: 1525 microversion: 2.1 time: 0.234816 Aug 04 10:36:08.061727 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 225/436] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:36:07 2022] GET /compute/v2.1/servers/9b09b542-5b10-4244-88af-cb6de23588d8 => generated 1525 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 10:36:08.107710 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-e7b2e4ec-d65a-42a9-b308-853fcc9bff4f tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:36:08.108370 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-e7b2e4ec-d65a-42a9-b308-853fcc9bff4f tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] [instance: 5306cee9-db16-4ba8-99e3-c54f401ab11d] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:36:08.119020 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-e7b2e4ec-d65a-42a9-b308-853fcc9bff4f tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:08.119669 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-e7b2e4ec-d65a-42a9-b308-853fcc9bff4f tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:08.120472 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-e7b2e4ec-d65a-42a9-b308-853fcc9bff4f tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:08.120867 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-e7b2e4ec-d65a-42a9-b308-853fcc9bff4f tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:08.304415 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-e7b2e4ec-d65a-42a9-b308-853fcc9bff4f tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a025ea88db864b55b7537311d20f4808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b1be624402454ba326a7d7a8754a25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:36:08.313812 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-e7b2e4ec-d65a-42a9-b308-853fcc9bff4f tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] 10.222.0.121 "GET /compute/v2.1/servers/5306cee9-db16-4ba8-99e3-c54f401ab11d" status: 200 len: 1318 microversion: 2.1 time: 0.210187 Aug 04 10:36:08.328656 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 212/437] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:36:08 2022] GET /compute/v2.1/servers/5306cee9-db16-4ba8-99e3-c54f401ab11d => generated 1318 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:36:09.086212 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-8c874a28-80e0-4dee-b2ea-a44dadca4432 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:36:09.087372 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-8c874a28-80e0-4dee-b2ea-a44dadca4432 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] [instance: 9b09b542-5b10-4244-88af-cb6de23588d8] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:36:09.096889 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-8c874a28-80e0-4dee-b2ea-a44dadca4432 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:09.097538 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-8c874a28-80e0-4dee-b2ea-a44dadca4432 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:09.098433 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-8c874a28-80e0-4dee-b2ea-a44dadca4432 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:09.098882 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-8c874a28-80e0-4dee-b2ea-a44dadca4432 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:09.340883 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-2944de06-c87b-4b22-9d9f-deecfd493cdc tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:36:09.341730 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-2944de06-c87b-4b22-9d9f-deecfd493cdc tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] [instance: 5306cee9-db16-4ba8-99e3-c54f401ab11d] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:36:09.349099 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-2944de06-c87b-4b22-9d9f-deecfd493cdc tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:09.350407 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-2944de06-c87b-4b22-9d9f-deecfd493cdc tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:09.351425 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-2944de06-c87b-4b22-9d9f-deecfd493cdc tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:09.352221 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-2944de06-c87b-4b22-9d9f-deecfd493cdc tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:09.359594 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-8c874a28-80e0-4dee-b2ea-a44dadca4432 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3170dc3323f54512bc8819c8efa86b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7121bd118a2549c39332cfdb7edaa92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:36:09.368596 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-8c874a28-80e0-4dee-b2ea-a44dadca4432 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] 10.222.0.121 "GET /compute/v2.1/servers/9b09b542-5b10-4244-88af-cb6de23588d8" status: 200 len: 1525 microversion: 2.1 time: 0.287972 Aug 04 10:36:09.369166 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 226/438] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:36:09 2022] GET /compute/v2.1/servers/9b09b542-5b10-4244-88af-cb6de23588d8 => generated 1525 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:36:09.546476 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-2944de06-c87b-4b22-9d9f-deecfd493cdc tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a025ea88db864b55b7537311d20f4808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b1be624402454ba326a7d7a8754a25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:36:09.561372 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-2944de06-c87b-4b22-9d9f-deecfd493cdc tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] 10.222.0.121 "GET /compute/v2.1/servers/5306cee9-db16-4ba8-99e3-c54f401ab11d" status: 200 len: 1318 microversion: 2.1 time: 0.225631 Aug 04 10:36:09.562832 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 213/439] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:36:09 2022] GET /compute/v2.1/servers/5306cee9-db16-4ba8-99e3-c54f401ab11d => generated 1318 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 10:36:09.840624 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 10:36:09.840624 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: Thu Aug 4 10:36:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 10:36:10.390646 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-d74fde29-40cb-46e1-8cf5-e34f925cd028 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:36:10.391291 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-d74fde29-40cb-46e1-8cf5-e34f925cd028 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] [instance: 9b09b542-5b10-4244-88af-cb6de23588d8] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:36:10.399610 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-d74fde29-40cb-46e1-8cf5-e34f925cd028 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:10.400090 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-d74fde29-40cb-46e1-8cf5-e34f925cd028 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:10.400913 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-d74fde29-40cb-46e1-8cf5-e34f925cd028 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:10.401351 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-d74fde29-40cb-46e1-8cf5-e34f925cd028 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:10.570349 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-d74fde29-40cb-46e1-8cf5-e34f925cd028 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3170dc3323f54512bc8819c8efa86b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7121bd118a2549c39332cfdb7edaa92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:36:10.583807 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-d74fde29-40cb-46e1-8cf5-e34f925cd028 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] 10.222.0.121 "GET /compute/v2.1/servers/9b09b542-5b10-4244-88af-cb6de23588d8" status: 200 len: 1525 microversion: 2.1 time: 0.197307 Aug 04 10:36:10.585190 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 227/440] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:36:10 2022] GET /compute/v2.1/servers/9b09b542-5b10-4244-88af-cb6de23588d8 => generated 1525 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:36:10.602227 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-b6e05312-b82e-48be-8194-829c4b62acc1 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:36:10.603012 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-b6e05312-b82e-48be-8194-829c4b62acc1 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] [instance: 5306cee9-db16-4ba8-99e3-c54f401ab11d] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:36:10.605214 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG dbcounter [-] [124456] Writing DB stats nova_cell0:SELECT=2 {{(pid=124456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:36:10.606214 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG dbcounter [-] [124456] Writing DB stats nova_cell0:SELECT=6 {{(pid=124456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:36:10.614813 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-b6e05312-b82e-48be-8194-829c4b62acc1 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:10.615526 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-b6e05312-b82e-48be-8194-829c4b62acc1 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:10.616619 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-b6e05312-b82e-48be-8194-829c4b62acc1 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:10.617476 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-b6e05312-b82e-48be-8194-829c4b62acc1 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:10.768307 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-b6e05312-b82e-48be-8194-829c4b62acc1 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a025ea88db864b55b7537311d20f4808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b1be624402454ba326a7d7a8754a25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:36:10.776889 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-b6e05312-b82e-48be-8194-829c4b62acc1 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] 10.222.0.121 "GET /compute/v2.1/servers/5306cee9-db16-4ba8-99e3-c54f401ab11d" status: 200 len: 1318 microversion: 2.1 time: 0.179121 Aug 04 10:36:10.777486 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 214/441] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:36:10 2022] GET /compute/v2.1/servers/5306cee9-db16-4ba8-99e3-c54f401ab11d => generated 1318 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:36:11.607879 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-9d433221-0432-450f-8efa-289e09fad6c8 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:36:11.608894 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-9d433221-0432-450f-8efa-289e09fad6c8 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] [instance: 9b09b542-5b10-4244-88af-cb6de23588d8] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:36:11.610868 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG dbcounter [-] [124457] Writing DB stats nova_cell0:SELECT=2 {{(pid=124457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:36:11.618947 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-9d433221-0432-450f-8efa-289e09fad6c8 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:11.619672 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-9d433221-0432-450f-8efa-289e09fad6c8 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:11.620698 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-9d433221-0432-450f-8efa-289e09fad6c8 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:11.621215 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-9d433221-0432-450f-8efa-289e09fad6c8 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:11.796303 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-9d433221-0432-450f-8efa-289e09fad6c8 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3170dc3323f54512bc8819c8efa86b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7121bd118a2549c39332cfdb7edaa92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:36:11.799576 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-b261842b-8d3c-472a-b2f6-c88f555ff127 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:36:11.801000 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-b261842b-8d3c-472a-b2f6-c88f555ff127 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] [instance: 5306cee9-db16-4ba8-99e3-c54f401ab11d] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:36:11.804988 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-9d433221-0432-450f-8efa-289e09fad6c8 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] 10.222.0.121 "GET /compute/v2.1/servers/9b09b542-5b10-4244-88af-cb6de23588d8" status: 200 len: 1525 microversion: 2.1 time: 0.201364 Aug 04 10:36:11.812868 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 228/442] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:36:11 2022] GET /compute/v2.1/servers/9b09b542-5b10-4244-88af-cb6de23588d8 => generated 1525 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:36:11.814527 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-b261842b-8d3c-472a-b2f6-c88f555ff127 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:11.815005 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-b261842b-8d3c-472a-b2f6-c88f555ff127 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:11.816162 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-b261842b-8d3c-472a-b2f6-c88f555ff127 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:11.816783 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-b261842b-8d3c-472a-b2f6-c88f555ff127 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:12.033314 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-b261842b-8d3c-472a-b2f6-c88f555ff127 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a025ea88db864b55b7537311d20f4808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b1be624402454ba326a7d7a8754a25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:36:12.046248 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-b261842b-8d3c-472a-b2f6-c88f555ff127 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] 10.222.0.121 "GET /compute/v2.1/servers/5306cee9-db16-4ba8-99e3-c54f401ab11d" status: 200 len: 1318 microversion: 2.1 time: 0.250800 Aug 04 10:36:12.046849 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 215/443] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:36:11 2022] GET /compute/v2.1/servers/5306cee9-db16-4ba8-99e3-c54f401ab11d => generated 1318 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:36:12.173963 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [req-3ab9dfc4-1592-4201-8808-7541ad5fd207 req-30442e14-db58-4c1b-9f3b-16cb747cc272 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5306cee9-db16-4ba8-99e3-c54f401ab11d", "name": "network-vif-plugged", "status": "completed", "tag": "b8c453ef-2fc2-41dd-a0d7-1d19ad8ea1d9"}]} {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:36:12.189977 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [req-3ab9dfc4-1592-4201-8808-7541ad5fd207 req-30442e14-db58-4c1b-9f3b-16cb747cc272 service nova] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:12.190563 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [req-3ab9dfc4-1592-4201-8808-7541ad5fd207 req-30442e14-db58-4c1b-9f3b-16cb747cc272 service nova] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:12.214661 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.compute.server_external_events [req-3ab9dfc4-1592-4201-8808-7541ad5fd207 req-30442e14-db58-4c1b-9f3b-16cb747cc272 service nova] Creating event network-vif-plugged:b8c453ef-2fc2-41dd-a0d7-1d19ad8ea1d9 for instance 5306cee9-db16-4ba8-99e3-c54f401ab11d on hv-cinder-85200 Aug 04 10:36:12.219989 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [req-3ab9dfc4-1592-4201-8808-7541ad5fd207 req-30442e14-db58-4c1b-9f3b-16cb747cc272 service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050435 Aug 04 10:36:12.221035 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 229/444] 10.222.0.121 () {64 vars in 1322 bytes} [Thu Aug 4 10:36:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:36:12.826763 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-3a5f0659-7cef-4d17-93bf-a9c80de589d9 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:36:12.828394 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-3a5f0659-7cef-4d17-93bf-a9c80de589d9 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] [instance: 9b09b542-5b10-4244-88af-cb6de23588d8] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:36:12.835684 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-3a5f0659-7cef-4d17-93bf-a9c80de589d9 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:12.836231 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-3a5f0659-7cef-4d17-93bf-a9c80de589d9 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:12.837299 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-3a5f0659-7cef-4d17-93bf-a9c80de589d9 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:12.837934 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-3a5f0659-7cef-4d17-93bf-a9c80de589d9 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:13.092730 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-11152b94-df8c-47e3-9ce7-7a3bed14c200 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:36:13.095883 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-11152b94-df8c-47e3-9ce7-7a3bed14c200 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] [instance: 5306cee9-db16-4ba8-99e3-c54f401ab11d] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:36:13.123568 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-3a5f0659-7cef-4d17-93bf-a9c80de589d9 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3170dc3323f54512bc8819c8efa86b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7121bd118a2549c39332cfdb7edaa92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:36:13.140035 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-11152b94-df8c-47e3-9ce7-7a3bed14c200 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:13.146421 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-3a5f0659-7cef-4d17-93bf-a9c80de589d9 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] 10.222.0.121 "GET /compute/v2.1/servers/9b09b542-5b10-4244-88af-cb6de23588d8" status: 200 len: 1525 microversion: 2.1 time: 0.323196 Aug 04 10:36:13.147895 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-11152b94-df8c-47e3-9ce7-7a3bed14c200 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:13.149393 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-11152b94-df8c-47e3-9ce7-7a3bed14c200 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:13.150231 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-11152b94-df8c-47e3-9ce7-7a3bed14c200 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:13.155466 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 216/445] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:36:12 2022] GET /compute/v2.1/servers/9b09b542-5b10-4244-88af-cb6de23588d8 => generated 1525 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:36:13.367903 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-11152b94-df8c-47e3-9ce7-7a3bed14c200 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a025ea88db864b55b7537311d20f4808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b1be624402454ba326a7d7a8754a25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:36:13.376918 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-11152b94-df8c-47e3-9ce7-7a3bed14c200 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] 10.222.0.121 "GET /compute/v2.1/servers/5306cee9-db16-4ba8-99e3-c54f401ab11d" status: 200 len: 1318 microversion: 2.1 time: 0.297070 Aug 04 10:36:13.377909 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 230/446] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:36:13 2022] GET /compute/v2.1/servers/5306cee9-db16-4ba8-99e3-c54f401ab11d => generated 1318 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:36:14.178069 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-3351338a-67ce-49d7-9f26-8c2bff71d2a3 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:36:14.179113 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-3351338a-67ce-49d7-9f26-8c2bff71d2a3 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] [instance: 9b09b542-5b10-4244-88af-cb6de23588d8] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:36:14.189552 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-3351338a-67ce-49d7-9f26-8c2bff71d2a3 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:14.190558 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-3351338a-67ce-49d7-9f26-8c2bff71d2a3 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:14.192092 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-3351338a-67ce-49d7-9f26-8c2bff71d2a3 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:14.193164 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-3351338a-67ce-49d7-9f26-8c2bff71d2a3 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:14.374569 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-3351338a-67ce-49d7-9f26-8c2bff71d2a3 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3170dc3323f54512bc8819c8efa86b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7121bd118a2549c39332cfdb7edaa92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:36:14.385887 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-3351338a-67ce-49d7-9f26-8c2bff71d2a3 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] 10.222.0.121 "GET /compute/v2.1/servers/9b09b542-5b10-4244-88af-cb6de23588d8" status: 200 len: 1525 microversion: 2.1 time: 0.211804 Aug 04 10:36:14.404309 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 217/447] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:36:14 2022] GET /compute/v2.1/servers/9b09b542-5b10-4244-88af-cb6de23588d8 => generated 1525 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:36:14.412707 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-51afed1c-ba4f-40bb-b341-9a5361f051f6 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:36:14.413679 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-51afed1c-ba4f-40bb-b341-9a5361f051f6 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] [instance: 5306cee9-db16-4ba8-99e3-c54f401ab11d] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:36:14.424408 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-51afed1c-ba4f-40bb-b341-9a5361f051f6 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:14.425262 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-51afed1c-ba4f-40bb-b341-9a5361f051f6 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:14.426765 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-51afed1c-ba4f-40bb-b341-9a5361f051f6 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:14.427607 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-51afed1c-ba4f-40bb-b341-9a5361f051f6 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:14.611620 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-51afed1c-ba4f-40bb-b341-9a5361f051f6 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a025ea88db864b55b7537311d20f4808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b1be624402454ba326a7d7a8754a25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:36:14.619140 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-51afed1c-ba4f-40bb-b341-9a5361f051f6 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] 10.222.0.121 "GET /compute/v2.1/servers/5306cee9-db16-4ba8-99e3-c54f401ab11d" status: 200 len: 1318 microversion: 2.1 time: 0.212818 Aug 04 10:36:14.621806 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 231/448] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:36:14 2022] GET /compute/v2.1/servers/5306cee9-db16-4ba8-99e3-c54f401ab11d => generated 1318 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:36:15.414118 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-cbfa8e5c-7180-4615-88b0-0f6cad04f181 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:36:15.414743 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-cbfa8e5c-7180-4615-88b0-0f6cad04f181 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] [instance: 9b09b542-5b10-4244-88af-cb6de23588d8] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:36:15.424526 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-cbfa8e5c-7180-4615-88b0-0f6cad04f181 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:15.424972 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-cbfa8e5c-7180-4615-88b0-0f6cad04f181 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:15.425851 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-cbfa8e5c-7180-4615-88b0-0f6cad04f181 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:15.426283 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-cbfa8e5c-7180-4615-88b0-0f6cad04f181 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:15.594942 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-cbfa8e5c-7180-4615-88b0-0f6cad04f181 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3170dc3323f54512bc8819c8efa86b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7121bd118a2549c39332cfdb7edaa92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:36:15.603718 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-cbfa8e5c-7180-4615-88b0-0f6cad04f181 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] 10.222.0.121 "GET /compute/v2.1/servers/9b09b542-5b10-4244-88af-cb6de23588d8" status: 200 len: 1525 microversion: 2.1 time: 0.193471 Aug 04 10:36:15.604340 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 218/449] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:36:15 2022] GET /compute/v2.1/servers/9b09b542-5b10-4244-88af-cb6de23588d8 => generated 1525 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:36:15.641519 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-db56d697-abd1-4617-80c1-e1bcc53f7ae8 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:36:15.643015 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-db56d697-abd1-4617-80c1-e1bcc53f7ae8 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] [instance: 5306cee9-db16-4ba8-99e3-c54f401ab11d] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:36:15.650860 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-db56d697-abd1-4617-80c1-e1bcc53f7ae8 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:15.651473 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-db56d697-abd1-4617-80c1-e1bcc53f7ae8 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:15.652654 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-db56d697-abd1-4617-80c1-e1bcc53f7ae8 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:15.657504 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-db56d697-abd1-4617-80c1-e1bcc53f7ae8 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:15.657889 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG dbcounter [-] [124457] Writing DB stats nova_cell1:SELECT=100 {{(pid=124457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:36:15.823888 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-db56d697-abd1-4617-80c1-e1bcc53f7ae8 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a025ea88db864b55b7537311d20f4808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b1be624402454ba326a7d7a8754a25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:36:15.837208 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-db56d697-abd1-4617-80c1-e1bcc53f7ae8 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] 10.222.0.121 "GET /compute/v2.1/servers/5306cee9-db16-4ba8-99e3-c54f401ab11d" status: 200 len: 1318 microversion: 2.1 time: 0.199323 Aug 04 10:36:15.838343 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 232/450] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:36:15 2022] GET /compute/v2.1/servers/5306cee9-db16-4ba8-99e3-c54f401ab11d => generated 1318 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:36:16.626760 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-0c30a847-3e04-48a9-b805-9a5837cd4d22 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:36:16.628132 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-0c30a847-3e04-48a9-b805-9a5837cd4d22 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] [instance: 9b09b542-5b10-4244-88af-cb6de23588d8] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:36:16.636727 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-0c30a847-3e04-48a9-b805-9a5837cd4d22 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:16.637301 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-0c30a847-3e04-48a9-b805-9a5837cd4d22 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:16.639135 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-0c30a847-3e04-48a9-b805-9a5837cd4d22 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:16.639915 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-0c30a847-3e04-48a9-b805-9a5837cd4d22 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:16.790821 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-0c30a847-3e04-48a9-b805-9a5837cd4d22 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3170dc3323f54512bc8819c8efa86b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7121bd118a2549c39332cfdb7edaa92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:36:16.799103 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-0c30a847-3e04-48a9-b805-9a5837cd4d22 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] 10.222.0.121 "GET /compute/v2.1/servers/9b09b542-5b10-4244-88af-cb6de23588d8" status: 200 len: 1505 microversion: 2.1 time: 0.176795 Aug 04 10:36:16.799698 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 219/451] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:36:16 2022] GET /compute/v2.1/servers/9b09b542-5b10-4244-88af-cb6de23588d8 => generated 1505 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:36:16.820850 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-dccf114b-f2e4-47b3-be48-dbd51ce4200c tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2ec7d7bb-165a-426b-b639-ccc7989aea0f"}} {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:36:16.823235 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-dccf114b-f2e4-47b3-be48-dbd51ce4200c tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] [instance: 9b09b542-5b10-4244-88af-cb6de23588d8] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:36:16.830123 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-dccf114b-f2e4-47b3-be48-dbd51ce4200c tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:16.830566 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-dccf114b-f2e4-47b3-be48-dbd51ce4200c tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:16.831427 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-dccf114b-f2e4-47b3-be48-dbd51ce4200c tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:16.831868 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-dccf114b-f2e4-47b3-be48-dbd51ce4200c tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:16.860873 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.wsgi [None req-dccf114b-f2e4-47b3-be48-dbd51ce4200c tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] HTTP exception thrown: Cannot 'attach_volume' instance 9b09b542-5b10-4244-88af-cb6de23588d8 while it is in vm_state rescued Aug 04 10:36:16.863770 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-dccf114b-f2e4-47b3-be48-dbd51ce4200c tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Request method failure captured: Aug 04 10:36:16.863770 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: request: POST /compute/v2.1/servers/9b09b542-5b10-4244-88af-cb6de23588d8/os-volume_attachments HTTP/1.1 Aug 04 10:36:16.863770 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: Accept: application/json Aug 04 10:36:16.863770 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: Accept-Encoding: identity Aug 04 10:36:16.863770 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: Connection: close Aug 04 10:36:16.863770 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: Content-Length: 74 Aug 04 10:36:16.863770 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: Content-Type: application/json Aug 04 10:36:16.863770 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: Host: 10.222.0.121 Aug 04 10:36:16.863770 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: Openstack-System-Scope: None Aug 04 10:36:16.863770 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: User-Agent: python-urllib3/1.26.11 Aug 04 10:36:16.863770 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Auth-Token: gAAAAABi66Bc3v4QS1FtUMzLABOQnByGgDiNvJ-JvGmdBDVbq6x7lQW47g6_YVrbEeRME3TfDfNZZQZzvek1irFXoT0OrvdtDRcHao-WSK1U1LXxlYJ7lzEubI7Szk80hERaW5e12YVPeHwUKRft5YXP3uZ6ZxfgU3B2fGKT8Q_qAH4d7HdL2nw Aug 04 10:36:16.863770 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Domain-Id: None Aug 04 10:36:16.863770 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Domain-Name: None Aug 04 10:36:16.863770 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Identity-Status: Confirmed Aug 04 10:36:16.863770 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Is-Admin-Project: True Aug 04 10:36:16.863770 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Project-Domain-Id: default Aug 04 10:36:16.863770 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Project-Domain-Name: Default Aug 04 10:36:16.863770 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Project-Id: 7121bd118a2549c39332cfdb7edaa92f Aug 04 10:36:16.863770 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-47221404 Aug 04 10:36:16.863770 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Role: reader,member Aug 04 10:36:16.863770 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Roles: reader,member Aug 04 10:36:16.865586 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/7121bd118a2549c39332cfdb7edaa92f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/7121bd118a2549c39332cfdb7edaa92f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.121:8080", "publicURL": "http://10.222.0.121:8080/v1/AUTH_7121bd118a2549c39332cfdb7edaa92f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2/7121bd118a2549c39332cfdb7edaa92f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:9696/networking"}]}] Aug 04 10:36:16.865586 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Tenant: tempest-ServerRescueNegativeTestJSON-47221404 Aug 04 10:36:16.865586 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Tenant-Id: 7121bd118a2549c39332cfdb7edaa92f Aug 04 10:36:16.865586 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-47221404 Aug 04 10:36:16.865586 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-User: tempest-ServerRescueNegativeTestJSON-47221404-project Aug 04 10:36:16.865586 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-User-Domain-Id: default Aug 04 10:36:16.865586 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-User-Domain-Name: Default Aug 04 10:36:16.865586 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-User-Id: 3170dc3323f54512bc8819c8efa86b0f Aug 04 10:36:16.865586 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-User-Name: tempest-ServerRescueNegativeTestJSON-47221404-project Aug 04 10:36:16.865586 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: Aug 04 10:36:16.865586 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: {"volumeAttachment": {"volumeId": "2ec7d7bb-165a-426b-b639-ccc7989aea0f"}} Aug 04 10:36:16.865586 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: method: > Aug 04 10:36:16.866371 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: exception: Cannot 'attach_volume' instance 9b09b542-5b10-4244-88af-cb6de23588d8 while it is in vm_state rescued Aug 04 10:36:16.866371 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: action_args: {'server_id': '9b09b542-5b10-4244-88af-cb6de23588d8', 'body': {'volumeAttachment': {'volumeId': '2ec7d7bb-165a-426b-b639-ccc7989aea0f'}}} Aug 04 10:36:16.866371 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 10:36:16.866371 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:36:16.866371 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 04 10:36:16.866371 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 04 10:36:16.866371 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 04 10:36:16.866371 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 04 10:36:16.866371 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 04 10:36:16.866371 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 04 10:36:16.866371 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 9b09b542-5b10-4244-88af-cb6de23588d8 in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 04 10:36:16.866371 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Aug 04 10:36:16.866371 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:36:16.866371 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Aug 04 10:36:16.866371 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:36:16.866371 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:36:16.866371 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:36:16.866371 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 10:36:16.866371 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 10:36:16.867565 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 10:36:16.867565 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 10:36:16.867565 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 10:36:16.867565 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 10:36:16.867565 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 10:36:16.867565 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 10:36:16.867565 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 10:36:16.867565 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 10:36:16.867565 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 04 10:36:16.867565 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 04 10:36:16.867565 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 04 10:36:16.867565 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 04 10:36:16.867565 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 9b09b542-5b10-4244-88af-cb6de23588d8 while it is in vm_state rescued Aug 04 10:36:16.867565 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Aug 04 10:36:16.867565 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:36:16.867565 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Aug 04 10:36:16.867565 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:36:16.867565 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:36:16.867565 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:36:16.868740 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 10:36:16.868740 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 10:36:16.868740 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 9b09b542-5b10-4244-88af-cb6de23588d8 while it is in vm_state rescued Aug 04 10:36:16.868740 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Aug 04 10:36:16.870581 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-dccf114b-f2e4-47b3-be48-dbd51ce4200c tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Returning 409 to user: Cannot 'attach_volume' instance 9b09b542-5b10-4244-88af-cb6de23588d8 while it is in vm_state rescued {{(pid=124457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 10:36:16.871687 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-dccf114b-f2e4-47b3-be48-dbd51ce4200c tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] 10.222.0.121 "POST /compute/v2.1/servers/9b09b542-5b10-4244-88af-cb6de23588d8/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.055254 Aug 04 10:36:16.872520 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 233/452] 10.222.0.121 () {60 vars in 1328 bytes} [Thu Aug 4 10:36:16 2022] POST /compute/v2.1/servers/9b09b542-5b10-4244-88af-cb6de23588d8/os-volume_attachments => generated 152 bytes in 57 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 04 10:36:16.873644 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-231b580c-3f00-4bba-8598-7a4e034b2f84 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:36:16.874287 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-231b580c-3f00-4bba-8598-7a4e034b2f84 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] [instance: 5306cee9-db16-4ba8-99e3-c54f401ab11d] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:36:16.881728 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-231b580c-3f00-4bba-8598-7a4e034b2f84 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:16.882632 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-231b580c-3f00-4bba-8598-7a4e034b2f84 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:16.883713 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-231b580c-3f00-4bba-8598-7a4e034b2f84 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:16.884429 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-231b580c-3f00-4bba-8598-7a4e034b2f84 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:16.891619 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-33919084-76cf-48e5-a3bb-8f8efe61a55f tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:36:16.895179 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-33919084-76cf-48e5-a3bb-8f8efe61a55f tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] [instance: 9b09b542-5b10-4244-88af-cb6de23588d8] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:36:16.905961 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-33919084-76cf-48e5-a3bb-8f8efe61a55f tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:16.906686 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-33919084-76cf-48e5-a3bb-8f8efe61a55f tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:16.907888 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-33919084-76cf-48e5-a3bb-8f8efe61a55f tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:16.908423 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-33919084-76cf-48e5-a3bb-8f8efe61a55f tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:17.032620 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-33919084-76cf-48e5-a3bb-8f8efe61a55f tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] 10.222.0.121 "POST /compute/v2.1/servers/9b09b542-5b10-4244-88af-cb6de23588d8/action" status: 202 len: 0 microversion: 2.1 time: 0.153611 Aug 04 10:36:17.036080 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 234/453] 10.222.0.121 () {60 vars in 1283 bytes} [Thu Aug 4 10:36:16 2022] POST /compute/v2.1/servers/9b09b542-5b10-4244-88af-cb6de23588d8/action => generated 0 bytes in 156 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 10:36:17.046566 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-c9a36f93-b521-4eaa-ae61-96fb7051ece8 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:36:17.047682 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-c9a36f93-b521-4eaa-ae61-96fb7051ece8 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] [instance: 9b09b542-5b10-4244-88af-cb6de23588d8] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:36:17.054747 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-c9a36f93-b521-4eaa-ae61-96fb7051ece8 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:17.055233 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-c9a36f93-b521-4eaa-ae61-96fb7051ece8 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:17.056073 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-c9a36f93-b521-4eaa-ae61-96fb7051ece8 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:17.056699 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-c9a36f93-b521-4eaa-ae61-96fb7051ece8 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:17.058076 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-231b580c-3f00-4bba-8598-7a4e034b2f84 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a025ea88db864b55b7537311d20f4808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b1be624402454ba326a7d7a8754a25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:36:17.066915 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-231b580c-3f00-4bba-8598-7a4e034b2f84 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] 10.222.0.121 "GET /compute/v2.1/servers/5306cee9-db16-4ba8-99e3-c54f401ab11d" status: 200 len: 1318 microversion: 2.1 time: 0.201465 Aug 04 10:36:17.080511 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 220/454] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:36:16 2022] GET /compute/v2.1/servers/5306cee9-db16-4ba8-99e3-c54f401ab11d => generated 1318 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:36:17.507164 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-c9a36f93-b521-4eaa-ae61-96fb7051ece8 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3170dc3323f54512bc8819c8efa86b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7121bd118a2549c39332cfdb7edaa92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:36:17.516038 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-c9a36f93-b521-4eaa-ae61-96fb7051ece8 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] 10.222.0.121 "GET /compute/v2.1/servers/9b09b542-5b10-4244-88af-cb6de23588d8" status: 200 len: 1513 microversion: 2.1 time: 0.475579 Aug 04 10:36:17.517291 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 235/455] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:36:17 2022] GET /compute/v2.1/servers/9b09b542-5b10-4244-88af-cb6de23588d8 => generated 1513 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:36:18.089650 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-01b37224-407d-46af-8478-cd6e744738bd tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:36:18.090323 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-01b37224-407d-46af-8478-cd6e744738bd tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] [instance: 5306cee9-db16-4ba8-99e3-c54f401ab11d] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:36:18.096947 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-01b37224-407d-46af-8478-cd6e744738bd tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:18.097402 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-01b37224-407d-46af-8478-cd6e744738bd tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:18.098206 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-01b37224-407d-46af-8478-cd6e744738bd tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:18.098657 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-01b37224-407d-46af-8478-cd6e744738bd tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:18.270144 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-01b37224-407d-46af-8478-cd6e744738bd tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a025ea88db864b55b7537311d20f4808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b1be624402454ba326a7d7a8754a25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:36:18.279048 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-01b37224-407d-46af-8478-cd6e744738bd tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] 10.222.0.121 "GET /compute/v2.1/servers/5306cee9-db16-4ba8-99e3-c54f401ab11d" status: 200 len: 1502 microversion: 2.1 time: 0.194025 Aug 04 10:36:18.279656 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 221/456] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:36:18 2022] GET /compute/v2.1/servers/5306cee9-db16-4ba8-99e3-c54f401ab11d => generated 1502 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:36:18.540512 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-412c4e43-219c-46e3-a83a-c5669d2fab8a tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:36:18.541128 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-412c4e43-219c-46e3-a83a-c5669d2fab8a tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] [instance: 9b09b542-5b10-4244-88af-cb6de23588d8] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:36:18.549019 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-412c4e43-219c-46e3-a83a-c5669d2fab8a tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:18.560074 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-412c4e43-219c-46e3-a83a-c5669d2fab8a tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:18.560074 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-412c4e43-219c-46e3-a83a-c5669d2fab8a tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:18.560074 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-412c4e43-219c-46e3-a83a-c5669d2fab8a tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:18.724054 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-412c4e43-219c-46e3-a83a-c5669d2fab8a tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3170dc3323f54512bc8819c8efa86b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7121bd118a2549c39332cfdb7edaa92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:36:18.738891 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-412c4e43-219c-46e3-a83a-c5669d2fab8a tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] 10.222.0.121 "GET /compute/v2.1/servers/9b09b542-5b10-4244-88af-cb6de23588d8" status: 200 len: 1513 microversion: 2.1 time: 0.202746 Aug 04 10:36:18.740271 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 236/457] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:36:18 2022] GET /compute/v2.1/servers/9b09b542-5b10-4244-88af-cb6de23588d8 => generated 1513 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:36:19.155293 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-ea62a8be-baa2-44fc-b808-0e36ff3feaa8 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:36:19.157759 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-ea62a8be-baa2-44fc-b808-0e36ff3feaa8 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] [instance: 5306cee9-db16-4ba8-99e3-c54f401ab11d] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:36:19.164909 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-ea62a8be-baa2-44fc-b808-0e36ff3feaa8 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:19.165458 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-ea62a8be-baa2-44fc-b808-0e36ff3feaa8 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:19.166373 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-ea62a8be-baa2-44fc-b808-0e36ff3feaa8 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:19.167064 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-ea62a8be-baa2-44fc-b808-0e36ff3feaa8 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:19.201804 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-ea62a8be-baa2-44fc-b808-0e36ff3feaa8 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] [instance: 5306cee9-db16-4ba8-99e3-c54f401ab11d] Going to try to terminate instance {{(pid=124456) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 10:36:19.327553 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-ea62a8be-baa2-44fc-b808-0e36ff3feaa8 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] 10.222.0.121 "DELETE /compute/v2.1/servers/5306cee9-db16-4ba8-99e3-c54f401ab11d" status: 204 len: 0 microversion: 2.1 time: 0.177007 Aug 04 10:36:19.328213 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 222/458] 10.222.0.121 () {58 vars in 1244 bytes} [Thu Aug 4 10:36:19 2022] DELETE /compute/v2.1/servers/5306cee9-db16-4ba8-99e3-c54f401ab11d => generated 0 bytes in 179 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 10:36:19.337997 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-18d96647-ab08-4f10-bc24-fa636ade686d tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:36:19.338630 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-18d96647-ab08-4f10-bc24-fa636ade686d tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] [instance: 5306cee9-db16-4ba8-99e3-c54f401ab11d] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:36:19.345177 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-18d96647-ab08-4f10-bc24-fa636ade686d tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:19.345567 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-18d96647-ab08-4f10-bc24-fa636ade686d tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:19.346343 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-18d96647-ab08-4f10-bc24-fa636ade686d tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:19.346780 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-18d96647-ab08-4f10-bc24-fa636ade686d tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:19.518375 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-18d96647-ab08-4f10-bc24-fa636ade686d tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a025ea88db864b55b7537311d20f4808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b1be624402454ba326a7d7a8754a25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:36:19.527744 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-18d96647-ab08-4f10-bc24-fa636ade686d tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] 10.222.0.121 "GET /compute/v2.1/servers/5306cee9-db16-4ba8-99e3-c54f401ab11d" status: 200 len: 1508 microversion: 2.1 time: 0.194409 Aug 04 10:36:19.528382 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 237/459] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:36:19 2022] GET /compute/v2.1/servers/5306cee9-db16-4ba8-99e3-c54f401ab11d => generated 1508 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:36:19.776776 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-5f606863-c281-4b50-960a-447ebfc800c1 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:36:19.777501 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-5f606863-c281-4b50-960a-447ebfc800c1 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] [instance: 9b09b542-5b10-4244-88af-cb6de23588d8] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:36:19.786089 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-5f606863-c281-4b50-960a-447ebfc800c1 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:19.787152 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-5f606863-c281-4b50-960a-447ebfc800c1 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:19.788138 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-5f606863-c281-4b50-960a-447ebfc800c1 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:19.788574 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-5f606863-c281-4b50-960a-447ebfc800c1 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:19.950082 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-5f606863-c281-4b50-960a-447ebfc800c1 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3170dc3323f54512bc8819c8efa86b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7121bd118a2549c39332cfdb7edaa92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:36:19.958793 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-5f606863-c281-4b50-960a-447ebfc800c1 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] 10.222.0.121 "GET /compute/v2.1/servers/9b09b542-5b10-4244-88af-cb6de23588d8" status: 200 len: 1513 microversion: 2.1 time: 0.186274 Aug 04 10:36:19.959401 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 223/460] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:36:19 2022] GET /compute/v2.1/servers/9b09b542-5b10-4244-88af-cb6de23588d8 => generated 1513 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:36:20.551254 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-000f90a7-c074-4b1f-a717-0a8c266c6006 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:36:20.552120 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-000f90a7-c074-4b1f-a717-0a8c266c6006 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] [instance: 5306cee9-db16-4ba8-99e3-c54f401ab11d] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:36:20.566708 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-000f90a7-c074-4b1f-a717-0a8c266c6006 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:20.567146 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-000f90a7-c074-4b1f-a717-0a8c266c6006 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:20.576219 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-000f90a7-c074-4b1f-a717-0a8c266c6006 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:20.580471 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-000f90a7-c074-4b1f-a717-0a8c266c6006 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:20.811738 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-000f90a7-c074-4b1f-a717-0a8c266c6006 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a025ea88db864b55b7537311d20f4808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b1be624402454ba326a7d7a8754a25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:36:20.830720 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-000f90a7-c074-4b1f-a717-0a8c266c6006 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] 10.222.0.121 "GET /compute/v2.1/servers/5306cee9-db16-4ba8-99e3-c54f401ab11d" status: 200 len: 1508 microversion: 2.1 time: 0.284182 Aug 04 10:36:20.833142 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 238/461] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:36:20 2022] GET /compute/v2.1/servers/5306cee9-db16-4ba8-99e3-c54f401ab11d => generated 1508 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 10:36:20.981574 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-74998791-847e-4eb6-95a6-9b28de3f1a54 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:36:20.982736 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-74998791-847e-4eb6-95a6-9b28de3f1a54 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] [instance: 9b09b542-5b10-4244-88af-cb6de23588d8] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:36:20.995665 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-74998791-847e-4eb6-95a6-9b28de3f1a54 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:20.996627 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-74998791-847e-4eb6-95a6-9b28de3f1a54 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:21.001211 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-74998791-847e-4eb6-95a6-9b28de3f1a54 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:21.002074 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-74998791-847e-4eb6-95a6-9b28de3f1a54 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:21.189831 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-74998791-847e-4eb6-95a6-9b28de3f1a54 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3170dc3323f54512bc8819c8efa86b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7121bd118a2549c39332cfdb7edaa92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:36:21.195863 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG dbcounter [-] [124456] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:36:21.202210 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-74998791-847e-4eb6-95a6-9b28de3f1a54 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] 10.222.0.121 "GET /compute/v2.1/servers/9b09b542-5b10-4244-88af-cb6de23588d8" status: 200 len: 1513 microversion: 2.1 time: 0.225495 Aug 04 10:36:21.202982 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 224/462] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:36:20 2022] GET /compute/v2.1/servers/9b09b542-5b10-4244-88af-cb6de23588d8 => generated 1513 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:36:21.858385 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-fedf009d-a9de-4881-80ed-6cb4a408f979 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:36:21.859030 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-fedf009d-a9de-4881-80ed-6cb4a408f979 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] [instance: 5306cee9-db16-4ba8-99e3-c54f401ab11d] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:36:21.866446 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-fedf009d-a9de-4881-80ed-6cb4a408f979 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:21.866972 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-fedf009d-a9de-4881-80ed-6cb4a408f979 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:21.867854 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-fedf009d-a9de-4881-80ed-6cb4a408f979 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:21.868411 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-fedf009d-a9de-4881-80ed-6cb4a408f979 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:22.021718 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-fedf009d-a9de-4881-80ed-6cb4a408f979 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a025ea88db864b55b7537311d20f4808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b1be624402454ba326a7d7a8754a25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:36:22.030416 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-fedf009d-a9de-4881-80ed-6cb4a408f979 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] 10.222.0.121 "GET /compute/v2.1/servers/5306cee9-db16-4ba8-99e3-c54f401ab11d" status: 200 len: 1508 microversion: 2.1 time: 0.176212 Aug 04 10:36:22.031239 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 239/463] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:36:21 2022] GET /compute/v2.1/servers/5306cee9-db16-4ba8-99e3-c54f401ab11d => generated 1508 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:36:22.228689 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-8ed8fb34-cc0c-4345-88a8-00fca45c485f tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:36:22.229356 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-8ed8fb34-cc0c-4345-88a8-00fca45c485f tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] [instance: 9b09b542-5b10-4244-88af-cb6de23588d8] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:36:22.231301 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG dbcounter [-] [124456] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=124456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:36:22.244119 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-8ed8fb34-cc0c-4345-88a8-00fca45c485f tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:22.244590 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-8ed8fb34-cc0c-4345-88a8-00fca45c485f tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:22.245648 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-8ed8fb34-cc0c-4345-88a8-00fca45c485f tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:22.246105 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-8ed8fb34-cc0c-4345-88a8-00fca45c485f tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:22.452425 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-8ed8fb34-cc0c-4345-88a8-00fca45c485f tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3170dc3323f54512bc8819c8efa86b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7121bd118a2549c39332cfdb7edaa92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:36:22.461958 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-8ed8fb34-cc0c-4345-88a8-00fca45c485f tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] 10.222.0.121 "GET /compute/v2.1/servers/9b09b542-5b10-4244-88af-cb6de23588d8" status: 200 len: 1519 microversion: 2.1 time: 0.238272 Aug 04 10:36:22.462932 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 225/464] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:36:22 2022] GET /compute/v2.1/servers/9b09b542-5b10-4244-88af-cb6de23588d8 => generated 1519 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 10:36:23.053700 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-662f8fe1-1a7d-4b40-bea0-a8f52a7444aa tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:36:23.054357 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-662f8fe1-1a7d-4b40-bea0-a8f52a7444aa tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] [instance: 5306cee9-db16-4ba8-99e3-c54f401ab11d] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:36:23.063101 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-662f8fe1-1a7d-4b40-bea0-a8f52a7444aa tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:23.063686 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-662f8fe1-1a7d-4b40-bea0-a8f52a7444aa tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:23.064538 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-662f8fe1-1a7d-4b40-bea0-a8f52a7444aa tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:23.064984 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-662f8fe1-1a7d-4b40-bea0-a8f52a7444aa tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:23.221145 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-662f8fe1-1a7d-4b40-bea0-a8f52a7444aa tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a025ea88db864b55b7537311d20f4808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b1be624402454ba326a7d7a8754a25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:36:23.230458 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-662f8fe1-1a7d-4b40-bea0-a8f52a7444aa tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] 10.222.0.121 "GET /compute/v2.1/servers/5306cee9-db16-4ba8-99e3-c54f401ab11d" status: 200 len: 1508 microversion: 2.1 time: 0.180973 Aug 04 10:36:23.231070 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 240/465] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:36:23 2022] GET /compute/v2.1/servers/5306cee9-db16-4ba8-99e3-c54f401ab11d => generated 1508 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 10:36:23.306115 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-69c0b842-eb13-4f20-ad0f-3c7e9b1758a3 tempest-VolumesNegativeTest-2091897051 tempest-VolumesNegativeTest-2091897051-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-876687638", "imageRef": "46724bb5-955f-4f3f-bd6a-b561fdde55e3", "flavorRef": "452"}} {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:36:23.374371 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.network.neutron [None req-69c0b842-eb13-4f20-ad0f-3c7e9b1758a3 tempest-VolumesNegativeTest-2091897051 tempest-VolumesNegativeTest-2091897051-project] validate_networks() for None {{(pid=124456) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 10:36:23.824749 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.virt.hardware [None req-69c0b842-eb13-4f20-ad0f-3c7e9b1758a3 tempest-VolumesNegativeTest-2091897051 tempest-VolumesNegativeTest-2091897051-project] Flavor limits 0:0:0 {{(pid=124456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 10:36:23.825188 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.virt.hardware [None req-69c0b842-eb13-4f20-ad0f-3c7e9b1758a3 tempest-VolumesNegativeTest-2091897051 tempest-VolumesNegativeTest-2091897051-project] Image limits 0:0:0 {{(pid=124456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 10:36:23.825833 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.virt.hardware [None req-69c0b842-eb13-4f20-ad0f-3c7e9b1758a3 tempest-VolumesNegativeTest-2091897051 tempest-VolumesNegativeTest-2091897051-project] Flavor pref 0:0:0 {{(pid=124456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 10:36:23.826251 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.virt.hardware [None req-69c0b842-eb13-4f20-ad0f-3c7e9b1758a3 tempest-VolumesNegativeTest-2091897051 tempest-VolumesNegativeTest-2091897051-project] Image pref 0:0:0 {{(pid=124456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 10:36:23.826670 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.virt.hardware [None req-69c0b842-eb13-4f20-ad0f-3c7e9b1758a3 tempest-VolumesNegativeTest-2091897051 tempest-VolumesNegativeTest-2091897051-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 10:36:23.840434 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-69c0b842-eb13-4f20-ad0f-3c7e9b1758a3 tempest-VolumesNegativeTest-2091897051 tempest-VolumesNegativeTest-2091897051-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:23.840914 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-69c0b842-eb13-4f20-ad0f-3c7e9b1758a3 tempest-VolumesNegativeTest-2091897051 tempest-VolumesNegativeTest-2091897051-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:23.841839 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-69c0b842-eb13-4f20-ad0f-3c7e9b1758a3 tempest-VolumesNegativeTest-2091897051 tempest-VolumesNegativeTest-2091897051-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:23.842350 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-69c0b842-eb13-4f20-ad0f-3c7e9b1758a3 tempest-VolumesNegativeTest-2091897051 tempest-VolumesNegativeTest-2091897051-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:23.871426 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.quota [None req-69c0b842-eb13-4f20-ad0f-3c7e9b1758a3 tempest-VolumesNegativeTest-2091897051 tempest-VolumesNegativeTest-2091897051-project] Getting quotas for project 3c41c04883804e9586e241166703c1ce. Resources: {'ram', 'instances', 'cores'} {{(pid=124456) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 10:36:23.880579 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.quota [None req-69c0b842-eb13-4f20-ad0f-3c7e9b1758a3 tempest-VolumesNegativeTest-2091897051 tempest-VolumesNegativeTest-2091897051-project] Getting quotas for user c06eaea526a346b3b86f27eb347b9856 and project 3c41c04883804e9586e241166703c1ce. Resources: {'ram', 'instances', 'cores'} {{(pid=124456) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 10:36:23.901940 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-69c0b842-eb13-4f20-ad0f-3c7e9b1758a3 tempest-VolumesNegativeTest-2091897051 tempest-VolumesNegativeTest-2091897051-project] Going to run 1 instances... {{(pid=124456) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 10:36:23.904946 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-69c0b842-eb13-4f20-ad0f-3c7e9b1758a3 tempest-VolumesNegativeTest-2091897051 tempest-VolumesNegativeTest-2091897051-project] [instance: 76896d81-ca04-4aed-9ca9-7bc874082eaf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='46724bb5-955f-4f3f-bd6a-b561fdde55e3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124456) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 10:36:23.972680 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-69c0b842-eb13-4f20-ad0f-3c7e9b1758a3 tempest-VolumesNegativeTest-2091897051 tempest-VolumesNegativeTest-2091897051-project] 10.222.0.121 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 0.670655 Aug 04 10:36:23.981286 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 226/466] 10.222.0.121 () {60 vars in 1152 bytes} [Thu Aug 4 10:36:23 2022] POST /compute/v2.1/servers => generated 382 bytes in 680 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 04 10:36:23.988331 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-09b2eaee-ee6c-4660-be69-c452c396b74f tempest-VolumesNegativeTest-2091897051 tempest-VolumesNegativeTest-2091897051-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:36:23.989505 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-09b2eaee-ee6c-4660-be69-c452c396b74f tempest-VolumesNegativeTest-2091897051 tempest-VolumesNegativeTest-2091897051-project] [instance: 76896d81-ca04-4aed-9ca9-7bc874082eaf] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:36:24.121753 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-09b2eaee-ee6c-4660-be69-c452c396b74f tempest-VolumesNegativeTest-2091897051 tempest-VolumesNegativeTest-2091897051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06eaea526a346b3b86f27eb347b9856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c41c04883804e9586e241166703c1ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:36:24.136365 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-09b2eaee-ee6c-4660-be69-c452c396b74f tempest-VolumesNegativeTest-2091897051 tempest-VolumesNegativeTest-2091897051-project] 10.222.0.121 "GET /compute/v2.1/servers/76896d81-ca04-4aed-9ca9-7bc874082eaf" status: 200 len: 1218 microversion: 2.1 time: 0.154115 Aug 04 10:36:24.137409 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 241/467] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:36:23 2022] GET /compute/v2.1/servers/76896d81-ca04-4aed-9ca9-7bc874082eaf => generated 1218 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:36:24.203685 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [req-6b995416-2b9b-4006-9373-b7e0f1a8425c req-e8428ce5-945d-484d-9d41-93c3d3a0b573 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5306cee9-db16-4ba8-99e3-c54f401ab11d", "name": "network-vif-deleted", "tag": "b8c453ef-2fc2-41dd-a0d7-1d19ad8ea1d9"}]} {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:36:24.219301 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [req-6b995416-2b9b-4006-9373-b7e0f1a8425c req-e8428ce5-945d-484d-9d41-93c3d3a0b573 service nova] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:24.219754 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [req-6b995416-2b9b-4006-9373-b7e0f1a8425c req-e8428ce5-945d-484d-9d41-93c3d3a0b573 service nova] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:24.239378 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.compute.server_external_events [req-6b995416-2b9b-4006-9373-b7e0f1a8425c req-e8428ce5-945d-484d-9d41-93c3d3a0b573 service nova] Creating event network-vif-deleted:b8c453ef-2fc2-41dd-a0d7-1d19ad8ea1d9 for instance 5306cee9-db16-4ba8-99e3-c54f401ab11d on hv-cinder-85200 Aug 04 10:36:24.250634 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [req-6b995416-2b9b-4006-9373-b7e0f1a8425c req-e8428ce5-945d-484d-9d41-93c3d3a0b573 service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050745 Aug 04 10:36:24.251404 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 227/468] 10.222.0.121 () {64 vars in 1322 bytes} [Thu Aug 4 10:36:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 10:36:24.256317 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-ec40747a-1235-4c28-893c-fa02f894d2ac tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:36:24.257501 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-ec40747a-1235-4c28-893c-fa02f894d2ac tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] [instance: 5306cee9-db16-4ba8-99e3-c54f401ab11d] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:36:24.268868 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-ec40747a-1235-4c28-893c-fa02f894d2ac tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:24.269721 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-ec40747a-1235-4c28-893c-fa02f894d2ac tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:24.271425 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-ec40747a-1235-4c28-893c-fa02f894d2ac tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:24.272531 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-ec40747a-1235-4c28-893c-fa02f894d2ac tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:24.384521 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-ec40747a-1235-4c28-893c-fa02f894d2ac tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a025ea88db864b55b7537311d20f4808', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b1be624402454ba326a7d7a8754a25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:36:24.403440 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-ec40747a-1235-4c28-893c-fa02f894d2ac tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] 10.222.0.121 "GET /compute/v2.1/servers/5306cee9-db16-4ba8-99e3-c54f401ab11d" status: 200 len: 1303 microversion: 2.1 time: 0.154380 Aug 04 10:36:24.404107 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 242/469] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:36:24 2022] GET /compute/v2.1/servers/5306cee9-db16-4ba8-99e3-c54f401ab11d => generated 1303 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:36:25.083795 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-01d1f9e2-b4b1-4a26-a598-58972ef87b46 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Action: 'create', calling method: .version_select at 0x7f67551f95e0>, body: {"keypair": {"name": "tempest-keypair-242295646", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAQTh+ZA10lfJCcmnMTgCmQZq8Bpfdn+xCkK5B8gSpj7CmW+hwYCJQtLf1u1uIAkkhB8g2TPGLdrj4WOLcK8oErxhp6GVv2R8AVh85PjyLrkJcX3mc71IyiOPtBGEHK7ag=="}} {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:36:25.122295 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.quota [None req-01d1f9e2-b4b1-4a26-a598-58972ef87b46 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Getting quotas for project 7121bd118a2549c39332cfdb7edaa92f. Resources: {'key_pairs'} {{(pid=124456) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 10:36:25.130148 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.quota [None req-01d1f9e2-b4b1-4a26-a598-58972ef87b46 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Getting quotas for user 3170dc3323f54512bc8819c8efa86b0f and project 7121bd118a2549c39332cfdb7edaa92f. Resources: {'key_pairs'} {{(pid=124456) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 10:36:25.159542 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-0ae53bcc-d585-4200-b659-c46da65afdc6 tempest-VolumesNegativeTest-2091897051 tempest-VolumesNegativeTest-2091897051-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:36:25.161103 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-0ae53bcc-d585-4200-b659-c46da65afdc6 tempest-VolumesNegativeTest-2091897051 tempest-VolumesNegativeTest-2091897051-project] [instance: 76896d81-ca04-4aed-9ca9-7bc874082eaf] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:36:25.164471 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG dbcounter [-] [124457] Writing DB stats nova_api:SELECT=62 {{(pid=124457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:36:25.171072 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-0ae53bcc-d585-4200-b659-c46da65afdc6 tempest-VolumesNegativeTest-2091897051 tempest-VolumesNegativeTest-2091897051-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:25.171652 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-0ae53bcc-d585-4200-b659-c46da65afdc6 tempest-VolumesNegativeTest-2091897051 tempest-VolumesNegativeTest-2091897051-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:25.172757 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-0ae53bcc-d585-4200-b659-c46da65afdc6 tempest-VolumesNegativeTest-2091897051 tempest-VolumesNegativeTest-2091897051-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:25.173613 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-0ae53bcc-d585-4200-b659-c46da65afdc6 tempest-VolumesNegativeTest-2091897051 tempest-VolumesNegativeTest-2091897051-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:25.174224 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-01d1f9e2-b4b1-4a26-a598-58972ef87b46 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] 10.222.0.121 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.100899 Aug 04 10:36:25.175055 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 228/470] 10.222.0.121 () {60 vars in 1164 bytes} [Thu Aug 4 10:36:25 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:36:25.296952 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-0ae53bcc-d585-4200-b659-c46da65afdc6 tempest-VolumesNegativeTest-2091897051 tempest-VolumesNegativeTest-2091897051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06eaea526a346b3b86f27eb347b9856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c41c04883804e9586e241166703c1ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:36:25.307772 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-0ae53bcc-d585-4200-b659-c46da65afdc6 tempest-VolumesNegativeTest-2091897051 tempest-VolumesNegativeTest-2091897051-project] 10.222.0.121 "GET /compute/v2.1/servers/76896d81-ca04-4aed-9ca9-7bc874082eaf" status: 200 len: 1270 microversion: 2.1 time: 0.153364 Aug 04 10:36:25.308750 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 243/471] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:36:25 2022] GET /compute/v2.1/servers/76896d81-ca04-4aed-9ca9-7bc874082eaf => generated 1270 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 10:36:25.430164 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-4eeb3715-0434-4452-a557-9a7b7ff7f601 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:36:25.431154 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-4eeb3715-0434-4452-a557-9a7b7ff7f601 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] [instance: 5306cee9-db16-4ba8-99e3-c54f401ab11d] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:36:25.438540 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-4eeb3715-0434-4452-a557-9a7b7ff7f601 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:25.439282 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-4eeb3715-0434-4452-a557-9a7b7ff7f601 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:25.439829 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-4eeb3715-0434-4452-a557-9a7b7ff7f601 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:25.440238 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-4eeb3715-0434-4452-a557-9a7b7ff7f601 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:25.468299 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.wsgi [None req-4eeb3715-0434-4452-a557-9a7b7ff7f601 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] HTTP exception thrown: Instance 5306cee9-db16-4ba8-99e3-c54f401ab11d could not be found. Aug 04 10:36:25.470119 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-4eeb3715-0434-4452-a557-9a7b7ff7f601 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Request method failure captured: Aug 04 10:36:25.470119 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: request: GET /compute/v2.1/servers/5306cee9-db16-4ba8-99e3-c54f401ab11d HTTP/1.1 Aug 04 10:36:25.470119 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: Accept: application/json Aug 04 10:36:25.470119 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: Accept-Encoding: identity Aug 04 10:36:25.470119 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: Connection: close Aug 04 10:36:25.470119 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: Content-Length: 0 Aug 04 10:36:25.470119 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: Content-Type: application/json Aug 04 10:36:25.470119 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: Host: 10.222.0.121 Aug 04 10:36:25.470119 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: Openstack-System-Scope: None Aug 04 10:36:25.470119 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: User-Agent: python-urllib3/1.26.11 Aug 04 10:36:25.470119 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Auth-Token: gAAAAABi66DfJ8Zu7pLpiELeTHqKMCMVnubsiJhY3rbjSSIT9jyOBJ-HbfSQyiuThw8B1IUlXZ2X4VRvGXW-m1YuNPlnZMIbWuDPSZ38vBGOeAh2M20rQo3exzIPAuEkNoQD4PVlYHYv9PupPi7S9n3OEdY__-mkJoS0JqLgVnT0cA2uiz0zsHw Aug 04 10:36:25.470119 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Domain-Id: None Aug 04 10:36:25.470119 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Domain-Name: None Aug 04 10:36:25.470119 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Identity-Status: Confirmed Aug 04 10:36:25.470119 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Is-Admin-Project: True Aug 04 10:36:25.470119 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Project-Domain-Id: default Aug 04 10:36:25.470119 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Project-Domain-Name: Default Aug 04 10:36:25.470119 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Project-Id: 99b1be624402454ba326a7d7a8754a25 Aug 04 10:36:25.470119 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Project-Name: tempest-VolumesActionsTest-1450193640 Aug 04 10:36:25.470119 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Role: reader,member Aug 04 10:36:25.470119 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Roles: reader,member Aug 04 10:36:25.472074 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/99b1be624402454ba326a7d7a8754a25"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/99b1be624402454ba326a7d7a8754a25"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.121:8080", "publicURL": "http://10.222.0.121:8080/v1/AUTH_99b1be624402454ba326a7d7a8754a25"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2/99b1be624402454ba326a7d7a8754a25"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:9696/networking"}]}] Aug 04 10:36:25.472074 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Tenant: tempest-VolumesActionsTest-1450193640 Aug 04 10:36:25.472074 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Tenant-Id: 99b1be624402454ba326a7d7a8754a25 Aug 04 10:36:25.472074 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Tenant-Name: tempest-VolumesActionsTest-1450193640 Aug 04 10:36:25.472074 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-User: tempest-VolumesActionsTest-1450193640-project Aug 04 10:36:25.472074 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-User-Domain-Id: default Aug 04 10:36:25.472074 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-User-Domain-Name: Default Aug 04 10:36:25.472074 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-User-Id: a025ea88db864b55b7537311d20f4808 Aug 04 10:36:25.472074 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-User-Name: tempest-VolumesActionsTest-1450193640-project Aug 04 10:36:25.472074 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: method: > Aug 04 10:36:25.472074 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: exception: Instance 5306cee9-db16-4ba8-99e3-c54f401ab11d could not be found. Aug 04 10:36:25.472074 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: action_args: {'id': '5306cee9-db16-4ba8-99e3-c54f401ab11d'} Aug 04 10:36:25.473013 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 10:36:25.473013 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:36:25.473013 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 10:36:25.473013 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 10:36:25.473013 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 10:36:25.473013 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 10:36:25.473013 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 10:36:25.473013 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 10:36:25.473013 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 10:36:25.473013 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 10:36:25.473013 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5306cee9-db16-4ba8-99e3-c54f401ab11d could not be found. Aug 04 10:36:25.473013 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi Aug 04 10:36:25.473013 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:36:25.473013 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi Aug 04 10:36:25.473013 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:36:25.473013 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:36:25.473013 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:36:25.473013 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 10:36:25.473013 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 10:36:25.473013 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 10:36:25.474439 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 10:36:25.474439 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 10:36:25.474439 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 10:36:25.474439 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 10:36:25.474439 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 10:36:25.474439 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 10:36:25.474439 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 10:36:25.474439 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5306cee9-db16-4ba8-99e3-c54f401ab11d could not be found. Aug 04 10:36:25.474439 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi Aug 04 10:36:25.474439 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:36:25.474439 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi Aug 04 10:36:25.474439 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:36:25.474439 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:36:25.474439 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:36:25.474439 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 10:36:25.474439 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 10:36:25.474439 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5306cee9-db16-4ba8-99e3-c54f401ab11d could not be found. Aug 04 10:36:25.474439 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi Aug 04 10:36:25.477497 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-4eeb3715-0434-4452-a557-9a7b7ff7f601 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] Returning 404 to user: Instance 5306cee9-db16-4ba8-99e3-c54f401ab11d could not be found. {{(pid=124456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 10:36:25.477497 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-4eeb3715-0434-4452-a557-9a7b7ff7f601 tempest-VolumesActionsTest-1450193640 tempest-VolumesActionsTest-1450193640-project] 10.222.0.121 "GET /compute/v2.1/servers/5306cee9-db16-4ba8-99e3-c54f401ab11d" status: 404 len: 111 microversion: 2.1 time: 0.045853 Aug 04 10:36:25.477497 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 229/472] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:36:25 2022] GET /compute/v2.1/servers/5306cee9-db16-4ba8-99e3-c54f401ab11d => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 10:36:26.337586 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-a09c8fd0-25ee-49c3-ad07-66df875e9d5e tempest-VolumesNegativeTest-2091897051 tempest-VolumesNegativeTest-2091897051-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:36:26.340552 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-a09c8fd0-25ee-49c3-ad07-66df875e9d5e tempest-VolumesNegativeTest-2091897051 tempest-VolumesNegativeTest-2091897051-project] [instance: 76896d81-ca04-4aed-9ca9-7bc874082eaf] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:36:26.354599 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-a09c8fd0-25ee-49c3-ad07-66df875e9d5e tempest-VolumesNegativeTest-2091897051 tempest-VolumesNegativeTest-2091897051-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:26.361159 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-a09c8fd0-25ee-49c3-ad07-66df875e9d5e tempest-VolumesNegativeTest-2091897051 tempest-VolumesNegativeTest-2091897051-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:26.362848 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-a09c8fd0-25ee-49c3-ad07-66df875e9d5e tempest-VolumesNegativeTest-2091897051 tempest-VolumesNegativeTest-2091897051-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:26.363719 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-a09c8fd0-25ee-49c3-ad07-66df875e9d5e tempest-VolumesNegativeTest-2091897051 tempest-VolumesNegativeTest-2091897051-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:26.518580 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-a09c8fd0-25ee-49c3-ad07-66df875e9d5e tempest-VolumesNegativeTest-2091897051 tempest-VolumesNegativeTest-2091897051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06eaea526a346b3b86f27eb347b9856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c41c04883804e9586e241166703c1ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:36:26.528288 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-a09c8fd0-25ee-49c3-ad07-66df875e9d5e tempest-VolumesNegativeTest-2091897051 tempest-VolumesNegativeTest-2091897051-project] 10.222.0.121 "GET /compute/v2.1/servers/76896d81-ca04-4aed-9ca9-7bc874082eaf" status: 200 len: 1276 microversion: 2.1 time: 0.199083 Aug 04 10:36:26.529639 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 244/473] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:36:26 2022] GET /compute/v2.1/servers/76896d81-ca04-4aed-9ca9-7bc874082eaf => generated 1276 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:36:27.280976 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-981f970b-16a2-4481-8f20-fd0b13602baf tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2066799337", "imageRef": "46724bb5-955f-4f3f-bd6a-b561fdde55e3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9ac3f175-1782-4c6f-8b51-6c5067c45651"}], "security_groups": [{"name": "tempest-securitygroup--1006728414"}], "key_name": "tempest-keypair-242295646", "user_data": "}} {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:36:27.556150 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.network.neutron [None req-981f970b-16a2-4481-8f20-fd0b13602baf tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] validate_networks() for [('9ac3f175-1782-4c6f-8b51-6c5067c45651', None, None, None, None, None)] {{(pid=124456) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 10:36:27.564249 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-8379dba1-cc87-412d-863e-2becfb324482 tempest-VolumesNegativeTest-2091897051 tempest-VolumesNegativeTest-2091897051-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:36:27.567674 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-8379dba1-cc87-412d-863e-2becfb324482 tempest-VolumesNegativeTest-2091897051 tempest-VolumesNegativeTest-2091897051-project] [instance: 76896d81-ca04-4aed-9ca9-7bc874082eaf] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:36:27.577023 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-8379dba1-cc87-412d-863e-2becfb324482 tempest-VolumesNegativeTest-2091897051 tempest-VolumesNegativeTest-2091897051-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:27.577562 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-8379dba1-cc87-412d-863e-2becfb324482 tempest-VolumesNegativeTest-2091897051 tempest-VolumesNegativeTest-2091897051-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:27.578434 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-8379dba1-cc87-412d-863e-2becfb324482 tempest-VolumesNegativeTest-2091897051 tempest-VolumesNegativeTest-2091897051-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:27.579164 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-8379dba1-cc87-412d-863e-2becfb324482 tempest-VolumesNegativeTest-2091897051 tempest-VolumesNegativeTest-2091897051-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:28.172115 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-8379dba1-cc87-412d-863e-2becfb324482 tempest-VolumesNegativeTest-2091897051 tempest-VolumesNegativeTest-2091897051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06eaea526a346b3b86f27eb347b9856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c41c04883804e9586e241166703c1ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:36:28.186425 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-8379dba1-cc87-412d-863e-2becfb324482 tempest-VolumesNegativeTest-2091897051 tempest-VolumesNegativeTest-2091897051-project] 10.222.0.121 "GET /compute/v2.1/servers/76896d81-ca04-4aed-9ca9-7bc874082eaf" status: 200 len: 1318 microversion: 2.1 time: 0.632970 Aug 04 10:36:28.187676 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 245/474] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:36:27 2022] GET /compute/v2.1/servers/76896d81-ca04-4aed-9ca9-7bc874082eaf => generated 1318 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 10:36:28.610352 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [req-cba992e4-5054-47f5-90aa-7beb522bbcf8 req-ef2c1f94-fb33-414e-8c0e-ed3d4c978754 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "76896d81-ca04-4aed-9ca9-7bc874082eaf", "tag": "be43ef9e-0ef9-4408-8516-109d7dc5189b"}]} {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:36:28.625617 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [req-cba992e4-5054-47f5-90aa-7beb522bbcf8 req-ef2c1f94-fb33-414e-8c0e-ed3d4c978754 service nova] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:28.626564 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [req-cba992e4-5054-47f5-90aa-7beb522bbcf8 req-ef2c1f94-fb33-414e-8c0e-ed3d4c978754 service nova] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:28.648436 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.compute.server_external_events [req-cba992e4-5054-47f5-90aa-7beb522bbcf8 req-ef2c1f94-fb33-414e-8c0e-ed3d4c978754 service nova] Creating event network-changed:be43ef9e-0ef9-4408-8516-109d7dc5189b for instance 76896d81-ca04-4aed-9ca9-7bc874082eaf on hv-cinder-85200 Aug 04 10:36:28.658320 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [req-cba992e4-5054-47f5-90aa-7beb522bbcf8 req-ef2c1f94-fb33-414e-8c0e-ed3d4c978754 service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053356 Aug 04 10:36:28.659446 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 246/475] 10.222.0.121 () {64 vars in 1322 bytes} [Thu Aug 4 10:36:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 10:36:28.679192 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.virt.hardware [None req-981f970b-16a2-4481-8f20-fd0b13602baf tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Flavor limits 0:0:0 {{(pid=124456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 10:36:28.681148 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.virt.hardware [None req-981f970b-16a2-4481-8f20-fd0b13602baf tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Image limits 0:0:0 {{(pid=124456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 10:36:28.682608 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.virt.hardware [None req-981f970b-16a2-4481-8f20-fd0b13602baf tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Flavor pref 0:0:0 {{(pid=124456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 10:36:28.683669 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.virt.hardware [None req-981f970b-16a2-4481-8f20-fd0b13602baf tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Image pref 0:0:0 {{(pid=124456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 10:36:28.684367 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.virt.hardware [None req-981f970b-16a2-4481-8f20-fd0b13602baf tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 10:36:28.698179 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-981f970b-16a2-4481-8f20-fd0b13602baf tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:28.698896 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-981f970b-16a2-4481-8f20-fd0b13602baf tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:28.699803 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-981f970b-16a2-4481-8f20-fd0b13602baf tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:28.700343 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-981f970b-16a2-4481-8f20-fd0b13602baf tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:28.721201 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.quota [None req-981f970b-16a2-4481-8f20-fd0b13602baf tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Getting quotas for project 7121bd118a2549c39332cfdb7edaa92f. Resources: {'ram', 'instances', 'cores'} {{(pid=124456) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 10:36:28.726206 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.quota [None req-981f970b-16a2-4481-8f20-fd0b13602baf tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Getting quotas for user 3170dc3323f54512bc8819c8efa86b0f and project 7121bd118a2549c39332cfdb7edaa92f. Resources: {'ram', 'instances', 'cores'} {{(pid=124456) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 10:36:28.753148 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-981f970b-16a2-4481-8f20-fd0b13602baf tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Going to run 1 instances... {{(pid=124456) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 10:36:28.763017 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-981f970b-16a2-4481-8f20-fd0b13602baf tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] [instance: a5fe2c05-1417-4bc2-855e-52c9d7457a49] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='46724bb5-955f-4f3f-bd6a-b561fdde55e3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124456) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 10:36:28.814557 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-981f970b-16a2-4481-8f20-fd0b13602baf tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] 10.222.0.121 "POST /compute/v2.1/servers" status: 202 len: 411 microversion: 2.1 time: 1.538928 Aug 04 10:36:28.821958 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 230/476] 10.222.0.121 () {60 vars in 1152 bytes} [Thu Aug 4 10:36:27 2022] POST /compute/v2.1/servers => generated 411 bytes in 1547 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 04 10:36:28.830111 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-2a66a7ec-f942-492c-9314-04686ea9439e tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:36:28.831142 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-2a66a7ec-f942-492c-9314-04686ea9439e tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] [instance: a5fe2c05-1417-4bc2-855e-52c9d7457a49] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:36:28.909173 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-2a66a7ec-f942-492c-9314-04686ea9439e tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3170dc3323f54512bc8819c8efa86b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7121bd118a2549c39332cfdb7edaa92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:36:28.917887 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-2a66a7ec-f942-492c-9314-04686ea9439e tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] 10.222.0.121 "GET /compute/v2.1/servers/a5fe2c05-1417-4bc2-855e-52c9d7457a49" status: 200 len: 1249 microversion: 2.1 time: 0.094145 Aug 04 10:36:28.918530 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 247/477] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:36:28 2022] GET /compute/v2.1/servers/a5fe2c05-1417-4bc2-855e-52c9d7457a49 => generated 1249 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 10:36:29.230072 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-41aea2ee-5cc9-4bbd-919b-febb533b0e7b tempest-VolumesNegativeTest-2091897051 tempest-VolumesNegativeTest-2091897051-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:36:29.231223 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-41aea2ee-5cc9-4bbd-919b-febb533b0e7b tempest-VolumesNegativeTest-2091897051 tempest-VolumesNegativeTest-2091897051-project] [instance: 76896d81-ca04-4aed-9ca9-7bc874082eaf] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:36:29.242238 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-41aea2ee-5cc9-4bbd-919b-febb533b0e7b tempest-VolumesNegativeTest-2091897051 tempest-VolumesNegativeTest-2091897051-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:29.243259 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-41aea2ee-5cc9-4bbd-919b-febb533b0e7b tempest-VolumesNegativeTest-2091897051 tempest-VolumesNegativeTest-2091897051-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:29.244689 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-41aea2ee-5cc9-4bbd-919b-febb533b0e7b tempest-VolumesNegativeTest-2091897051 tempest-VolumesNegativeTest-2091897051-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:29.245388 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-41aea2ee-5cc9-4bbd-919b-febb533b0e7b tempest-VolumesNegativeTest-2091897051 tempest-VolumesNegativeTest-2091897051-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:29.503865 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-41aea2ee-5cc9-4bbd-919b-febb533b0e7b tempest-VolumesNegativeTest-2091897051 tempest-VolumesNegativeTest-2091897051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06eaea526a346b3b86f27eb347b9856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c41c04883804e9586e241166703c1ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:36:29.514078 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-41aea2ee-5cc9-4bbd-919b-febb533b0e7b tempest-VolumesNegativeTest-2091897051 tempest-VolumesNegativeTest-2091897051-project] 10.222.0.121 "GET /compute/v2.1/servers/76896d81-ca04-4aed-9ca9-7bc874082eaf" status: 200 len: 1318 microversion: 2.1 time: 0.294285 Aug 04 10:36:29.514732 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 231/478] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:36:29 2022] GET /compute/v2.1/servers/76896d81-ca04-4aed-9ca9-7bc874082eaf => generated 1318 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:36:29.941481 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-977a79c5-13b5-463e-959f-321e24b73f2b tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:36:29.943397 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-977a79c5-13b5-463e-959f-321e24b73f2b tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] [instance: a5fe2c05-1417-4bc2-855e-52c9d7457a49] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:36:29.953112 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-977a79c5-13b5-463e-959f-321e24b73f2b tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:29.953578 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-977a79c5-13b5-463e-959f-321e24b73f2b tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:29.954378 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-977a79c5-13b5-463e-959f-321e24b73f2b tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:29.954823 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-977a79c5-13b5-463e-959f-321e24b73f2b tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:30.025434 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-977a79c5-13b5-463e-959f-321e24b73f2b tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3170dc3323f54512bc8819c8efa86b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7121bd118a2549c39332cfdb7edaa92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:36:30.034015 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-977a79c5-13b5-463e-959f-321e24b73f2b tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] 10.222.0.121 "GET /compute/v2.1/servers/a5fe2c05-1417-4bc2-855e-52c9d7457a49" status: 200 len: 1253 microversion: 2.1 time: 0.098603 Aug 04 10:36:30.036103 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 248/479] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:36:29 2022] GET /compute/v2.1/servers/a5fe2c05-1417-4bc2-855e-52c9d7457a49 => generated 1253 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:36:30.537512 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-fb853325-c6ab-4607-ad0f-90ab001bddef tempest-VolumesNegativeTest-2091897051 tempest-VolumesNegativeTest-2091897051-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:36:30.538392 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-fb853325-c6ab-4607-ad0f-90ab001bddef tempest-VolumesNegativeTest-2091897051 tempest-VolumesNegativeTest-2091897051-project] [instance: 76896d81-ca04-4aed-9ca9-7bc874082eaf] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:36:30.545876 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-fb853325-c6ab-4607-ad0f-90ab001bddef tempest-VolumesNegativeTest-2091897051 tempest-VolumesNegativeTest-2091897051-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:30.546335 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-fb853325-c6ab-4607-ad0f-90ab001bddef tempest-VolumesNegativeTest-2091897051 tempest-VolumesNegativeTest-2091897051-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:30.547135 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-fb853325-c6ab-4607-ad0f-90ab001bddef tempest-VolumesNegativeTest-2091897051 tempest-VolumesNegativeTest-2091897051-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:30.547582 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-fb853325-c6ab-4607-ad0f-90ab001bddef tempest-VolumesNegativeTest-2091897051 tempest-VolumesNegativeTest-2091897051-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:30.712439 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-fb853325-c6ab-4607-ad0f-90ab001bddef tempest-VolumesNegativeTest-2091897051 tempest-VolumesNegativeTest-2091897051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06eaea526a346b3b86f27eb347b9856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c41c04883804e9586e241166703c1ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:36:30.720773 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-fb853325-c6ab-4607-ad0f-90ab001bddef tempest-VolumesNegativeTest-2091897051 tempest-VolumesNegativeTest-2091897051-project] 10.222.0.121 "GET /compute/v2.1/servers/76896d81-ca04-4aed-9ca9-7bc874082eaf" status: 200 len: 1318 microversion: 2.1 time: 0.187570 Aug 04 10:36:30.721391 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 232/480] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:36:30 2022] GET /compute/v2.1/servers/76896d81-ca04-4aed-9ca9-7bc874082eaf => generated 1318 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:36:31.056596 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-14b06d6d-55fb-4e32-b56f-45a4430dd92d tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:36:31.057452 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-14b06d6d-55fb-4e32-b56f-45a4430dd92d tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] [instance: a5fe2c05-1417-4bc2-855e-52c9d7457a49] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:36:31.065391 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-14b06d6d-55fb-4e32-b56f-45a4430dd92d tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:31.065919 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-14b06d6d-55fb-4e32-b56f-45a4430dd92d tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:31.066734 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-14b06d6d-55fb-4e32-b56f-45a4430dd92d tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:31.067193 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-14b06d6d-55fb-4e32-b56f-45a4430dd92d tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:31.155711 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-14b06d6d-55fb-4e32-b56f-45a4430dd92d tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3170dc3323f54512bc8819c8efa86b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7121bd118a2549c39332cfdb7edaa92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:36:31.167908 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-14b06d6d-55fb-4e32-b56f-45a4430dd92d tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] 10.222.0.121 "GET /compute/v2.1/servers/a5fe2c05-1417-4bc2-855e-52c9d7457a49" status: 200 len: 1245 microversion: 2.1 time: 0.117009 Aug 04 10:36:31.168548 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 249/481] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:36:31 2022] GET /compute/v2.1/servers/a5fe2c05-1417-4bc2-855e-52c9d7457a49 => generated 1245 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:36:31.745155 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-ed7835bd-b9c1-4f18-bd5d-3130155b435d tempest-VolumesNegativeTest-2091897051 tempest-VolumesNegativeTest-2091897051-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:36:31.746237 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-ed7835bd-b9c1-4f18-bd5d-3130155b435d tempest-VolumesNegativeTest-2091897051 tempest-VolumesNegativeTest-2091897051-project] [instance: 76896d81-ca04-4aed-9ca9-7bc874082eaf] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:36:31.755782 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-ed7835bd-b9c1-4f18-bd5d-3130155b435d tempest-VolumesNegativeTest-2091897051 tempest-VolumesNegativeTest-2091897051-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:31.756317 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-ed7835bd-b9c1-4f18-bd5d-3130155b435d tempest-VolumesNegativeTest-2091897051 tempest-VolumesNegativeTest-2091897051-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:31.757218 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-ed7835bd-b9c1-4f18-bd5d-3130155b435d tempest-VolumesNegativeTest-2091897051 tempest-VolumesNegativeTest-2091897051-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:31.757665 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-ed7835bd-b9c1-4f18-bd5d-3130155b435d tempest-VolumesNegativeTest-2091897051 tempest-VolumesNegativeTest-2091897051-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:32.098028 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-ed7835bd-b9c1-4f18-bd5d-3130155b435d tempest-VolumesNegativeTest-2091897051 tempest-VolumesNegativeTest-2091897051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06eaea526a346b3b86f27eb347b9856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c41c04883804e9586e241166703c1ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:36:32.107883 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-ed7835bd-b9c1-4f18-bd5d-3130155b435d tempest-VolumesNegativeTest-2091897051 tempest-VolumesNegativeTest-2091897051-project] 10.222.0.121 "GET /compute/v2.1/servers/76896d81-ca04-4aed-9ca9-7bc874082eaf" status: 200 len: 1318 microversion: 2.1 time: 0.368777 Aug 04 10:36:32.109050 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 233/482] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:36:31 2022] GET /compute/v2.1/servers/76896d81-ca04-4aed-9ca9-7bc874082eaf => generated 1318 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:36:32.191788 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-06b28e9b-b2c2-451b-8eb8-caf5fb47dce3 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:36:32.193512 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-06b28e9b-b2c2-451b-8eb8-caf5fb47dce3 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] [instance: a5fe2c05-1417-4bc2-855e-52c9d7457a49] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:36:32.203289 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-06b28e9b-b2c2-451b-8eb8-caf5fb47dce3 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:32.203758 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-06b28e9b-b2c2-451b-8eb8-caf5fb47dce3 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:32.204629 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-06b28e9b-b2c2-451b-8eb8-caf5fb47dce3 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:32.205069 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-06b28e9b-b2c2-451b-8eb8-caf5fb47dce3 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:32.320511 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-06b28e9b-b2c2-451b-8eb8-caf5fb47dce3 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3170dc3323f54512bc8819c8efa86b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7121bd118a2549c39332cfdb7edaa92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:36:32.324641 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG dbcounter [-] [124457] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:36:32.330338 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-06b28e9b-b2c2-451b-8eb8-caf5fb47dce3 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] 10.222.0.121 "GET /compute/v2.1/servers/a5fe2c05-1417-4bc2-855e-52c9d7457a49" status: 200 len: 1307 microversion: 2.1 time: 0.144276 Aug 04 10:36:32.331480 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 250/483] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:36:32 2022] GET /compute/v2.1/servers/a5fe2c05-1417-4bc2-855e-52c9d7457a49 => generated 1307 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:36:32.680063 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-3b33d31d-1fb6-459b-b82d-f6697487f5f8 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1066907314", "imageRef": "46724bb5-955f-4f3f-bd6a-b561fdde55e3", "flavorRef": "452", "networks": [{"uuid": "da818991-7f34-479b-940a-a8a044d43867"}]}} {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:36:32.744095 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.network.neutron [None req-3b33d31d-1fb6-459b-b82d-f6697487f5f8 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] validate_networks() for [('da818991-7f34-479b-940a-a8a044d43867', None, None, None, None, None)] {{(pid=124456) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 10:36:33.130708 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-6468e9b4-3bfa-4235-ac74-4e270f99ec83 tempest-VolumesNegativeTest-2091897051 tempest-VolumesNegativeTest-2091897051-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:36:33.131657 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-6468e9b4-3bfa-4235-ac74-4e270f99ec83 tempest-VolumesNegativeTest-2091897051 tempest-VolumesNegativeTest-2091897051-project] [instance: 76896d81-ca04-4aed-9ca9-7bc874082eaf] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:36:33.139110 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-6468e9b4-3bfa-4235-ac74-4e270f99ec83 tempest-VolumesNegativeTest-2091897051 tempest-VolumesNegativeTest-2091897051-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:33.139826 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-6468e9b4-3bfa-4235-ac74-4e270f99ec83 tempest-VolumesNegativeTest-2091897051 tempest-VolumesNegativeTest-2091897051-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:33.140974 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-6468e9b4-3bfa-4235-ac74-4e270f99ec83 tempest-VolumesNegativeTest-2091897051 tempest-VolumesNegativeTest-2091897051-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:33.141416 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-6468e9b4-3bfa-4235-ac74-4e270f99ec83 tempest-VolumesNegativeTest-2091897051 tempest-VolumesNegativeTest-2091897051-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:33.475515 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-6468e9b4-3bfa-4235-ac74-4e270f99ec83 tempest-VolumesNegativeTest-2091897051 tempest-VolumesNegativeTest-2091897051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06eaea526a346b3b86f27eb347b9856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c41c04883804e9586e241166703c1ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:36:33.494014 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-6468e9b4-3bfa-4235-ac74-4e270f99ec83 tempest-VolumesNegativeTest-2091897051 tempest-VolumesNegativeTest-2091897051-project] 10.222.0.121 "GET /compute/v2.1/servers/76896d81-ca04-4aed-9ca9-7bc874082eaf" status: 200 len: 1318 microversion: 2.1 time: 0.367808 Aug 04 10:36:33.500506 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 251/484] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:36:33 2022] GET /compute/v2.1/servers/76896d81-ca04-4aed-9ca9-7bc874082eaf => generated 1318 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 10:36:33.512522 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-58c70f18-b2f0-4c03-8152-d7ec54cacee9 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:36:33.513151 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-58c70f18-b2f0-4c03-8152-d7ec54cacee9 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] [instance: a5fe2c05-1417-4bc2-855e-52c9d7457a49] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:36:33.525891 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-58c70f18-b2f0-4c03-8152-d7ec54cacee9 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:33.526707 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-58c70f18-b2f0-4c03-8152-d7ec54cacee9 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:33.527722 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-58c70f18-b2f0-4c03-8152-d7ec54cacee9 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:33.528384 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-58c70f18-b2f0-4c03-8152-d7ec54cacee9 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:33.533911 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.virt.hardware [None req-3b33d31d-1fb6-459b-b82d-f6697487f5f8 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Flavor limits 0:0:0 {{(pid=124456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 10:36:33.534556 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.virt.hardware [None req-3b33d31d-1fb6-459b-b82d-f6697487f5f8 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Image limits 0:0:0 {{(pid=124456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 10:36:33.535036 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.virt.hardware [None req-3b33d31d-1fb6-459b-b82d-f6697487f5f8 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Flavor pref 0:0:0 {{(pid=124456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 10:36:33.535469 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.virt.hardware [None req-3b33d31d-1fb6-459b-b82d-f6697487f5f8 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Image pref 0:0:0 {{(pid=124456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 10:36:33.535998 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.virt.hardware [None req-3b33d31d-1fb6-459b-b82d-f6697487f5f8 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 10:36:33.552646 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-3b33d31d-1fb6-459b-b82d-f6697487f5f8 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:33.552998 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-3b33d31d-1fb6-459b-b82d-f6697487f5f8 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:33.553811 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-3b33d31d-1fb6-459b-b82d-f6697487f5f8 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:33.554251 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-3b33d31d-1fb6-459b-b82d-f6697487f5f8 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:33.576681 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.quota [None req-3b33d31d-1fb6-459b-b82d-f6697487f5f8 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Getting quotas for project aacec5c4a2584f60af1ca9843e9e8732. Resources: {'ram', 'instances', 'cores'} {{(pid=124456) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 10:36:33.582413 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.quota [None req-3b33d31d-1fb6-459b-b82d-f6697487f5f8 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Getting quotas for user db9e00718840481ca416e25ef436bb24 and project aacec5c4a2584f60af1ca9843e9e8732. Resources: {'ram', 'instances', 'cores'} {{(pid=124456) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 10:36:33.598237 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-3b33d31d-1fb6-459b-b82d-f6697487f5f8 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Going to run 1 instances... {{(pid=124456) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 10:36:33.600687 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-3b33d31d-1fb6-459b-b82d-f6697487f5f8 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] [instance: c0b1b05c-6675-4224-8158-caf89589f2db] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='46724bb5-955f-4f3f-bd6a-b561fdde55e3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124456) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 10:36:33.725488 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-3b33d31d-1fb6-459b-b82d-f6697487f5f8 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] 10.222.0.121 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 1.049415 Aug 04 10:36:33.727466 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 234/485] 10.222.0.121 () {60 vars in 1152 bytes} [Thu Aug 4 10:36:32 2022] POST /compute/v2.1/servers => generated 382 bytes in 1052 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Aug 04 10:36:33.745055 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-e6e60f86-103f-48cb-8c38-7cc999ba3882 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:36:33.746209 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-e6e60f86-103f-48cb-8c38-7cc999ba3882 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] [instance: c0b1b05c-6675-4224-8158-caf89589f2db] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:36:33.789432 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-58c70f18-b2f0-4c03-8152-d7ec54cacee9 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3170dc3323f54512bc8819c8efa86b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7121bd118a2549c39332cfdb7edaa92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:36:33.800650 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-58c70f18-b2f0-4c03-8152-d7ec54cacee9 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] 10.222.0.121 "GET /compute/v2.1/servers/a5fe2c05-1417-4bc2-855e-52c9d7457a49" status: 200 len: 1375 microversion: 2.1 time: 0.298467 Aug 04 10:36:33.801924 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 252/486] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:36:33 2022] GET /compute/v2.1/servers/a5fe2c05-1417-4bc2-855e-52c9d7457a49 => generated 1375 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:36:33.848960 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-e6e60f86-103f-48cb-8c38-7cc999ba3882 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9e00718840481ca416e25ef436bb24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacec5c4a2584f60af1ca9843e9e8732', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:36:33.857454 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-e6e60f86-103f-48cb-8c38-7cc999ba3882 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] 10.222.0.121 "GET /compute/v2.1/servers/c0b1b05c-6675-4224-8158-caf89589f2db" status: 200 len: 1223 microversion: 2.1 time: 0.121245 Aug 04 10:36:33.871588 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 235/487] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:36:33 2022] GET /compute/v2.1/servers/c0b1b05c-6675-4224-8158-caf89589f2db => generated 1223 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:36:34.521367 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-f46dd3a1-ca54-4157-a106-0947b09b714f tempest-VolumesNegativeTest-2091897051 tempest-VolumesNegativeTest-2091897051-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:36:34.523090 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-f46dd3a1-ca54-4157-a106-0947b09b714f tempest-VolumesNegativeTest-2091897051 tempest-VolumesNegativeTest-2091897051-project] [instance: 76896d81-ca04-4aed-9ca9-7bc874082eaf] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:36:34.531356 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-f46dd3a1-ca54-4157-a106-0947b09b714f tempest-VolumesNegativeTest-2091897051 tempest-VolumesNegativeTest-2091897051-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:34.531927 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-f46dd3a1-ca54-4157-a106-0947b09b714f tempest-VolumesNegativeTest-2091897051 tempest-VolumesNegativeTest-2091897051-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:34.532882 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-f46dd3a1-ca54-4157-a106-0947b09b714f tempest-VolumesNegativeTest-2091897051 tempest-VolumesNegativeTest-2091897051-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:34.533450 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-f46dd3a1-ca54-4157-a106-0947b09b714f tempest-VolumesNegativeTest-2091897051 tempest-VolumesNegativeTest-2091897051-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:34.732938 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-f46dd3a1-ca54-4157-a106-0947b09b714f tempest-VolumesNegativeTest-2091897051 tempest-VolumesNegativeTest-2091897051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06eaea526a346b3b86f27eb347b9856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c41c04883804e9586e241166703c1ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:36:34.757518 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-f46dd3a1-ca54-4157-a106-0947b09b714f tempest-VolumesNegativeTest-2091897051 tempest-VolumesNegativeTest-2091897051-project] 10.222.0.121 "GET /compute/v2.1/servers/76896d81-ca04-4aed-9ca9-7bc874082eaf" status: 200 len: 1318 microversion: 2.1 time: 0.239528 Aug 04 10:36:34.772989 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 253/488] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:36:34 2022] GET /compute/v2.1/servers/76896d81-ca04-4aed-9ca9-7bc874082eaf => generated 1318 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:36:34.830618 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-76c68230-eb34-47ff-978d-58862beb9d1c tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:36:34.834692 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-76c68230-eb34-47ff-978d-58862beb9d1c tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] [instance: a5fe2c05-1417-4bc2-855e-52c9d7457a49] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:36:34.841170 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-76c68230-eb34-47ff-978d-58862beb9d1c tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:34.841650 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-76c68230-eb34-47ff-978d-58862beb9d1c tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:34.842785 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-76c68230-eb34-47ff-978d-58862beb9d1c tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:34.843858 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-76c68230-eb34-47ff-978d-58862beb9d1c tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:34.884658 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-d0822f23-1576-4b47-aab8-b9e7745eee69 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:36:34.885962 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-d0822f23-1576-4b47-aab8-b9e7745eee69 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] [instance: c0b1b05c-6675-4224-8158-caf89589f2db] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:36:34.898098 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-d0822f23-1576-4b47-aab8-b9e7745eee69 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:34.898879 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-d0822f23-1576-4b47-aab8-b9e7745eee69 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:34.899984 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-d0822f23-1576-4b47-aab8-b9e7745eee69 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:34.900623 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-d0822f23-1576-4b47-aab8-b9e7745eee69 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:35.038364 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-d0822f23-1576-4b47-aab8-b9e7745eee69 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9e00718840481ca416e25ef436bb24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacec5c4a2584f60af1ca9843e9e8732', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:36:35.068373 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-d0822f23-1576-4b47-aab8-b9e7745eee69 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] 10.222.0.121 "GET /compute/v2.1/servers/c0b1b05c-6675-4224-8158-caf89589f2db" status: 200 len: 1227 microversion: 2.1 time: 0.191621 Aug 04 10:36:35.077450 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 254/489] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:36:34 2022] GET /compute/v2.1/servers/c0b1b05c-6675-4224-8158-caf89589f2db => generated 1227 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 10:36:35.148505 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-76c68230-eb34-47ff-978d-58862beb9d1c tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3170dc3323f54512bc8819c8efa86b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7121bd118a2549c39332cfdb7edaa92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:36:35.163725 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-76c68230-eb34-47ff-978d-58862beb9d1c tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] 10.222.0.121 "GET /compute/v2.1/servers/a5fe2c05-1417-4bc2-855e-52c9d7457a49" status: 200 len: 1375 microversion: 2.1 time: 0.338086 Aug 04 10:36:35.188635 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 236/490] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:36:34 2022] GET /compute/v2.1/servers/a5fe2c05-1417-4bc2-855e-52c9d7457a49 => generated 1375 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:36:35.790303 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-d8f6fc87-3128-4602-b696-b17057a040d1 tempest-VolumesNegativeTest-2091897051 tempest-VolumesNegativeTest-2091897051-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:36:35.800278 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-d8f6fc87-3128-4602-b696-b17057a040d1 tempest-VolumesNegativeTest-2091897051 tempest-VolumesNegativeTest-2091897051-project] [instance: 76896d81-ca04-4aed-9ca9-7bc874082eaf] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:36:35.812735 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-d8f6fc87-3128-4602-b696-b17057a040d1 tempest-VolumesNegativeTest-2091897051 tempest-VolumesNegativeTest-2091897051-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:35.814160 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-d8f6fc87-3128-4602-b696-b17057a040d1 tempest-VolumesNegativeTest-2091897051 tempest-VolumesNegativeTest-2091897051-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:35.816117 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-d8f6fc87-3128-4602-b696-b17057a040d1 tempest-VolumesNegativeTest-2091897051 tempest-VolumesNegativeTest-2091897051-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:35.817043 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-d8f6fc87-3128-4602-b696-b17057a040d1 tempest-VolumesNegativeTest-2091897051 tempest-VolumesNegativeTest-2091897051-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:36.018292 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-d8f6fc87-3128-4602-b696-b17057a040d1 tempest-VolumesNegativeTest-2091897051 tempest-VolumesNegativeTest-2091897051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06eaea526a346b3b86f27eb347b9856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c41c04883804e9586e241166703c1ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:36:36.032354 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-d8f6fc87-3128-4602-b696-b17057a040d1 tempest-VolumesNegativeTest-2091897051 tempest-VolumesNegativeTest-2091897051-project] 10.222.0.121 "GET /compute/v2.1/servers/76896d81-ca04-4aed-9ca9-7bc874082eaf" status: 200 len: 1318 microversion: 2.1 time: 0.250520 Aug 04 10:36:36.033290 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 255/491] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:36:35 2022] GET /compute/v2.1/servers/76896d81-ca04-4aed-9ca9-7bc874082eaf => generated 1318 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:36:36.103360 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-3272f396-4131-4392-a753-e3f924b3e53b tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:36:36.104331 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-3272f396-4131-4392-a753-e3f924b3e53b tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] [instance: c0b1b05c-6675-4224-8158-caf89589f2db] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:36:36.114469 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-3272f396-4131-4392-a753-e3f924b3e53b tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:36.114936 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-3272f396-4131-4392-a753-e3f924b3e53b tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:36.116019 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-3272f396-4131-4392-a753-e3f924b3e53b tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:36.116690 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-3272f396-4131-4392-a753-e3f924b3e53b tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:36.205739 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-b3699950-d3ca-4c60-802f-1260180f090c tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:36:36.206369 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-b3699950-d3ca-4c60-802f-1260180f090c tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] [instance: a5fe2c05-1417-4bc2-855e-52c9d7457a49] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:36:36.229028 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-b3699950-d3ca-4c60-802f-1260180f090c tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:36.230158 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-b3699950-d3ca-4c60-802f-1260180f090c tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:36.231117 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-b3699950-d3ca-4c60-802f-1260180f090c tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:36.231799 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-b3699950-d3ca-4c60-802f-1260180f090c tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:36.594612 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-3272f396-4131-4392-a753-e3f924b3e53b tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9e00718840481ca416e25ef436bb24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacec5c4a2584f60af1ca9843e9e8732', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:36:36.617856 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-3272f396-4131-4392-a753-e3f924b3e53b tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] 10.222.0.121 "GET /compute/v2.1/servers/c0b1b05c-6675-4224-8158-caf89589f2db" status: 200 len: 1227 microversion: 2.1 time: 0.520834 Aug 04 10:36:36.641494 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 237/492] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:36:36 2022] GET /compute/v2.1/servers/c0b1b05c-6675-4224-8158-caf89589f2db => generated 1227 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:36:36.873126 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-b3699950-d3ca-4c60-802f-1260180f090c tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3170dc3323f54512bc8819c8efa86b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7121bd118a2549c39332cfdb7edaa92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:36:36.890604 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-b3699950-d3ca-4c60-802f-1260180f090c tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] 10.222.0.121 "GET /compute/v2.1/servers/a5fe2c05-1417-4bc2-855e-52c9d7457a49" status: 200 len: 1375 microversion: 2.1 time: 0.690881 Aug 04 10:36:36.892670 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 256/493] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:36:36 2022] GET /compute/v2.1/servers/a5fe2c05-1417-4bc2-855e-52c9d7457a49 => generated 1375 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 10:36:37.061264 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-b9d0fac1-a182-4dca-bac4-436b43deb6c8 tempest-VolumesNegativeTest-2091897051 tempest-VolumesNegativeTest-2091897051-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:36:37.062372 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-b9d0fac1-a182-4dca-bac4-436b43deb6c8 tempest-VolumesNegativeTest-2091897051 tempest-VolumesNegativeTest-2091897051-project] [instance: 76896d81-ca04-4aed-9ca9-7bc874082eaf] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:36:37.070043 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-b9d0fac1-a182-4dca-bac4-436b43deb6c8 tempest-VolumesNegativeTest-2091897051 tempest-VolumesNegativeTest-2091897051-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:37.070884 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-b9d0fac1-a182-4dca-bac4-436b43deb6c8 tempest-VolumesNegativeTest-2091897051 tempest-VolumesNegativeTest-2091897051-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:37.071890 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-b9d0fac1-a182-4dca-bac4-436b43deb6c8 tempest-VolumesNegativeTest-2091897051 tempest-VolumesNegativeTest-2091897051-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:37.072369 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-b9d0fac1-a182-4dca-bac4-436b43deb6c8 tempest-VolumesNegativeTest-2091897051 tempest-VolumesNegativeTest-2091897051-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:37.442493 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-b9d0fac1-a182-4dca-bac4-436b43deb6c8 tempest-VolumesNegativeTest-2091897051 tempest-VolumesNegativeTest-2091897051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06eaea526a346b3b86f27eb347b9856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c41c04883804e9586e241166703c1ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:36:37.469646 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-b9d0fac1-a182-4dca-bac4-436b43deb6c8 tempest-VolumesNegativeTest-2091897051 tempest-VolumesNegativeTest-2091897051-project] 10.222.0.121 "GET /compute/v2.1/servers/76896d81-ca04-4aed-9ca9-7bc874082eaf" status: 200 len: 1318 microversion: 2.1 time: 0.415343 Aug 04 10:36:37.470639 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 238/494] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:36:37 2022] GET /compute/v2.1/servers/76896d81-ca04-4aed-9ca9-7bc874082eaf => generated 1318 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:36:37.646939 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-d2175c87-98f7-468c-9e88-9d72093f77cc tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:36:37.647734 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-d2175c87-98f7-468c-9e88-9d72093f77cc tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] [instance: c0b1b05c-6675-4224-8158-caf89589f2db] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:36:37.672901 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-d2175c87-98f7-468c-9e88-9d72093f77cc tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:37.673807 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-d2175c87-98f7-468c-9e88-9d72093f77cc tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:37.675747 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-d2175c87-98f7-468c-9e88-9d72093f77cc tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:37.677671 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-d2175c87-98f7-468c-9e88-9d72093f77cc tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:37.821619 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-d2175c87-98f7-468c-9e88-9d72093f77cc tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9e00718840481ca416e25ef436bb24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacec5c4a2584f60af1ca9843e9e8732', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:36:37.834459 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-d2175c87-98f7-468c-9e88-9d72093f77cc tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] 10.222.0.121 "GET /compute/v2.1/servers/c0b1b05c-6675-4224-8158-caf89589f2db" status: 200 len: 1281 microversion: 2.1 time: 0.193671 Aug 04 10:36:37.835430 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 257/495] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:36:37 2022] GET /compute/v2.1/servers/c0b1b05c-6675-4224-8158-caf89589f2db => generated 1281 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:36:37.924174 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-2daa0543-81b0-4222-a8ab-b9eb0048f763 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:36:37.925302 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-2daa0543-81b0-4222-a8ab-b9eb0048f763 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] [instance: a5fe2c05-1417-4bc2-855e-52c9d7457a49] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:36:37.937685 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-2daa0543-81b0-4222-a8ab-b9eb0048f763 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:37.938726 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-2daa0543-81b0-4222-a8ab-b9eb0048f763 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:37.939863 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-2daa0543-81b0-4222-a8ab-b9eb0048f763 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:37.940549 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-2daa0543-81b0-4222-a8ab-b9eb0048f763 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:37.979476 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [req-5d46c3cc-58fa-408e-b54c-25e60c241ce6 req-db7b28c5-6af2-490f-b82d-c2b4b6856a40 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a5fe2c05-1417-4bc2-855e-52c9d7457a49", "tag": "145415de-6cf5-4375-a71d-43735b21c5b4"}]} {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:36:38.002617 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [req-5d46c3cc-58fa-408e-b54c-25e60c241ce6 req-db7b28c5-6af2-490f-b82d-c2b4b6856a40 service nova] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:38.003148 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [req-5d46c3cc-58fa-408e-b54c-25e60c241ce6 req-db7b28c5-6af2-490f-b82d-c2b4b6856a40 service nova] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:38.031997 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.compute.server_external_events [req-5d46c3cc-58fa-408e-b54c-25e60c241ce6 req-db7b28c5-6af2-490f-b82d-c2b4b6856a40 service nova] Creating event network-changed:145415de-6cf5-4375-a71d-43735b21c5b4 for instance a5fe2c05-1417-4bc2-855e-52c9d7457a49 on hv-cinder-85200 Aug 04 10:36:38.040490 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [req-5d46c3cc-58fa-408e-b54c-25e60c241ce6 req-db7b28c5-6af2-490f-b82d-c2b4b6856a40 service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065095 Aug 04 10:36:38.041476 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 258/496] 10.222.0.121 () {64 vars in 1322 bytes} [Thu Aug 4 10:36:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:36:38.375724 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-2daa0543-81b0-4222-a8ab-b9eb0048f763 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3170dc3323f54512bc8819c8efa86b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7121bd118a2549c39332cfdb7edaa92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:36:38.385097 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-2daa0543-81b0-4222-a8ab-b9eb0048f763 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] 10.222.0.121 "GET /compute/v2.1/servers/a5fe2c05-1417-4bc2-855e-52c9d7457a49" status: 200 len: 1375 microversion: 2.1 time: 0.466548 Aug 04 10:36:38.398391 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 239/497] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:36:37 2022] GET /compute/v2.1/servers/a5fe2c05-1417-4bc2-855e-52c9d7457a49 => generated 1375 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:36:38.498199 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-dfb3cb45-fe89-4f43-99f0-3be2e1cec638 tempest-VolumesNegativeTest-2091897051 tempest-VolumesNegativeTest-2091897051-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:36:38.500697 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-dfb3cb45-fe89-4f43-99f0-3be2e1cec638 tempest-VolumesNegativeTest-2091897051 tempest-VolumesNegativeTest-2091897051-project] [instance: 76896d81-ca04-4aed-9ca9-7bc874082eaf] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:36:38.514077 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-dfb3cb45-fe89-4f43-99f0-3be2e1cec638 tempest-VolumesNegativeTest-2091897051 tempest-VolumesNegativeTest-2091897051-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:38.515525 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-dfb3cb45-fe89-4f43-99f0-3be2e1cec638 tempest-VolumesNegativeTest-2091897051 tempest-VolumesNegativeTest-2091897051-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:38.516632 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-dfb3cb45-fe89-4f43-99f0-3be2e1cec638 tempest-VolumesNegativeTest-2091897051 tempest-VolumesNegativeTest-2091897051-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:38.517384 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-dfb3cb45-fe89-4f43-99f0-3be2e1cec638 tempest-VolumesNegativeTest-2091897051 tempest-VolumesNegativeTest-2091897051-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:38.859571 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-8958514f-ad27-4d7a-9494-258789469da6 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:36:38.861367 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-8958514f-ad27-4d7a-9494-258789469da6 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] [instance: c0b1b05c-6675-4224-8158-caf89589f2db] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:36:38.882424 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-8958514f-ad27-4d7a-9494-258789469da6 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:38.883394 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-8958514f-ad27-4d7a-9494-258789469da6 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:38.884467 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-8958514f-ad27-4d7a-9494-258789469da6 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:38.885046 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-8958514f-ad27-4d7a-9494-258789469da6 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:38.919727 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG dbcounter [-] [124457] Writing DB stats nova_cell0:SELECT=4 {{(pid=124457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:36:39.194221 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-8958514f-ad27-4d7a-9494-258789469da6 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9e00718840481ca416e25ef436bb24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacec5c4a2584f60af1ca9843e9e8732', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:36:39.203259 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-dfb3cb45-fe89-4f43-99f0-3be2e1cec638 tempest-VolumesNegativeTest-2091897051 tempest-VolumesNegativeTest-2091897051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06eaea526a346b3b86f27eb347b9856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c41c04883804e9586e241166703c1ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:36:39.211270 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-8958514f-ad27-4d7a-9494-258789469da6 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] 10.222.0.121 "GET /compute/v2.1/servers/c0b1b05c-6675-4224-8158-caf89589f2db" status: 200 len: 1281 microversion: 2.1 time: 0.356645 Aug 04 10:36:39.218983 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 240/498] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:36:38 2022] GET /compute/v2.1/servers/c0b1b05c-6675-4224-8158-caf89589f2db => generated 1281 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 10:36:39.223288 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-dfb3cb45-fe89-4f43-99f0-3be2e1cec638 tempest-VolumesNegativeTest-2091897051 tempest-VolumesNegativeTest-2091897051-project] 10.222.0.121 "GET /compute/v2.1/servers/76896d81-ca04-4aed-9ca9-7bc874082eaf" status: 200 len: 1318 microversion: 2.1 time: 0.726390 Aug 04 10:36:39.238271 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 259/499] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:36:38 2022] GET /compute/v2.1/servers/76896d81-ca04-4aed-9ca9-7bc874082eaf => generated 1318 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:36:39.406125 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-46293e48-1a91-484b-9e5b-6ae12ee814a4 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:36:39.407420 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-46293e48-1a91-484b-9e5b-6ae12ee814a4 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] [instance: a5fe2c05-1417-4bc2-855e-52c9d7457a49] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:36:39.418598 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-46293e48-1a91-484b-9e5b-6ae12ee814a4 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:39.419907 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-46293e48-1a91-484b-9e5b-6ae12ee814a4 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:39.421098 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-46293e48-1a91-484b-9e5b-6ae12ee814a4 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:39.421786 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-46293e48-1a91-484b-9e5b-6ae12ee814a4 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:39.640554 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-46293e48-1a91-484b-9e5b-6ae12ee814a4 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3170dc3323f54512bc8819c8efa86b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7121bd118a2549c39332cfdb7edaa92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:36:39.649750 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-46293e48-1a91-484b-9e5b-6ae12ee814a4 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] 10.222.0.121 "GET /compute/v2.1/servers/a5fe2c05-1417-4bc2-855e-52c9d7457a49" status: 200 len: 1375 microversion: 2.1 time: 0.247677 Aug 04 10:36:39.651121 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 241/500] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:36:39 2022] GET /compute/v2.1/servers/a5fe2c05-1417-4bc2-855e-52c9d7457a49 => generated 1375 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 10:36:40.247616 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-256f1bc9-b5e9-4830-87b9-468312336a81 tempest-VolumesNegativeTest-2091897051 tempest-VolumesNegativeTest-2091897051-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:36:40.250398 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-20dcb976-d611-4a32-bf67-264eb5db15ab tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:36:40.251721 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-256f1bc9-b5e9-4830-87b9-468312336a81 tempest-VolumesNegativeTest-2091897051 tempest-VolumesNegativeTest-2091897051-project] [instance: 76896d81-ca04-4aed-9ca9-7bc874082eaf] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:36:40.252748 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-20dcb976-d611-4a32-bf67-264eb5db15ab tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] [instance: c0b1b05c-6675-4224-8158-caf89589f2db] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:36:40.266551 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-20dcb976-d611-4a32-bf67-264eb5db15ab tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:40.267711 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-20dcb976-d611-4a32-bf67-264eb5db15ab tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:40.268304 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-256f1bc9-b5e9-4830-87b9-468312336a81 tempest-VolumesNegativeTest-2091897051 tempest-VolumesNegativeTest-2091897051-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:40.269085 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-20dcb976-d611-4a32-bf67-264eb5db15ab tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:40.269741 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-20dcb976-d611-4a32-bf67-264eb5db15ab tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:40.271714 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-256f1bc9-b5e9-4830-87b9-468312336a81 tempest-VolumesNegativeTest-2091897051 tempest-VolumesNegativeTest-2091897051-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:40.276593 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-256f1bc9-b5e9-4830-87b9-468312336a81 tempest-VolumesNegativeTest-2091897051 tempest-VolumesNegativeTest-2091897051-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:40.277016 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-256f1bc9-b5e9-4830-87b9-468312336a81 tempest-VolumesNegativeTest-2091897051 tempest-VolumesNegativeTest-2091897051-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:40.647433 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-20dcb976-d611-4a32-bf67-264eb5db15ab tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9e00718840481ca416e25ef436bb24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacec5c4a2584f60af1ca9843e9e8732', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:36:40.660678 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-20dcb976-d611-4a32-bf67-264eb5db15ab tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] 10.222.0.121 "GET /compute/v2.1/servers/c0b1b05c-6675-4224-8158-caf89589f2db" status: 200 len: 1323 microversion: 2.1 time: 0.420581 Aug 04 10:36:40.686601 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-256f1bc9-b5e9-4830-87b9-468312336a81 tempest-VolumesNegativeTest-2091897051 tempest-VolumesNegativeTest-2091897051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06eaea526a346b3b86f27eb347b9856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c41c04883804e9586e241166703c1ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:36:40.691005 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 260/501] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:36:40 2022] GET /compute/v2.1/servers/c0b1b05c-6675-4224-8158-caf89589f2db => generated 1323 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:36:40.696818 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-7a6c81f4-3537-4b78-b440-03af1c0dea6a tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:36:40.697499 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-7a6c81f4-3537-4b78-b440-03af1c0dea6a tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] [instance: a5fe2c05-1417-4bc2-855e-52c9d7457a49] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:36:40.705820 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-256f1bc9-b5e9-4830-87b9-468312336a81 tempest-VolumesNegativeTest-2091897051 tempest-VolumesNegativeTest-2091897051-project] 10.222.0.121 "GET /compute/v2.1/servers/76896d81-ca04-4aed-9ca9-7bc874082eaf" status: 200 len: 1318 microversion: 2.1 time: 0.461975 Aug 04 10:36:40.707715 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 242/502] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:36:40 2022] GET /compute/v2.1/servers/76896d81-ca04-4aed-9ca9-7bc874082eaf => generated 1318 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:36:40.719228 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-7a6c81f4-3537-4b78-b440-03af1c0dea6a tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:40.720483 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-7a6c81f4-3537-4b78-b440-03af1c0dea6a tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:40.722286 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-7a6c81f4-3537-4b78-b440-03af1c0dea6a tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:40.723257 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-7a6c81f4-3537-4b78-b440-03af1c0dea6a tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:40.985892 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-7a6c81f4-3537-4b78-b440-03af1c0dea6a tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3170dc3323f54512bc8819c8efa86b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7121bd118a2549c39332cfdb7edaa92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:36:41.003858 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-7a6c81f4-3537-4b78-b440-03af1c0dea6a tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] 10.222.0.121 "GET /compute/v2.1/servers/a5fe2c05-1417-4bc2-855e-52c9d7457a49" status: 200 len: 1375 microversion: 2.1 time: 0.310930 Aug 04 10:36:41.005060 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 261/503] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:36:40 2022] GET /compute/v2.1/servers/a5fe2c05-1417-4bc2-855e-52c9d7457a49 => generated 1375 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:36:41.363073 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [req-004cbfaf-67ca-4cba-af8b-452a4c7c39f1 req-83bf2239-75ce-43b1-9f44-23fb50b18153 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76896d81-ca04-4aed-9ca9-7bc874082eaf", "name": "network-vif-plugged", "status": "completed", "tag": "be43ef9e-0ef9-4408-8516-109d7dc5189b"}]} {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:36:41.393189 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [req-004cbfaf-67ca-4cba-af8b-452a4c7c39f1 req-83bf2239-75ce-43b1-9f44-23fb50b18153 service nova] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:41.393998 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [req-004cbfaf-67ca-4cba-af8b-452a4c7c39f1 req-83bf2239-75ce-43b1-9f44-23fb50b18153 service nova] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:41.415874 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.compute.server_external_events [req-004cbfaf-67ca-4cba-af8b-452a4c7c39f1 req-83bf2239-75ce-43b1-9f44-23fb50b18153 service nova] Creating event network-vif-plugged:be43ef9e-0ef9-4408-8516-109d7dc5189b for instance 76896d81-ca04-4aed-9ca9-7bc874082eaf on hv-cinder-85200 Aug 04 10:36:41.429691 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [req-004cbfaf-67ca-4cba-af8b-452a4c7c39f1 req-83bf2239-75ce-43b1-9f44-23fb50b18153 service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071615 Aug 04 10:36:41.431786 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 243/504] 10.222.0.121 () {64 vars in 1322 bytes} [Thu Aug 4 10:36:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:36:41.695724 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-166d2a59-7825-4335-9db4-3f504ab69a5b tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:36:41.696711 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-166d2a59-7825-4335-9db4-3f504ab69a5b tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] [instance: c0b1b05c-6675-4224-8158-caf89589f2db] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:36:41.710307 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-166d2a59-7825-4335-9db4-3f504ab69a5b tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:41.711090 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-166d2a59-7825-4335-9db4-3f504ab69a5b tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:41.712642 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-166d2a59-7825-4335-9db4-3f504ab69a5b tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:41.713756 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-166d2a59-7825-4335-9db4-3f504ab69a5b tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:41.757193 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-a0c66f9f-7937-4b66-b45b-4e46461524d0 tempest-VolumesNegativeTest-2091897051 tempest-VolumesNegativeTest-2091897051-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:36:41.758908 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-a0c66f9f-7937-4b66-b45b-4e46461524d0 tempest-VolumesNegativeTest-2091897051 tempest-VolumesNegativeTest-2091897051-project] [instance: 76896d81-ca04-4aed-9ca9-7bc874082eaf] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:36:41.772378 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-a0c66f9f-7937-4b66-b45b-4e46461524d0 tempest-VolumesNegativeTest-2091897051 tempest-VolumesNegativeTest-2091897051-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:41.773312 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-a0c66f9f-7937-4b66-b45b-4e46461524d0 tempest-VolumesNegativeTest-2091897051 tempest-VolumesNegativeTest-2091897051-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:41.774885 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-a0c66f9f-7937-4b66-b45b-4e46461524d0 tempest-VolumesNegativeTest-2091897051 tempest-VolumesNegativeTest-2091897051-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:41.775572 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-a0c66f9f-7937-4b66-b45b-4e46461524d0 tempest-VolumesNegativeTest-2091897051 tempest-VolumesNegativeTest-2091897051-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:42.028490 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-166d2a59-7825-4335-9db4-3f504ab69a5b tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9e00718840481ca416e25ef436bb24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacec5c4a2584f60af1ca9843e9e8732', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:36:42.031236 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-a0c66f9f-7937-4b66-b45b-4e46461524d0 tempest-VolumesNegativeTest-2091897051 tempest-VolumesNegativeTest-2091897051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06eaea526a346b3b86f27eb347b9856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c41c04883804e9586e241166703c1ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:36:42.041901 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-a0c66f9f-7937-4b66-b45b-4e46461524d0 tempest-VolumesNegativeTest-2091897051 tempest-VolumesNegativeTest-2091897051-project] 10.222.0.121 "GET /compute/v2.1/servers/76896d81-ca04-4aed-9ca9-7bc874082eaf" status: 200 len: 1318 microversion: 2.1 time: 0.292415 Aug 04 10:36:42.043799 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 244/505] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:36:41 2022] GET /compute/v2.1/servers/76896d81-ca04-4aed-9ca9-7bc874082eaf => generated 1318 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:36:42.049047 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-09b81a4c-ac68-464b-81ae-32def9818cf4 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:36:42.050469 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-09b81a4c-ac68-464b-81ae-32def9818cf4 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] [instance: a5fe2c05-1417-4bc2-855e-52c9d7457a49] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:36:42.062666 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-166d2a59-7825-4335-9db4-3f504ab69a5b tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] 10.222.0.121 "GET /compute/v2.1/servers/c0b1b05c-6675-4224-8158-caf89589f2db" status: 200 len: 1323 microversion: 2.1 time: 0.372629 Aug 04 10:36:42.079607 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-09b81a4c-ac68-464b-81ae-32def9818cf4 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:42.080532 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-09b81a4c-ac68-464b-81ae-32def9818cf4 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:42.081763 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-09b81a4c-ac68-464b-81ae-32def9818cf4 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:42.082306 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-09b81a4c-ac68-464b-81ae-32def9818cf4 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:42.085822 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 262/506] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:36:41 2022] GET /compute/v2.1/servers/c0b1b05c-6675-4224-8158-caf89589f2db => generated 1323 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 10:36:42.287719 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-09b81a4c-ac68-464b-81ae-32def9818cf4 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3170dc3323f54512bc8819c8efa86b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7121bd118a2549c39332cfdb7edaa92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:36:42.296456 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-09b81a4c-ac68-464b-81ae-32def9818cf4 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] 10.222.0.121 "GET /compute/v2.1/servers/a5fe2c05-1417-4bc2-855e-52c9d7457a49" status: 200 len: 1375 microversion: 2.1 time: 0.251129 Aug 04 10:36:42.297230 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 245/507] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:36:42 2022] GET /compute/v2.1/servers/a5fe2c05-1417-4bc2-855e-52c9d7457a49 => generated 1375 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:36:43.074700 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-1322b278-7622-4c95-b181-93d1797cbbeb tempest-VolumesNegativeTest-2091897051 tempest-VolumesNegativeTest-2091897051-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:36:43.076097 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-1322b278-7622-4c95-b181-93d1797cbbeb tempest-VolumesNegativeTest-2091897051 tempest-VolumesNegativeTest-2091897051-project] [instance: 76896d81-ca04-4aed-9ca9-7bc874082eaf] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:36:43.089822 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-1322b278-7622-4c95-b181-93d1797cbbeb tempest-VolumesNegativeTest-2091897051 tempest-VolumesNegativeTest-2091897051-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:43.089822 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-1322b278-7622-4c95-b181-93d1797cbbeb tempest-VolumesNegativeTest-2091897051 tempest-VolumesNegativeTest-2091897051-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:43.092052 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-1322b278-7622-4c95-b181-93d1797cbbeb tempest-VolumesNegativeTest-2091897051 tempest-VolumesNegativeTest-2091897051-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:43.095252 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-1322b278-7622-4c95-b181-93d1797cbbeb tempest-VolumesNegativeTest-2091897051 tempest-VolumesNegativeTest-2091897051-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:43.098502 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-318aadab-0ac5-4514-987f-ae6afa93c580 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:36:43.100447 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-318aadab-0ac5-4514-987f-ae6afa93c580 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] [instance: c0b1b05c-6675-4224-8158-caf89589f2db] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:36:43.109628 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-318aadab-0ac5-4514-987f-ae6afa93c580 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:43.110506 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-318aadab-0ac5-4514-987f-ae6afa93c580 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:43.111542 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-318aadab-0ac5-4514-987f-ae6afa93c580 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:43.112702 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-318aadab-0ac5-4514-987f-ae6afa93c580 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:43.565188 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG dbcounter [-] [124456] Writing DB stats nova_cell0:SELECT=6 {{(pid=124456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:36:43.854398 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG dbcounter [-] [124456] Writing DB stats nova_cell0:SELECT=24 {{(pid=124456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:36:44.040271 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-1322b278-7622-4c95-b181-93d1797cbbeb tempest-VolumesNegativeTest-2091897051 tempest-VolumesNegativeTest-2091897051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06eaea526a346b3b86f27eb347b9856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c41c04883804e9586e241166703c1ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:36:44.050508 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-1322b278-7622-4c95-b181-93d1797cbbeb tempest-VolumesNegativeTest-2091897051 tempest-VolumesNegativeTest-2091897051-project] 10.222.0.121 "GET /compute/v2.1/servers/76896d81-ca04-4aed-9ca9-7bc874082eaf" status: 200 len: 1318 microversion: 2.1 time: 0.988671 Aug 04 10:36:44.051901 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 263/508] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:36:43 2022] GET /compute/v2.1/servers/76896d81-ca04-4aed-9ca9-7bc874082eaf => generated 1318 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:36:44.057742 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-a9192f01-74ed-43c0-a4d1-41259eaf68e8 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:36:44.058513 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-a9192f01-74ed-43c0-a4d1-41259eaf68e8 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] [instance: a5fe2c05-1417-4bc2-855e-52c9d7457a49] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:36:44.066486 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-a9192f01-74ed-43c0-a4d1-41259eaf68e8 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:44.067538 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-a9192f01-74ed-43c0-a4d1-41259eaf68e8 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:44.069372 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-a9192f01-74ed-43c0-a4d1-41259eaf68e8 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:44.070479 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-a9192f01-74ed-43c0-a4d1-41259eaf68e8 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:44.220620 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-318aadab-0ac5-4514-987f-ae6afa93c580 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9e00718840481ca416e25ef436bb24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacec5c4a2584f60af1ca9843e9e8732', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:36:44.238559 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-318aadab-0ac5-4514-987f-ae6afa93c580 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] 10.222.0.121 "GET /compute/v2.1/servers/c0b1b05c-6675-4224-8158-caf89589f2db" status: 200 len: 1323 microversion: 2.1 time: 1.154911 Aug 04 10:36:44.240181 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 246/509] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:36:43 2022] GET /compute/v2.1/servers/c0b1b05c-6675-4224-8158-caf89589f2db => generated 1323 bytes in 1157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 10:36:44.523626 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-a9192f01-74ed-43c0-a4d1-41259eaf68e8 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3170dc3323f54512bc8819c8efa86b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7121bd118a2549c39332cfdb7edaa92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:36:44.533914 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-a9192f01-74ed-43c0-a4d1-41259eaf68e8 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] 10.222.0.121 "GET /compute/v2.1/servers/a5fe2c05-1417-4bc2-855e-52c9d7457a49" status: 200 len: 1375 microversion: 2.1 time: 0.480445 Aug 04 10:36:44.535111 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 264/510] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:36:44 2022] GET /compute/v2.1/servers/a5fe2c05-1417-4bc2-855e-52c9d7457a49 => generated 1375 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:36:44.923279 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [req-1d261ebf-98a3-4e32-a260-04ba58381140 req-50595d63-1955-4044-992d-de42eb7ad3f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0b1b05c-6675-4224-8158-caf89589f2db", "tag": "a64c6d5f-61ff-4f5b-8dd1-12186cb685ca"}]} {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:36:44.936713 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG dbcounter [-] [124456] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=124456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:36:44.952490 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [req-1d261ebf-98a3-4e32-a260-04ba58381140 req-50595d63-1955-4044-992d-de42eb7ad3f3 service nova] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:44.953565 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [req-1d261ebf-98a3-4e32-a260-04ba58381140 req-50595d63-1955-4044-992d-de42eb7ad3f3 service nova] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:44.969948 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.compute.server_external_events [req-1d261ebf-98a3-4e32-a260-04ba58381140 req-50595d63-1955-4044-992d-de42eb7ad3f3 service nova] Creating event network-changed:a64c6d5f-61ff-4f5b-8dd1-12186cb685ca for instance c0b1b05c-6675-4224-8158-caf89589f2db on hv-cinder-85200 Aug 04 10:36:44.978887 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [req-1d261ebf-98a3-4e32-a260-04ba58381140 req-50595d63-1955-4044-992d-de42eb7ad3f3 service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061211 Aug 04 10:36:44.980182 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 247/511] 10.222.0.121 () {64 vars in 1322 bytes} [Thu Aug 4 10:36:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:36:45.072659 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-8e58d93d-d711-4bb1-b01c-ecf3b42b35ad tempest-VolumesNegativeTest-2091897051 tempest-VolumesNegativeTest-2091897051-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:36:45.073871 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-8e58d93d-d711-4bb1-b01c-ecf3b42b35ad tempest-VolumesNegativeTest-2091897051 tempest-VolumesNegativeTest-2091897051-project] [instance: 76896d81-ca04-4aed-9ca9-7bc874082eaf] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:36:45.082017 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-8e58d93d-d711-4bb1-b01c-ecf3b42b35ad tempest-VolumesNegativeTest-2091897051 tempest-VolumesNegativeTest-2091897051-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:45.082587 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-8e58d93d-d711-4bb1-b01c-ecf3b42b35ad tempest-VolumesNegativeTest-2091897051 tempest-VolumesNegativeTest-2091897051-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:45.083808 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-8e58d93d-d711-4bb1-b01c-ecf3b42b35ad tempest-VolumesNegativeTest-2091897051 tempest-VolumesNegativeTest-2091897051-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:45.084320 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-8e58d93d-d711-4bb1-b01c-ecf3b42b35ad tempest-VolumesNegativeTest-2091897051 tempest-VolumesNegativeTest-2091897051-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:45.263844 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-e4a19781-a83a-4f1f-8a41-4b6a0741908a tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:36:45.264837 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-e4a19781-a83a-4f1f-8a41-4b6a0741908a tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] [instance: c0b1b05c-6675-4224-8158-caf89589f2db] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:36:45.281942 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-e4a19781-a83a-4f1f-8a41-4b6a0741908a tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:45.282568 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-e4a19781-a83a-4f1f-8a41-4b6a0741908a tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:45.283480 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-e4a19781-a83a-4f1f-8a41-4b6a0741908a tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:45.284063 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-e4a19781-a83a-4f1f-8a41-4b6a0741908a tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:45.289134 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG dbcounter [-] [124456] Writing DB stats nova_cell1:SELECT=100 {{(pid=124456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:36:45.482471 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-8e58d93d-d711-4bb1-b01c-ecf3b42b35ad tempest-VolumesNegativeTest-2091897051 tempest-VolumesNegativeTest-2091897051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06eaea526a346b3b86f27eb347b9856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c41c04883804e9586e241166703c1ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:36:45.500145 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-8e58d93d-d711-4bb1-b01c-ecf3b42b35ad tempest-VolumesNegativeTest-2091897051 tempest-VolumesNegativeTest-2091897051-project] 10.222.0.121 "GET /compute/v2.1/servers/76896d81-ca04-4aed-9ca9-7bc874082eaf" status: 200 len: 1318 microversion: 2.1 time: 0.431452 Aug 04 10:36:45.504524 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 265/512] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:36:45 2022] GET /compute/v2.1/servers/76896d81-ca04-4aed-9ca9-7bc874082eaf => generated 1318 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:36:45.536259 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-e4a19781-a83a-4f1f-8a41-4b6a0741908a tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9e00718840481ca416e25ef436bb24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacec5c4a2584f60af1ca9843e9e8732', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:36:45.547211 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-e4a19781-a83a-4f1f-8a41-4b6a0741908a tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] 10.222.0.121 "GET /compute/v2.1/servers/c0b1b05c-6675-4224-8158-caf89589f2db" status: 200 len: 1323 microversion: 2.1 time: 0.287977 Aug 04 10:36:45.548236 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 248/513] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:36:45 2022] GET /compute/v2.1/servers/c0b1b05c-6675-4224-8158-caf89589f2db => generated 1323 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 10:36:45.565221 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-fc19c99f-19a5-4e1f-bdd5-b4c23619c4f8 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:36:45.567369 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-fc19c99f-19a5-4e1f-bdd5-b4c23619c4f8 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] [instance: a5fe2c05-1417-4bc2-855e-52c9d7457a49] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:36:45.576274 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-fc19c99f-19a5-4e1f-bdd5-b4c23619c4f8 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:45.576740 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-fc19c99f-19a5-4e1f-bdd5-b4c23619c4f8 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:45.577905 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-fc19c99f-19a5-4e1f-bdd5-b4c23619c4f8 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:45.578700 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-fc19c99f-19a5-4e1f-bdd5-b4c23619c4f8 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:45.795648 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-fc19c99f-19a5-4e1f-bdd5-b4c23619c4f8 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3170dc3323f54512bc8819c8efa86b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7121bd118a2549c39332cfdb7edaa92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:36:45.808180 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-fc19c99f-19a5-4e1f-bdd5-b4c23619c4f8 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] 10.222.0.121 "GET /compute/v2.1/servers/a5fe2c05-1417-4bc2-855e-52c9d7457a49" status: 200 len: 1375 microversion: 2.1 time: 0.249026 Aug 04 10:36:45.809449 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 266/514] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:36:45 2022] GET /compute/v2.1/servers/a5fe2c05-1417-4bc2-855e-52c9d7457a49 => generated 1375 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:36:46.153379 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [req-26a68d85-35c7-48a8-baae-b3361fa8ca3d req-bab9043e-6ba4-43cc-9819-3607004b4fdc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5fe2c05-1417-4bc2-855e-52c9d7457a49", "name": "network-vif-plugged", "status": "completed", "tag": "145415de-6cf5-4375-a71d-43735b21c5b4"}]} {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:36:46.171651 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [req-26a68d85-35c7-48a8-baae-b3361fa8ca3d req-bab9043e-6ba4-43cc-9819-3607004b4fdc service nova] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:46.172996 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [req-26a68d85-35c7-48a8-baae-b3361fa8ca3d req-bab9043e-6ba4-43cc-9819-3607004b4fdc service nova] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:46.218283 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.compute.server_external_events [req-26a68d85-35c7-48a8-baae-b3361fa8ca3d req-bab9043e-6ba4-43cc-9819-3607004b4fdc service nova] Creating event network-vif-plugged:145415de-6cf5-4375-a71d-43735b21c5b4 for instance a5fe2c05-1417-4bc2-855e-52c9d7457a49 on hv-cinder-85200 Aug 04 10:36:46.325070 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [req-26a68d85-35c7-48a8-baae-b3361fa8ca3d req-bab9043e-6ba4-43cc-9819-3607004b4fdc service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.167442 Aug 04 10:36:46.328996 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 249/515] 10.222.0.121 () {64 vars in 1322 bytes} [Thu Aug 4 10:36:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:36:46.523767 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-a7b99129-f2db-4ce1-a235-0266ff205df2 tempest-VolumesNegativeTest-2091897051 tempest-VolumesNegativeTest-2091897051-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:36:46.524447 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-a7b99129-f2db-4ce1-a235-0266ff205df2 tempest-VolumesNegativeTest-2091897051 tempest-VolumesNegativeTest-2091897051-project] [instance: 76896d81-ca04-4aed-9ca9-7bc874082eaf] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:36:46.533670 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-a7b99129-f2db-4ce1-a235-0266ff205df2 tempest-VolumesNegativeTest-2091897051 tempest-VolumesNegativeTest-2091897051-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:46.534137 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-a7b99129-f2db-4ce1-a235-0266ff205df2 tempest-VolumesNegativeTest-2091897051 tempest-VolumesNegativeTest-2091897051-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:46.535788 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-a7b99129-f2db-4ce1-a235-0266ff205df2 tempest-VolumesNegativeTest-2091897051 tempest-VolumesNegativeTest-2091897051-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:46.536504 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-a7b99129-f2db-4ce1-a235-0266ff205df2 tempest-VolumesNegativeTest-2091897051 tempest-VolumesNegativeTest-2091897051-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:46.587685 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-499fc185-bae1-4d6a-a3bb-95ba725c5ced tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:36:46.588540 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-499fc185-bae1-4d6a-a3bb-95ba725c5ced tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] [instance: c0b1b05c-6675-4224-8158-caf89589f2db] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:36:46.595874 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-499fc185-bae1-4d6a-a3bb-95ba725c5ced tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:46.596442 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-499fc185-bae1-4d6a-a3bb-95ba725c5ced tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:46.597328 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-499fc185-bae1-4d6a-a3bb-95ba725c5ced tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:46.597772 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-499fc185-bae1-4d6a-a3bb-95ba725c5ced tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:46.881782 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-a7b99129-f2db-4ce1-a235-0266ff205df2 tempest-VolumesNegativeTest-2091897051 tempest-VolumesNegativeTest-2091897051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06eaea526a346b3b86f27eb347b9856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c41c04883804e9586e241166703c1ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:36:46.897992 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-499fc185-bae1-4d6a-a3bb-95ba725c5ced tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9e00718840481ca416e25ef436bb24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacec5c4a2584f60af1ca9843e9e8732', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:36:46.910970 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-499fc185-bae1-4d6a-a3bb-95ba725c5ced tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] 10.222.0.121 "GET /compute/v2.1/servers/c0b1b05c-6675-4224-8158-caf89589f2db" status: 200 len: 1323 microversion: 2.1 time: 0.340344 Aug 04 10:36:46.912276 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-a7b99129-f2db-4ce1-a235-0266ff205df2 tempest-VolumesNegativeTest-2091897051 tempest-VolumesNegativeTest-2091897051-project] 10.222.0.121 "GET /compute/v2.1/servers/76896d81-ca04-4aed-9ca9-7bc874082eaf" status: 200 len: 1318 microversion: 2.1 time: 0.392211 Aug 04 10:36:46.912503 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 250/516] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:36:46 2022] GET /compute/v2.1/servers/c0b1b05c-6675-4224-8158-caf89589f2db => generated 1323 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:36:46.918413 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-3e7924cd-33e9-451d-ae43-0ae12994a457 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:36:46.919213 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-3e7924cd-33e9-451d-ae43-0ae12994a457 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] [instance: a5fe2c05-1417-4bc2-855e-52c9d7457a49] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:36:46.927784 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 267/517] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:36:46 2022] GET /compute/v2.1/servers/76896d81-ca04-4aed-9ca9-7bc874082eaf => generated 1318 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:36:46.928548 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-3e7924cd-33e9-451d-ae43-0ae12994a457 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:46.929104 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-3e7924cd-33e9-451d-ae43-0ae12994a457 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:46.930007 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-3e7924cd-33e9-451d-ae43-0ae12994a457 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:46.930453 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-3e7924cd-33e9-451d-ae43-0ae12994a457 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:47.179718 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-3e7924cd-33e9-451d-ae43-0ae12994a457 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3170dc3323f54512bc8819c8efa86b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7121bd118a2549c39332cfdb7edaa92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:36:47.190138 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-3e7924cd-33e9-451d-ae43-0ae12994a457 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] 10.222.0.121 "GET /compute/v2.1/servers/a5fe2c05-1417-4bc2-855e-52c9d7457a49" status: 200 len: 1375 microversion: 2.1 time: 0.275708 Aug 04 10:36:47.191033 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 251/518] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:36:46 2022] GET /compute/v2.1/servers/a5fe2c05-1417-4bc2-855e-52c9d7457a49 => generated 1375 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:36:47.936328 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-b7006dc6-cf34-4294-ac47-06a61d924a77 tempest-VolumesNegativeTest-2091897051 tempest-VolumesNegativeTest-2091897051-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:36:47.943996 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-c1fe7c94-25ab-41ce-97fa-599a90480766 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:36:47.946079 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-b7006dc6-cf34-4294-ac47-06a61d924a77 tempest-VolumesNegativeTest-2091897051 tempest-VolumesNegativeTest-2091897051-project] [instance: 76896d81-ca04-4aed-9ca9-7bc874082eaf] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:36:47.947153 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-c1fe7c94-25ab-41ce-97fa-599a90480766 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] [instance: c0b1b05c-6675-4224-8158-caf89589f2db] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:36:47.957367 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-b7006dc6-cf34-4294-ac47-06a61d924a77 tempest-VolumesNegativeTest-2091897051 tempest-VolumesNegativeTest-2091897051-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:47.959754 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-b7006dc6-cf34-4294-ac47-06a61d924a77 tempest-VolumesNegativeTest-2091897051 tempest-VolumesNegativeTest-2091897051-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:47.963171 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-b7006dc6-cf34-4294-ac47-06a61d924a77 tempest-VolumesNegativeTest-2091897051 tempest-VolumesNegativeTest-2091897051-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:47.965546 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-c1fe7c94-25ab-41ce-97fa-599a90480766 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:47.966167 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-c1fe7c94-25ab-41ce-97fa-599a90480766 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:47.967134 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-c1fe7c94-25ab-41ce-97fa-599a90480766 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:47.967702 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-c1fe7c94-25ab-41ce-97fa-599a90480766 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:47.972569 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-b7006dc6-cf34-4294-ac47-06a61d924a77 tempest-VolumesNegativeTest-2091897051 tempest-VolumesNegativeTest-2091897051-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:47.983537 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG dbcounter [-] [124457] Writing DB stats nova_cell1:SELECT=100 {{(pid=124457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:36:48.279389 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-b7006dc6-cf34-4294-ac47-06a61d924a77 tempest-VolumesNegativeTest-2091897051 tempest-VolumesNegativeTest-2091897051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06eaea526a346b3b86f27eb347b9856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c41c04883804e9586e241166703c1ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:36:48.293414 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-c1fe7c94-25ab-41ce-97fa-599a90480766 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9e00718840481ca416e25ef436bb24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacec5c4a2584f60af1ca9843e9e8732', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:36:48.303248 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-b7006dc6-cf34-4294-ac47-06a61d924a77 tempest-VolumesNegativeTest-2091897051 tempest-VolumesNegativeTest-2091897051-project] 10.222.0.121 "GET /compute/v2.1/servers/76896d81-ca04-4aed-9ca9-7bc874082eaf" status: 200 len: 1468 microversion: 2.1 time: 0.370818 Aug 04 10:36:48.305501 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 268/519] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:36:47 2022] GET /compute/v2.1/servers/76896d81-ca04-4aed-9ca9-7bc874082eaf => generated 1468 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:36:48.316766 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-c1fe7c94-25ab-41ce-97fa-599a90480766 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] 10.222.0.121 "GET /compute/v2.1/servers/c0b1b05c-6675-4224-8158-caf89589f2db" status: 200 len: 1323 microversion: 2.1 time: 0.365494 Aug 04 10:36:48.317035 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-f2a9ac25-0ba8-47d6-aca8-0ce28628536b tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:36:48.318005 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-f2a9ac25-0ba8-47d6-aca8-0ce28628536b tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] [instance: a5fe2c05-1417-4bc2-855e-52c9d7457a49] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:36:48.323761 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 252/520] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:36:47 2022] GET /compute/v2.1/servers/c0b1b05c-6675-4224-8158-caf89589f2db => generated 1323 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:36:48.342167 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-f2a9ac25-0ba8-47d6-aca8-0ce28628536b tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:48.342167 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-f2a9ac25-0ba8-47d6-aca8-0ce28628536b tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:48.342734 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-f2a9ac25-0ba8-47d6-aca8-0ce28628536b tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:48.343523 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-f2a9ac25-0ba8-47d6-aca8-0ce28628536b tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:48.363591 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-aaf7127e-4f0a-4a43-a6c1-f5b8e7cd4b22 tempest-VolumesNegativeTest-2091897051 tempest-VolumesNegativeTest-2091897051-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:36:48.364273 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-aaf7127e-4f0a-4a43-a6c1-f5b8e7cd4b22 tempest-VolumesNegativeTest-2091897051 tempest-VolumesNegativeTest-2091897051-project] [instance: 76896d81-ca04-4aed-9ca9-7bc874082eaf] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:36:48.373867 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-aaf7127e-4f0a-4a43-a6c1-f5b8e7cd4b22 tempest-VolumesNegativeTest-2091897051 tempest-VolumesNegativeTest-2091897051-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:48.374329 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-aaf7127e-4f0a-4a43-a6c1-f5b8e7cd4b22 tempest-VolumesNegativeTest-2091897051 tempest-VolumesNegativeTest-2091897051-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:48.375223 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-aaf7127e-4f0a-4a43-a6c1-f5b8e7cd4b22 tempest-VolumesNegativeTest-2091897051 tempest-VolumesNegativeTest-2091897051-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:48.375766 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-aaf7127e-4f0a-4a43-a6c1-f5b8e7cd4b22 tempest-VolumesNegativeTest-2091897051 tempest-VolumesNegativeTest-2091897051-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:48.418564 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-aaf7127e-4f0a-4a43-a6c1-f5b8e7cd4b22 tempest-VolumesNegativeTest-2091897051 tempest-VolumesNegativeTest-2091897051-project] [instance: 76896d81-ca04-4aed-9ca9-7bc874082eaf] Going to try to terminate instance {{(pid=124456) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 10:36:48.534545 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-aaf7127e-4f0a-4a43-a6c1-f5b8e7cd4b22 tempest-VolumesNegativeTest-2091897051 tempest-VolumesNegativeTest-2091897051-project] 10.222.0.121 "DELETE /compute/v2.1/servers/76896d81-ca04-4aed-9ca9-7bc874082eaf" status: 204 len: 0 microversion: 2.1 time: 0.176027 Aug 04 10:36:48.536215 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 253/521] 10.222.0.121 () {58 vars in 1244 bytes} [Thu Aug 4 10:36:48 2022] DELETE /compute/v2.1/servers/76896d81-ca04-4aed-9ca9-7bc874082eaf => generated 0 bytes in 179 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 10:36:48.546665 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-a597d4dd-db7c-4a43-9bad-b8c8f27ac5ca tempest-VolumesNegativeTest-2091897051 tempest-VolumesNegativeTest-2091897051-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:36:48.547980 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-a597d4dd-db7c-4a43-9bad-b8c8f27ac5ca tempest-VolumesNegativeTest-2091897051 tempest-VolumesNegativeTest-2091897051-project] [instance: 76896d81-ca04-4aed-9ca9-7bc874082eaf] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:36:48.566073 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-a597d4dd-db7c-4a43-9bad-b8c8f27ac5ca tempest-VolumesNegativeTest-2091897051 tempest-VolumesNegativeTest-2091897051-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:48.566808 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-a597d4dd-db7c-4a43-9bad-b8c8f27ac5ca tempest-VolumesNegativeTest-2091897051 tempest-VolumesNegativeTest-2091897051-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:48.567777 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-a597d4dd-db7c-4a43-9bad-b8c8f27ac5ca tempest-VolumesNegativeTest-2091897051 tempest-VolumesNegativeTest-2091897051-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:48.568415 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-a597d4dd-db7c-4a43-9bad-b8c8f27ac5ca tempest-VolumesNegativeTest-2091897051 tempest-VolumesNegativeTest-2091897051-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:48.679394 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-f2a9ac25-0ba8-47d6-aca8-0ce28628536b tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3170dc3323f54512bc8819c8efa86b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7121bd118a2549c39332cfdb7edaa92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:36:48.693075 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-f2a9ac25-0ba8-47d6-aca8-0ce28628536b tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] 10.222.0.121 "GET /compute/v2.1/servers/a5fe2c05-1417-4bc2-855e-52c9d7457a49" status: 200 len: 1375 microversion: 2.1 time: 0.385111 Aug 04 10:36:48.695147 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 269/522] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:36:48 2022] GET /compute/v2.1/servers/a5fe2c05-1417-4bc2-855e-52c9d7457a49 => generated 1375 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:36:48.766094 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-a597d4dd-db7c-4a43-9bad-b8c8f27ac5ca tempest-VolumesNegativeTest-2091897051 tempest-VolumesNegativeTest-2091897051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06eaea526a346b3b86f27eb347b9856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c41c04883804e9586e241166703c1ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:36:48.775432 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-a597d4dd-db7c-4a43-9bad-b8c8f27ac5ca tempest-VolumesNegativeTest-2091897051 tempest-VolumesNegativeTest-2091897051-project] 10.222.0.121 "GET /compute/v2.1/servers/76896d81-ca04-4aed-9ca9-7bc874082eaf" status: 200 len: 1474 microversion: 2.1 time: 0.234437 Aug 04 10:36:48.776492 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 254/523] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:36:48 2022] GET /compute/v2.1/servers/76896d81-ca04-4aed-9ca9-7bc874082eaf => generated 1474 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:36:49.348826 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-f7233315-1a82-4946-a748-e0c7ec34426a tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:36:49.349607 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-f7233315-1a82-4946-a748-e0c7ec34426a tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] [instance: c0b1b05c-6675-4224-8158-caf89589f2db] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:36:49.357354 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-f7233315-1a82-4946-a748-e0c7ec34426a tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:49.357808 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-f7233315-1a82-4946-a748-e0c7ec34426a tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:49.358671 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-f7233315-1a82-4946-a748-e0c7ec34426a tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:49.359307 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-f7233315-1a82-4946-a748-e0c7ec34426a tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:49.562397 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-f7233315-1a82-4946-a748-e0c7ec34426a tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9e00718840481ca416e25ef436bb24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacec5c4a2584f60af1ca9843e9e8732', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:36:49.576024 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-f7233315-1a82-4946-a748-e0c7ec34426a tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] 10.222.0.121 "GET /compute/v2.1/servers/c0b1b05c-6675-4224-8158-caf89589f2db" status: 200 len: 1323 microversion: 2.1 time: 0.233762 Aug 04 10:36:49.576661 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 270/524] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:36:49 2022] GET /compute/v2.1/servers/c0b1b05c-6675-4224-8158-caf89589f2db => generated 1323 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:36:49.716951 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-c0ec5c5a-af16-4675-9134-9ed846da3a32 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:36:49.718008 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-c0ec5c5a-af16-4675-9134-9ed846da3a32 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] [instance: a5fe2c05-1417-4bc2-855e-52c9d7457a49] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:36:49.728224 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-c0ec5c5a-af16-4675-9134-9ed846da3a32 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:49.728224 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-c0ec5c5a-af16-4675-9134-9ed846da3a32 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:49.728224 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-c0ec5c5a-af16-4675-9134-9ed846da3a32 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:49.728224 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-c0ec5c5a-af16-4675-9134-9ed846da3a32 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:49.807344 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-a91f3506-bc95-4b1d-a803-aeb111dcb079 tempest-VolumesNegativeTest-2091897051 tempest-VolumesNegativeTest-2091897051-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:36:49.809201 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-a91f3506-bc95-4b1d-a803-aeb111dcb079 tempest-VolumesNegativeTest-2091897051 tempest-VolumesNegativeTest-2091897051-project] [instance: 76896d81-ca04-4aed-9ca9-7bc874082eaf] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:36:49.823147 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-a91f3506-bc95-4b1d-a803-aeb111dcb079 tempest-VolumesNegativeTest-2091897051 tempest-VolumesNegativeTest-2091897051-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:49.824438 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-a91f3506-bc95-4b1d-a803-aeb111dcb079 tempest-VolumesNegativeTest-2091897051 tempest-VolumesNegativeTest-2091897051-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:49.826086 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-a91f3506-bc95-4b1d-a803-aeb111dcb079 tempest-VolumesNegativeTest-2091897051 tempest-VolumesNegativeTest-2091897051-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:49.826937 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-a91f3506-bc95-4b1d-a803-aeb111dcb079 tempest-VolumesNegativeTest-2091897051 tempest-VolumesNegativeTest-2091897051-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:50.023855 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-c0ec5c5a-af16-4675-9134-9ed846da3a32 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3170dc3323f54512bc8819c8efa86b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7121bd118a2549c39332cfdb7edaa92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:36:50.042455 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-c0ec5c5a-af16-4675-9134-9ed846da3a32 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] 10.222.0.121 "GET /compute/v2.1/servers/a5fe2c05-1417-4bc2-855e-52c9d7457a49" status: 200 len: 1375 microversion: 2.1 time: 0.329392 Aug 04 10:36:50.056010 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 255/525] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:36:49 2022] GET /compute/v2.1/servers/a5fe2c05-1417-4bc2-855e-52c9d7457a49 => generated 1375 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 10:36:50.062000 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-a91f3506-bc95-4b1d-a803-aeb111dcb079 tempest-VolumesNegativeTest-2091897051 tempest-VolumesNegativeTest-2091897051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06eaea526a346b3b86f27eb347b9856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c41c04883804e9586e241166703c1ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:36:50.072182 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-a91f3506-bc95-4b1d-a803-aeb111dcb079 tempest-VolumesNegativeTest-2091897051 tempest-VolumesNegativeTest-2091897051-project] 10.222.0.121 "GET /compute/v2.1/servers/76896d81-ca04-4aed-9ca9-7bc874082eaf" status: 200 len: 1474 microversion: 2.1 time: 0.278021 Aug 04 10:36:50.072913 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 271/526] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:36:49 2022] GET /compute/v2.1/servers/76896d81-ca04-4aed-9ca9-7bc874082eaf => generated 1474 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:36:50.599782 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-aa0168ad-389b-46c0-b5b5-31f8f123954e tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:36:50.600457 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-aa0168ad-389b-46c0-b5b5-31f8f123954e tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] [instance: c0b1b05c-6675-4224-8158-caf89589f2db] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:36:50.613013 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-aa0168ad-389b-46c0-b5b5-31f8f123954e tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:50.613461 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-aa0168ad-389b-46c0-b5b5-31f8f123954e tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:50.614270 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-aa0168ad-389b-46c0-b5b5-31f8f123954e tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:50.614699 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-aa0168ad-389b-46c0-b5b5-31f8f123954e tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:50.792056 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-aa0168ad-389b-46c0-b5b5-31f8f123954e tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9e00718840481ca416e25ef436bb24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacec5c4a2584f60af1ca9843e9e8732', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:36:50.801663 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-aa0168ad-389b-46c0-b5b5-31f8f123954e tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] 10.222.0.121 "GET /compute/v2.1/servers/c0b1b05c-6675-4224-8158-caf89589f2db" status: 200 len: 1323 microversion: 2.1 time: 0.206214 Aug 04 10:36:50.802826 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 256/527] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:36:50 2022] GET /compute/v2.1/servers/c0b1b05c-6675-4224-8158-caf89589f2db => generated 1323 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:36:51.064744 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-71d7fa11-7cc1-4378-8b57-1e9df345be1f tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:36:51.065500 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-71d7fa11-7cc1-4378-8b57-1e9df345be1f tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] [instance: a5fe2c05-1417-4bc2-855e-52c9d7457a49] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:36:51.072390 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-71d7fa11-7cc1-4378-8b57-1e9df345be1f tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:51.072854 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-71d7fa11-7cc1-4378-8b57-1e9df345be1f tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:51.073638 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-71d7fa11-7cc1-4378-8b57-1e9df345be1f tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:51.074061 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-71d7fa11-7cc1-4378-8b57-1e9df345be1f tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:51.094584 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-f7a9d1c9-4983-43fe-9665-c75adc86bd18 tempest-VolumesNegativeTest-2091897051 tempest-VolumesNegativeTest-2091897051-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:36:51.095067 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-f7a9d1c9-4983-43fe-9665-c75adc86bd18 tempest-VolumesNegativeTest-2091897051 tempest-VolumesNegativeTest-2091897051-project] [instance: 76896d81-ca04-4aed-9ca9-7bc874082eaf] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:36:51.102424 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-f7a9d1c9-4983-43fe-9665-c75adc86bd18 tempest-VolumesNegativeTest-2091897051 tempest-VolumesNegativeTest-2091897051-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:51.102879 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-f7a9d1c9-4983-43fe-9665-c75adc86bd18 tempest-VolumesNegativeTest-2091897051 tempest-VolumesNegativeTest-2091897051-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:51.103656 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-f7a9d1c9-4983-43fe-9665-c75adc86bd18 tempest-VolumesNegativeTest-2091897051 tempest-VolumesNegativeTest-2091897051-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:51.104146 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-f7a9d1c9-4983-43fe-9665-c75adc86bd18 tempest-VolumesNegativeTest-2091897051 tempest-VolumesNegativeTest-2091897051-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:51.287747 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-71d7fa11-7cc1-4378-8b57-1e9df345be1f tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3170dc3323f54512bc8819c8efa86b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7121bd118a2549c39332cfdb7edaa92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:36:51.296847 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-71d7fa11-7cc1-4378-8b57-1e9df345be1f tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] 10.222.0.121 "GET /compute/v2.1/servers/a5fe2c05-1417-4bc2-855e-52c9d7457a49" status: 200 len: 1570 microversion: 2.1 time: 0.236215 Aug 04 10:36:51.297476 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 272/528] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:36:51 2022] GET /compute/v2.1/servers/a5fe2c05-1417-4bc2-855e-52c9d7457a49 => generated 1570 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:36:51.302186 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-f7a9d1c9-4983-43fe-9665-c75adc86bd18 tempest-VolumesNegativeTest-2091897051 tempest-VolumesNegativeTest-2091897051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06eaea526a346b3b86f27eb347b9856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c41c04883804e9586e241166703c1ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:36:51.310662 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-f7a9d1c9-4983-43fe-9665-c75adc86bd18 tempest-VolumesNegativeTest-2091897051 tempest-VolumesNegativeTest-2091897051-project] 10.222.0.121 "GET /compute/v2.1/servers/76896d81-ca04-4aed-9ca9-7bc874082eaf" status: 200 len: 1474 microversion: 2.1 time: 0.220560 Aug 04 10:36:51.311269 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 257/529] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:36:51 2022] GET /compute/v2.1/servers/76896d81-ca04-4aed-9ca9-7bc874082eaf => generated 1474 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:36:51.318300 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-8768a301-4ca5-4505-9f66-565add683c7e tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:36:51.318728 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-8768a301-4ca5-4505-9f66-565add683c7e tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] [instance: a5fe2c05-1417-4bc2-855e-52c9d7457a49] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:36:51.325755 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-8768a301-4ca5-4505-9f66-565add683c7e tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:51.326212 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-8768a301-4ca5-4505-9f66-565add683c7e tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:51.326999 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-8768a301-4ca5-4505-9f66-565add683c7e tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:51.327444 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-8768a301-4ca5-4505-9f66-565add683c7e tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:51.413191 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-8768a301-4ca5-4505-9f66-565add683c7e tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] 10.222.0.121 "GET /compute/v2.1/servers/a5fe2c05-1417-4bc2-855e-52c9d7457a49/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.099118 Aug 04 10:36:51.413820 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 273/530] 10.222.0.121 () {58 vars in 1280 bytes} [Thu Aug 4 10:36:51 2022] GET /compute/v2.1/servers/a5fe2c05-1417-4bc2-855e-52c9d7457a49/os-interface => generated 285 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:36:51.825338 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-36be78c4-5a08-48e4-9d8e-65c8e4de7be7 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:36:51.826483 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-36be78c4-5a08-48e4-9d8e-65c8e4de7be7 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] [instance: c0b1b05c-6675-4224-8158-caf89589f2db] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:36:51.835860 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-36be78c4-5a08-48e4-9d8e-65c8e4de7be7 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:51.836699 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-36be78c4-5a08-48e4-9d8e-65c8e4de7be7 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:51.846432 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-36be78c4-5a08-48e4-9d8e-65c8e4de7be7 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:51.847217 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-36be78c4-5a08-48e4-9d8e-65c8e4de7be7 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:52.077232 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-36be78c4-5a08-48e4-9d8e-65c8e4de7be7 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9e00718840481ca416e25ef436bb24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacec5c4a2584f60af1ca9843e9e8732', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:36:52.088704 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-36be78c4-5a08-48e4-9d8e-65c8e4de7be7 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] 10.222.0.121 "GET /compute/v2.1/servers/c0b1b05c-6675-4224-8158-caf89589f2db" status: 200 len: 1323 microversion: 2.1 time: 0.268849 Aug 04 10:36:52.089247 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 258/531] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:36:51 2022] GET /compute/v2.1/servers/c0b1b05c-6675-4224-8158-caf89589f2db => generated 1323 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:36:52.335768 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-b668f4c3-cb4b-4206-bbea-ec699ab44066 tempest-VolumesNegativeTest-2091897051 tempest-VolumesNegativeTest-2091897051-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:36:52.337035 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-b668f4c3-cb4b-4206-bbea-ec699ab44066 tempest-VolumesNegativeTest-2091897051 tempest-VolumesNegativeTest-2091897051-project] [instance: 76896d81-ca04-4aed-9ca9-7bc874082eaf] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:36:52.348600 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-b668f4c3-cb4b-4206-bbea-ec699ab44066 tempest-VolumesNegativeTest-2091897051 tempest-VolumesNegativeTest-2091897051-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:52.349377 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-b668f4c3-cb4b-4206-bbea-ec699ab44066 tempest-VolumesNegativeTest-2091897051 tempest-VolumesNegativeTest-2091897051-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:52.350838 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-b668f4c3-cb4b-4206-bbea-ec699ab44066 tempest-VolumesNegativeTest-2091897051 tempest-VolumesNegativeTest-2091897051-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:52.352168 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-b668f4c3-cb4b-4206-bbea-ec699ab44066 tempest-VolumesNegativeTest-2091897051 tempest-VolumesNegativeTest-2091897051-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:52.523991 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-b668f4c3-cb4b-4206-bbea-ec699ab44066 tempest-VolumesNegativeTest-2091897051 tempest-VolumesNegativeTest-2091897051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06eaea526a346b3b86f27eb347b9856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c41c04883804e9586e241166703c1ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:36:52.534011 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-b668f4c3-cb4b-4206-bbea-ec699ab44066 tempest-VolumesNegativeTest-2091897051 tempest-VolumesNegativeTest-2091897051-project] 10.222.0.121 "GET /compute/v2.1/servers/76896d81-ca04-4aed-9ca9-7bc874082eaf" status: 200 len: 1474 microversion: 2.1 time: 0.204991 Aug 04 10:36:52.534632 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 274/532] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:36:52 2022] GET /compute/v2.1/servers/76896d81-ca04-4aed-9ca9-7bc874082eaf => generated 1474 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:36:52.759203 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [req-2ddf7a3c-25b2-4967-abcf-fe180f04ecc6 req-5e4f9ec0-e0ad-4889-bdd1-fef47d571d03 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a5fe2c05-1417-4bc2-855e-52c9d7457a49", "tag": "145415de-6cf5-4375-a71d-43735b21c5b4"}]} {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:36:52.771343 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [req-2ddf7a3c-25b2-4967-abcf-fe180f04ecc6 req-5e4f9ec0-e0ad-4889-bdd1-fef47d571d03 service nova] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:52.771787 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [req-2ddf7a3c-25b2-4967-abcf-fe180f04ecc6 req-5e4f9ec0-e0ad-4889-bdd1-fef47d571d03 service nova] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:52.784816 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.compute.server_external_events [req-2ddf7a3c-25b2-4967-abcf-fe180f04ecc6 req-5e4f9ec0-e0ad-4889-bdd1-fef47d571d03 service nova] Creating event network-changed:145415de-6cf5-4375-a71d-43735b21c5b4 for instance a5fe2c05-1417-4bc2-855e-52c9d7457a49 on hv-cinder-85200 Aug 04 10:36:52.791409 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [req-2ddf7a3c-25b2-4967-abcf-fe180f04ecc6 req-5e4f9ec0-e0ad-4889-bdd1-fef47d571d03 service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036746 Aug 04 10:36:52.792303 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 259/533] 10.222.0.121 () {64 vars in 1322 bytes} [Thu Aug 4 10:36:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:36:53.115840 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-a3371fbf-cc5f-4d36-9aee-dcc65e87e3cd tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:36:53.116546 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-a3371fbf-cc5f-4d36-9aee-dcc65e87e3cd tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] [instance: c0b1b05c-6675-4224-8158-caf89589f2db] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:36:53.123871 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-a3371fbf-cc5f-4d36-9aee-dcc65e87e3cd tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:53.124350 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-a3371fbf-cc5f-4d36-9aee-dcc65e87e3cd tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:53.125148 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-a3371fbf-cc5f-4d36-9aee-dcc65e87e3cd tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:53.125700 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-a3371fbf-cc5f-4d36-9aee-dcc65e87e3cd tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:53.288356 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-a3371fbf-cc5f-4d36-9aee-dcc65e87e3cd tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9e00718840481ca416e25ef436bb24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacec5c4a2584f60af1ca9843e9e8732', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:36:53.297048 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-a3371fbf-cc5f-4d36-9aee-dcc65e87e3cd tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] 10.222.0.121 "GET /compute/v2.1/servers/c0b1b05c-6675-4224-8158-caf89589f2db" status: 200 len: 1323 microversion: 2.1 time: 0.185679 Aug 04 10:36:53.297667 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 275/534] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:36:53 2022] GET /compute/v2.1/servers/c0b1b05c-6675-4224-8158-caf89589f2db => generated 1323 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:36:53.566990 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-be749963-177d-49a0-8bef-cb405bc7d468 tempest-VolumesNegativeTest-2091897051 tempest-VolumesNegativeTest-2091897051-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:36:53.569506 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-be749963-177d-49a0-8bef-cb405bc7d468 tempest-VolumesNegativeTest-2091897051 tempest-VolumesNegativeTest-2091897051-project] [instance: 76896d81-ca04-4aed-9ca9-7bc874082eaf] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:36:53.588367 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-be749963-177d-49a0-8bef-cb405bc7d468 tempest-VolumesNegativeTest-2091897051 tempest-VolumesNegativeTest-2091897051-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:53.589545 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-be749963-177d-49a0-8bef-cb405bc7d468 tempest-VolumesNegativeTest-2091897051 tempest-VolumesNegativeTest-2091897051-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:53.592831 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-be749963-177d-49a0-8bef-cb405bc7d468 tempest-VolumesNegativeTest-2091897051 tempest-VolumesNegativeTest-2091897051-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:53.593844 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-be749963-177d-49a0-8bef-cb405bc7d468 tempest-VolumesNegativeTest-2091897051 tempest-VolumesNegativeTest-2091897051-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:53.867199 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-be749963-177d-49a0-8bef-cb405bc7d468 tempest-VolumesNegativeTest-2091897051 tempest-VolumesNegativeTest-2091897051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06eaea526a346b3b86f27eb347b9856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c41c04883804e9586e241166703c1ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:36:53.882654 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-be749963-177d-49a0-8bef-cb405bc7d468 tempest-VolumesNegativeTest-2091897051 tempest-VolumesNegativeTest-2091897051-project] 10.222.0.121 "GET /compute/v2.1/servers/76896d81-ca04-4aed-9ca9-7bc874082eaf" status: 200 len: 1474 microversion: 2.1 time: 0.327882 Aug 04 10:36:53.896029 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 260/535] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:36:53 2022] GET /compute/v2.1/servers/76896d81-ca04-4aed-9ca9-7bc874082eaf => generated 1474 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:36:54.320513 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-8e4a2306-73f1-45de-8e81-4ff9fa439d7e tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:36:54.323540 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-8e4a2306-73f1-45de-8e81-4ff9fa439d7e tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] [instance: c0b1b05c-6675-4224-8158-caf89589f2db] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:36:54.335239 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-8e4a2306-73f1-45de-8e81-4ff9fa439d7e tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:54.335979 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-8e4a2306-73f1-45de-8e81-4ff9fa439d7e tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:54.337313 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-8e4a2306-73f1-45de-8e81-4ff9fa439d7e tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:54.338068 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-8e4a2306-73f1-45de-8e81-4ff9fa439d7e tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:54.551902 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-8e4a2306-73f1-45de-8e81-4ff9fa439d7e tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9e00718840481ca416e25ef436bb24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacec5c4a2584f60af1ca9843e9e8732', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:36:54.562385 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-8e4a2306-73f1-45de-8e81-4ff9fa439d7e tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] 10.222.0.121 "GET /compute/v2.1/servers/c0b1b05c-6675-4224-8158-caf89589f2db" status: 200 len: 1323 microversion: 2.1 time: 0.246971 Aug 04 10:36:54.563828 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 276/536] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:36:54 2022] GET /compute/v2.1/servers/c0b1b05c-6675-4224-8158-caf89589f2db => generated 1323 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:36:54.910504 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-fd34a842-5c13-4fc9-8cc4-4bb16dbd6fdf tempest-VolumesNegativeTest-2091897051 tempest-VolumesNegativeTest-2091897051-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:36:54.911664 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-fd34a842-5c13-4fc9-8cc4-4bb16dbd6fdf tempest-VolumesNegativeTest-2091897051 tempest-VolumesNegativeTest-2091897051-project] [instance: 76896d81-ca04-4aed-9ca9-7bc874082eaf] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:36:54.922050 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-fd34a842-5c13-4fc9-8cc4-4bb16dbd6fdf tempest-VolumesNegativeTest-2091897051 tempest-VolumesNegativeTest-2091897051-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:54.922829 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-fd34a842-5c13-4fc9-8cc4-4bb16dbd6fdf tempest-VolumesNegativeTest-2091897051 tempest-VolumesNegativeTest-2091897051-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:54.924312 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-fd34a842-5c13-4fc9-8cc4-4bb16dbd6fdf tempest-VolumesNegativeTest-2091897051 tempest-VolumesNegativeTest-2091897051-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:54.925272 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-fd34a842-5c13-4fc9-8cc4-4bb16dbd6fdf tempest-VolumesNegativeTest-2091897051 tempest-VolumesNegativeTest-2091897051-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:55.217956 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-fd34a842-5c13-4fc9-8cc4-4bb16dbd6fdf tempest-VolumesNegativeTest-2091897051 tempest-VolumesNegativeTest-2091897051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06eaea526a346b3b86f27eb347b9856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c41c04883804e9586e241166703c1ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:36:55.228700 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-fd34a842-5c13-4fc9-8cc4-4bb16dbd6fdf tempest-VolumesNegativeTest-2091897051 tempest-VolumesNegativeTest-2091897051-project] 10.222.0.121 "GET /compute/v2.1/servers/76896d81-ca04-4aed-9ca9-7bc874082eaf" status: 200 len: 1474 microversion: 2.1 time: 0.326089 Aug 04 10:36:55.230805 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 261/537] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:36:54 2022] GET /compute/v2.1/servers/76896d81-ca04-4aed-9ca9-7bc874082eaf => generated 1474 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:36:55.605274 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-44ae3dab-8d38-4518-901e-0092be691e68 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:36:55.612569 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-44ae3dab-8d38-4518-901e-0092be691e68 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] [instance: c0b1b05c-6675-4224-8158-caf89589f2db] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:36:55.616842 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG dbcounter [-] [124457] Writing DB stats nova_api:SELECT=70 {{(pid=124457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:36:55.629351 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-44ae3dab-8d38-4518-901e-0092be691e68 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:55.630452 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-44ae3dab-8d38-4518-901e-0092be691e68 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:55.632034 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-44ae3dab-8d38-4518-901e-0092be691e68 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:55.632693 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-44ae3dab-8d38-4518-901e-0092be691e68 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:56.133290 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [req-1e773edc-c933-4b20-a81a-89df4768fc3c req-ed1832a3-663f-4f9a-9640-8bbcf5504096 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76896d81-ca04-4aed-9ca9-7bc874082eaf", "name": "network-vif-unplugged", "status": "completed", "tag": "be43ef9e-0ef9-4408-8516-109d7dc5189b"}]} {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:36:56.153946 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-44ae3dab-8d38-4518-901e-0092be691e68 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9e00718840481ca416e25ef436bb24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacec5c4a2584f60af1ca9843e9e8732', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:36:56.158093 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [req-1e773edc-c933-4b20-a81a-89df4768fc3c req-ed1832a3-663f-4f9a-9640-8bbcf5504096 service nova] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:56.159904 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [req-1e773edc-c933-4b20-a81a-89df4768fc3c req-ed1832a3-663f-4f9a-9640-8bbcf5504096 service nova] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:56.165804 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-44ae3dab-8d38-4518-901e-0092be691e68 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] 10.222.0.121 "GET /compute/v2.1/servers/c0b1b05c-6675-4224-8158-caf89589f2db" status: 200 len: 1323 microversion: 2.1 time: 0.570277 Aug 04 10:36:56.166435 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 277/538] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:36:55 2022] GET /compute/v2.1/servers/c0b1b05c-6675-4224-8158-caf89589f2db => generated 1323 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:36:56.204008 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.compute.server_external_events [req-1e773edc-c933-4b20-a81a-89df4768fc3c req-ed1832a3-663f-4f9a-9640-8bbcf5504096 service nova] Creating event network-vif-unplugged:be43ef9e-0ef9-4408-8516-109d7dc5189b for instance 76896d81-ca04-4aed-9ca9-7bc874082eaf on hv-cinder-85200 Aug 04 10:36:56.226564 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [req-1e773edc-c933-4b20-a81a-89df4768fc3c req-ed1832a3-663f-4f9a-9640-8bbcf5504096 service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.096628 Aug 04 10:36:56.229027 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 262/539] 10.222.0.121 () {64 vars in 1322 bytes} [Thu Aug 4 10:36:56 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 10:36:56.254429 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-4d5fecec-5cf9-4e06-b7e1-43ab3849e3db tempest-VolumesNegativeTest-2091897051 tempest-VolumesNegativeTest-2091897051-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:36:56.255825 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-4d5fecec-5cf9-4e06-b7e1-43ab3849e3db tempest-VolumesNegativeTest-2091897051 tempest-VolumesNegativeTest-2091897051-project] [instance: 76896d81-ca04-4aed-9ca9-7bc874082eaf] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:36:56.266288 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-4d5fecec-5cf9-4e06-b7e1-43ab3849e3db tempest-VolumesNegativeTest-2091897051 tempest-VolumesNegativeTest-2091897051-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:56.267817 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-4d5fecec-5cf9-4e06-b7e1-43ab3849e3db tempest-VolumesNegativeTest-2091897051 tempest-VolumesNegativeTest-2091897051-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:56.269500 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-4d5fecec-5cf9-4e06-b7e1-43ab3849e3db tempest-VolumesNegativeTest-2091897051 tempest-VolumesNegativeTest-2091897051-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:56.270508 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-4d5fecec-5cf9-4e06-b7e1-43ab3849e3db tempest-VolumesNegativeTest-2091897051 tempest-VolumesNegativeTest-2091897051-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:56.688116 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-4d5fecec-5cf9-4e06-b7e1-43ab3849e3db tempest-VolumesNegativeTest-2091897051 tempest-VolumesNegativeTest-2091897051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06eaea526a346b3b86f27eb347b9856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c41c04883804e9586e241166703c1ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:36:56.702530 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-4d5fecec-5cf9-4e06-b7e1-43ab3849e3db tempest-VolumesNegativeTest-2091897051 tempest-VolumesNegativeTest-2091897051-project] 10.222.0.121 "GET /compute/v2.1/servers/76896d81-ca04-4aed-9ca9-7bc874082eaf" status: 200 len: 1474 microversion: 2.1 time: 0.454608 Aug 04 10:36:56.704189 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 278/540] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:36:56 2022] GET /compute/v2.1/servers/76896d81-ca04-4aed-9ca9-7bc874082eaf => generated 1474 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:36:56.986598 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [req-7a51994a-68ce-4dab-8dab-baae6d403bf3 req-549ca51f-7bf6-422b-a306-53a36de1b1d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76896d81-ca04-4aed-9ca9-7bc874082eaf", "name": "network-vif-deleted", "tag": "be43ef9e-0ef9-4408-8516-109d7dc5189b"}]} {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:36:57.001144 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [req-7a51994a-68ce-4dab-8dab-baae6d403bf3 req-549ca51f-7bf6-422b-a306-53a36de1b1d6 service nova] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:57.003361 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [req-7a51994a-68ce-4dab-8dab-baae6d403bf3 req-549ca51f-7bf6-422b-a306-53a36de1b1d6 service nova] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:57.034310 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.compute.server_external_events [req-7a51994a-68ce-4dab-8dab-baae6d403bf3 req-549ca51f-7bf6-422b-a306-53a36de1b1d6 service nova] Creating event network-vif-deleted:be43ef9e-0ef9-4408-8516-109d7dc5189b for instance 76896d81-ca04-4aed-9ca9-7bc874082eaf on hv-cinder-85200 Aug 04 10:36:57.046576 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [req-7a51994a-68ce-4dab-8dab-baae6d403bf3 req-549ca51f-7bf6-422b-a306-53a36de1b1d6 service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065080 Aug 04 10:36:57.049158 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 263/541] 10.222.0.121 () {64 vars in 1322 bytes} [Thu Aug 4 10:36:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:36:57.192153 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-7d525f21-217d-4cff-8b5b-7b013553a600 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:36:57.192941 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-7d525f21-217d-4cff-8b5b-7b013553a600 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] [instance: c0b1b05c-6675-4224-8158-caf89589f2db] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:36:57.200116 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-7d525f21-217d-4cff-8b5b-7b013553a600 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:57.200934 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-7d525f21-217d-4cff-8b5b-7b013553a600 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:57.202139 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-7d525f21-217d-4cff-8b5b-7b013553a600 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:57.202831 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-7d525f21-217d-4cff-8b5b-7b013553a600 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:57.380384 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-7d525f21-217d-4cff-8b5b-7b013553a600 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9e00718840481ca416e25ef436bb24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacec5c4a2584f60af1ca9843e9e8732', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:36:57.389459 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-7d525f21-217d-4cff-8b5b-7b013553a600 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] 10.222.0.121 "GET /compute/v2.1/servers/c0b1b05c-6675-4224-8158-caf89589f2db" status: 200 len: 1323 microversion: 2.1 time: 0.201276 Aug 04 10:36:57.389714 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 279/542] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:36:57 2022] GET /compute/v2.1/servers/c0b1b05c-6675-4224-8158-caf89589f2db => generated 1323 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 10:36:57.730869 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-bf225c09-eb35-48ca-a3d4-286d36b8478d tempest-VolumesNegativeTest-2091897051 tempest-VolumesNegativeTest-2091897051-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:36:57.731968 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-bf225c09-eb35-48ca-a3d4-286d36b8478d tempest-VolumesNegativeTest-2091897051 tempest-VolumesNegativeTest-2091897051-project] [instance: 76896d81-ca04-4aed-9ca9-7bc874082eaf] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:36:57.747934 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-bf225c09-eb35-48ca-a3d4-286d36b8478d tempest-VolumesNegativeTest-2091897051 tempest-VolumesNegativeTest-2091897051-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:57.748616 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-bf225c09-eb35-48ca-a3d4-286d36b8478d tempest-VolumesNegativeTest-2091897051 tempest-VolumesNegativeTest-2091897051-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:57.749777 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-bf225c09-eb35-48ca-a3d4-286d36b8478d tempest-VolumesNegativeTest-2091897051 tempest-VolumesNegativeTest-2091897051-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:57.750430 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-bf225c09-eb35-48ca-a3d4-286d36b8478d tempest-VolumesNegativeTest-2091897051 tempest-VolumesNegativeTest-2091897051-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:57.822174 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-bf225c09-eb35-48ca-a3d4-286d36b8478d tempest-VolumesNegativeTest-2091897051 tempest-VolumesNegativeTest-2091897051-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:57.822983 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-bf225c09-eb35-48ca-a3d4-286d36b8478d tempest-VolumesNegativeTest-2091897051 tempest-VolumesNegativeTest-2091897051-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:57.823817 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.objects.instance [None req-bf225c09-eb35-48ca-a3d4-286d36b8478d tempest-VolumesNegativeTest-2091897051 tempest-VolumesNegativeTest-2091897051-project] Lazy-loading 'fault' on Instance uuid 76896d81-ca04-4aed-9ca9-7bc874082eaf {{(pid=124456) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 10:36:57.891856 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-bf225c09-eb35-48ca-a3d4-286d36b8478d tempest-VolumesNegativeTest-2091897051 tempest-VolumesNegativeTest-2091897051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c06eaea526a346b3b86f27eb347b9856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c41c04883804e9586e241166703c1ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:36:57.903773 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-bf225c09-eb35-48ca-a3d4-286d36b8478d tempest-VolumesNegativeTest-2091897051 tempest-VolumesNegativeTest-2091897051-project] 10.222.0.121 "GET /compute/v2.1/servers/76896d81-ca04-4aed-9ca9-7bc874082eaf" status: 200 len: 1308 microversion: 2.1 time: 0.180077 Aug 04 10:36:57.904539 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 264/543] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:36:57 2022] GET /compute/v2.1/servers/76896d81-ca04-4aed-9ca9-7bc874082eaf => generated 1308 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:36:58.415494 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-d37fcd2e-cebd-46b4-b6d4-1db175a6be13 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:36:58.416845 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-d37fcd2e-cebd-46b4-b6d4-1db175a6be13 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] [instance: c0b1b05c-6675-4224-8158-caf89589f2db] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:36:58.426670 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-d37fcd2e-cebd-46b4-b6d4-1db175a6be13 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:58.427380 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-d37fcd2e-cebd-46b4-b6d4-1db175a6be13 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:58.428309 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-d37fcd2e-cebd-46b4-b6d4-1db175a6be13 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:58.428843 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-d37fcd2e-cebd-46b4-b6d4-1db175a6be13 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:58.645289 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-d37fcd2e-cebd-46b4-b6d4-1db175a6be13 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9e00718840481ca416e25ef436bb24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacec5c4a2584f60af1ca9843e9e8732', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:36:58.660776 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-d37fcd2e-cebd-46b4-b6d4-1db175a6be13 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] 10.222.0.121 "GET /compute/v2.1/servers/c0b1b05c-6675-4224-8158-caf89589f2db" status: 200 len: 1323 microversion: 2.1 time: 0.250425 Aug 04 10:36:58.662168 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 280/544] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:36:58 2022] GET /compute/v2.1/servers/c0b1b05c-6675-4224-8158-caf89589f2db => generated 1323 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:36:58.705465 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [req-f995a0d3-16c6-4a4e-a41d-a5d63a193442 req-ba91ae08-2598-4da5-8716-b6c12571983f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0b1b05c-6675-4224-8158-caf89589f2db", "name": "network-vif-plugged", "status": "completed", "tag": "a64c6d5f-61ff-4f5b-8dd1-12186cb685ca"}]} {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:36:58.718437 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [req-f995a0d3-16c6-4a4e-a41d-a5d63a193442 req-ba91ae08-2598-4da5-8716-b6c12571983f service nova] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:58.718886 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [req-f995a0d3-16c6-4a4e-a41d-a5d63a193442 req-ba91ae08-2598-4da5-8716-b6c12571983f service nova] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:58.736147 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.compute.server_external_events [req-f995a0d3-16c6-4a4e-a41d-a5d63a193442 req-ba91ae08-2598-4da5-8716-b6c12571983f service nova] Creating event network-vif-plugged:a64c6d5f-61ff-4f5b-8dd1-12186cb685ca for instance c0b1b05c-6675-4224-8158-caf89589f2db on hv-cinder-85200 Aug 04 10:36:58.745308 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [req-f995a0d3-16c6-4a4e-a41d-a5d63a193442 req-ba91ae08-2598-4da5-8716-b6c12571983f service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044395 Aug 04 10:36:58.747167 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 265/545] 10.222.0.121 () {64 vars in 1322 bytes} [Thu Aug 4 10:36:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:36:58.926775 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-82edeb5c-64f8-44ec-8ee5-098c2e84c495 tempest-VolumesNegativeTest-2091897051 tempest-VolumesNegativeTest-2091897051-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:36:58.927410 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-82edeb5c-64f8-44ec-8ee5-098c2e84c495 tempest-VolumesNegativeTest-2091897051 tempest-VolumesNegativeTest-2091897051-project] [instance: 76896d81-ca04-4aed-9ca9-7bc874082eaf] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:36:58.934570 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-82edeb5c-64f8-44ec-8ee5-098c2e84c495 tempest-VolumesNegativeTest-2091897051 tempest-VolumesNegativeTest-2091897051-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:58.934999 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-82edeb5c-64f8-44ec-8ee5-098c2e84c495 tempest-VolumesNegativeTest-2091897051 tempest-VolumesNegativeTest-2091897051-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:58.935823 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-82edeb5c-64f8-44ec-8ee5-098c2e84c495 tempest-VolumesNegativeTest-2091897051 tempest-VolumesNegativeTest-2091897051-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:58.936317 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-82edeb5c-64f8-44ec-8ee5-098c2e84c495 tempest-VolumesNegativeTest-2091897051 tempest-VolumesNegativeTest-2091897051-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:58.952856 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.wsgi [None req-82edeb5c-64f8-44ec-8ee5-098c2e84c495 tempest-VolumesNegativeTest-2091897051 tempest-VolumesNegativeTest-2091897051-project] HTTP exception thrown: Instance 76896d81-ca04-4aed-9ca9-7bc874082eaf could not be found. Aug 04 10:36:58.955491 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-82edeb5c-64f8-44ec-8ee5-098c2e84c495 tempest-VolumesNegativeTest-2091897051 tempest-VolumesNegativeTest-2091897051-project] Request method failure captured: Aug 04 10:36:58.955491 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: request: GET /compute/v2.1/servers/76896d81-ca04-4aed-9ca9-7bc874082eaf HTTP/1.1 Aug 04 10:36:58.955491 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: Accept: application/json Aug 04 10:36:58.955491 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: Accept-Encoding: identity Aug 04 10:36:58.955491 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: Connection: close Aug 04 10:36:58.955491 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: Content-Length: 0 Aug 04 10:36:58.955491 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: Content-Type: application/json Aug 04 10:36:58.955491 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: Host: 10.222.0.121 Aug 04 10:36:58.955491 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: Openstack-System-Scope: None Aug 04 10:36:58.955491 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: User-Agent: python-urllib3/1.26.11 Aug 04 10:36:58.955491 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Auth-Token: gAAAAABi66EkMq21bzcjGF_RXzAtEcyES8IaJUhIV6Ivpp9VPKdUExKGjw6YmbfD1-fqxmlaphLsZMjEAUfMheLvy6L-r2uc-bezrF9uTiP_sIDYFUy8QVTSNuubpeAEEhqgzbOe7pECbQq-nmueQsTz6-fhWR5-_31-lA7Ymmhva_nfESN9f_E Aug 04 10:36:58.955491 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Domain-Id: None Aug 04 10:36:58.955491 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Domain-Name: None Aug 04 10:36:58.955491 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Identity-Status: Confirmed Aug 04 10:36:58.955491 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Is-Admin-Project: True Aug 04 10:36:58.955491 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Project-Domain-Id: default Aug 04 10:36:58.955491 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Project-Domain-Name: Default Aug 04 10:36:58.955491 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Project-Id: 3c41c04883804e9586e241166703c1ce Aug 04 10:36:58.955491 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Project-Name: tempest-VolumesNegativeTest-2091897051 Aug 04 10:36:58.955491 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Role: reader,member Aug 04 10:36:58.955491 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Roles: reader,member Aug 04 10:36:58.958075 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/3c41c04883804e9586e241166703c1ce"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/3c41c04883804e9586e241166703c1ce"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.121:8080", "publicURL": "http://10.222.0.121:8080/v1/AUTH_3c41c04883804e9586e241166703c1ce"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2/3c41c04883804e9586e241166703c1ce"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:9696/networking"}]}] Aug 04 10:36:58.958075 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Tenant: tempest-VolumesNegativeTest-2091897051 Aug 04 10:36:58.958075 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Tenant-Id: 3c41c04883804e9586e241166703c1ce Aug 04 10:36:58.958075 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Tenant-Name: tempest-VolumesNegativeTest-2091897051 Aug 04 10:36:58.958075 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-User: tempest-VolumesNegativeTest-2091897051-project Aug 04 10:36:58.958075 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-User-Domain-Id: default Aug 04 10:36:58.958075 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-User-Domain-Name: Default Aug 04 10:36:58.958075 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-User-Id: c06eaea526a346b3b86f27eb347b9856 Aug 04 10:36:58.958075 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-User-Name: tempest-VolumesNegativeTest-2091897051-project Aug 04 10:36:58.958075 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: method: > Aug 04 10:36:58.958075 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: exception: Instance 76896d81-ca04-4aed-9ca9-7bc874082eaf could not be found. Aug 04 10:36:58.958075 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: action_args: {'id': '76896d81-ca04-4aed-9ca9-7bc874082eaf'} Aug 04 10:36:58.959192 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 10:36:58.959192 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:36:58.959192 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 10:36:58.959192 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 10:36:58.959192 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 10:36:58.959192 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 10:36:58.959192 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 10:36:58.959192 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 10:36:58.959192 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 10:36:58.959192 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 10:36:58.959192 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 76896d81-ca04-4aed-9ca9-7bc874082eaf could not be found. Aug 04 10:36:58.959192 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Aug 04 10:36:58.959192 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:36:58.959192 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Aug 04 10:36:58.959192 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:36:58.959192 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:36:58.959192 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:36:58.959192 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 10:36:58.959192 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 10:36:58.959192 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 10:36:58.961232 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 10:36:58.961232 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 10:36:58.961232 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 10:36:58.961232 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 10:36:58.961232 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 10:36:58.961232 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 10:36:58.961232 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 10:36:58.961232 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 76896d81-ca04-4aed-9ca9-7bc874082eaf could not be found. Aug 04 10:36:58.961232 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Aug 04 10:36:58.961232 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:36:58.961232 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Aug 04 10:36:58.961232 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:36:58.961232 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:36:58.961232 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:36:58.961232 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 10:36:58.961232 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 10:36:58.961232 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 76896d81-ca04-4aed-9ca9-7bc874082eaf could not be found. Aug 04 10:36:58.961232 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Aug 04 10:36:58.963320 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-82edeb5c-64f8-44ec-8ee5-098c2e84c495 tempest-VolumesNegativeTest-2091897051 tempest-VolumesNegativeTest-2091897051-project] Returning 404 to user: Instance 76896d81-ca04-4aed-9ca9-7bc874082eaf could not be found. {{(pid=124457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 10:36:58.963320 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-82edeb5c-64f8-44ec-8ee5-098c2e84c495 tempest-VolumesNegativeTest-2091897051 tempest-VolumesNegativeTest-2091897051-project] 10.222.0.121 "GET /compute/v2.1/servers/76896d81-ca04-4aed-9ca9-7bc874082eaf" status: 404 len: 111 microversion: 2.1 time: 0.034533 Aug 04 10:36:58.963320 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 281/546] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:36:58 2022] GET /compute/v2.1/servers/76896d81-ca04-4aed-9ca9-7bc874082eaf => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 10:36:59.689643 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-d56880c6-9430-4768-9a7e-2869612ef749 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:36:59.690506 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-d56880c6-9430-4768-9a7e-2869612ef749 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] [instance: c0b1b05c-6675-4224-8158-caf89589f2db] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:36:59.702461 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-d56880c6-9430-4768-9a7e-2869612ef749 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:59.703175 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-d56880c6-9430-4768-9a7e-2869612ef749 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:59.704463 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-d56880c6-9430-4768-9a7e-2869612ef749 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:36:59.705048 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-d56880c6-9430-4768-9a7e-2869612ef749 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:36:59.713240 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG dbcounter [-] [124456] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:36:59.872430 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-d56880c6-9430-4768-9a7e-2869612ef749 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9e00718840481ca416e25ef436bb24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacec5c4a2584f60af1ca9843e9e8732', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:36:59.881909 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-d56880c6-9430-4768-9a7e-2869612ef749 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] 10.222.0.121 "GET /compute/v2.1/servers/c0b1b05c-6675-4224-8158-caf89589f2db" status: 200 len: 1323 microversion: 2.1 time: 0.199399 Aug 04 10:36:59.882659 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 266/547] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:36:59 2022] GET /compute/v2.1/servers/c0b1b05c-6675-4224-8158-caf89589f2db => generated 1323 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:37:00.905959 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-f3c42ed2-2580-4dc3-9054-e434c0ba0a98 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:37:00.906590 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-f3c42ed2-2580-4dc3-9054-e434c0ba0a98 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] [instance: c0b1b05c-6675-4224-8158-caf89589f2db] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:37:00.916785 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-f3c42ed2-2580-4dc3-9054-e434c0ba0a98 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:37:00.917516 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-f3c42ed2-2580-4dc3-9054-e434c0ba0a98 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:37:00.918878 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-f3c42ed2-2580-4dc3-9054-e434c0ba0a98 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:37:00.919687 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-f3c42ed2-2580-4dc3-9054-e434c0ba0a98 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:37:01.074996 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-f3c42ed2-2580-4dc3-9054-e434c0ba0a98 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9e00718840481ca416e25ef436bb24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacec5c4a2584f60af1ca9843e9e8732', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:37:01.084375 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-f3c42ed2-2580-4dc3-9054-e434c0ba0a98 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] 10.222.0.121 "GET /compute/v2.1/servers/c0b1b05c-6675-4224-8158-caf89589f2db" status: 200 len: 1323 microversion: 2.1 time: 0.182562 Aug 04 10:37:01.084962 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 282/548] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:37:00 2022] GET /compute/v2.1/servers/c0b1b05c-6675-4224-8158-caf89589f2db => generated 1323 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:37:02.111848 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-a0010071-4dd8-4244-8496-e0b0f3fdfe33 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:37:02.113123 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-a0010071-4dd8-4244-8496-e0b0f3fdfe33 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] [instance: c0b1b05c-6675-4224-8158-caf89589f2db] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:37:02.124757 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-a0010071-4dd8-4244-8496-e0b0f3fdfe33 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:37:02.125563 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-a0010071-4dd8-4244-8496-e0b0f3fdfe33 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:37:02.126906 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-a0010071-4dd8-4244-8496-e0b0f3fdfe33 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:37:02.127770 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-a0010071-4dd8-4244-8496-e0b0f3fdfe33 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:37:02.315580 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-a0010071-4dd8-4244-8496-e0b0f3fdfe33 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9e00718840481ca416e25ef436bb24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacec5c4a2584f60af1ca9843e9e8732', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:37:02.329022 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-a0010071-4dd8-4244-8496-e0b0f3fdfe33 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] 10.222.0.121 "GET /compute/v2.1/servers/c0b1b05c-6675-4224-8158-caf89589f2db" status: 200 len: 1323 microversion: 2.1 time: 0.224819 Aug 04 10:37:02.330172 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 267/549] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:37:02 2022] GET /compute/v2.1/servers/c0b1b05c-6675-4224-8158-caf89589f2db => generated 1323 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:37:03.354592 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-248dd0ab-f828-4873-a411-1f24e40800d3 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:37:03.355574 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-248dd0ab-f828-4873-a411-1f24e40800d3 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] [instance: c0b1b05c-6675-4224-8158-caf89589f2db] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:37:03.365924 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-248dd0ab-f828-4873-a411-1f24e40800d3 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:37:03.366338 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-248dd0ab-f828-4873-a411-1f24e40800d3 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:37:03.367373 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-248dd0ab-f828-4873-a411-1f24e40800d3 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:37:03.367883 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-248dd0ab-f828-4873-a411-1f24e40800d3 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:37:03.540786 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-248dd0ab-f828-4873-a411-1f24e40800d3 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9e00718840481ca416e25ef436bb24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacec5c4a2584f60af1ca9843e9e8732', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:37:03.554019 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-248dd0ab-f828-4873-a411-1f24e40800d3 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] 10.222.0.121 "GET /compute/v2.1/servers/c0b1b05c-6675-4224-8158-caf89589f2db" status: 200 len: 1323 microversion: 2.1 time: 0.204581 Aug 04 10:37:03.554885 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 283/550] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:37:03 2022] GET /compute/v2.1/servers/c0b1b05c-6675-4224-8158-caf89589f2db => generated 1323 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 10:37:04.582221 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-dde18aba-0b81-4ec7-877a-e413e1b87c4b tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:37:04.583190 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-dde18aba-0b81-4ec7-877a-e413e1b87c4b tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] [instance: c0b1b05c-6675-4224-8158-caf89589f2db] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:37:04.590618 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-dde18aba-0b81-4ec7-877a-e413e1b87c4b tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:37:04.591063 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-dde18aba-0b81-4ec7-877a-e413e1b87c4b tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:37:04.591861 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-dde18aba-0b81-4ec7-877a-e413e1b87c4b tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:37:04.592337 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-dde18aba-0b81-4ec7-877a-e413e1b87c4b tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:37:04.789464 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-dde18aba-0b81-4ec7-877a-e413e1b87c4b tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9e00718840481ca416e25ef436bb24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacec5c4a2584f60af1ca9843e9e8732', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:37:04.798160 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-dde18aba-0b81-4ec7-877a-e413e1b87c4b tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] 10.222.0.121 "GET /compute/v2.1/servers/c0b1b05c-6675-4224-8158-caf89589f2db" status: 200 len: 1323 microversion: 2.1 time: 0.220828 Aug 04 10:37:04.798879 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 268/551] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:37:04 2022] GET /compute/v2.1/servers/c0b1b05c-6675-4224-8158-caf89589f2db => generated 1323 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:37:05.826646 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-c1236afb-dee8-4d1a-9776-fd4e7b34629b tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:37:05.827656 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-c1236afb-dee8-4d1a-9776-fd4e7b34629b tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] [instance: c0b1b05c-6675-4224-8158-caf89589f2db] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:37:05.836279 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-c1236afb-dee8-4d1a-9776-fd4e7b34629b tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:37:05.837257 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-c1236afb-dee8-4d1a-9776-fd4e7b34629b tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:37:05.838402 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-c1236afb-dee8-4d1a-9776-fd4e7b34629b tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:37:05.838950 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-c1236afb-dee8-4d1a-9776-fd4e7b34629b tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:37:06.086175 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-c1236afb-dee8-4d1a-9776-fd4e7b34629b tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9e00718840481ca416e25ef436bb24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacec5c4a2584f60af1ca9843e9e8732', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:37:06.099739 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-c1236afb-dee8-4d1a-9776-fd4e7b34629b tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] 10.222.0.121 "GET /compute/v2.1/servers/c0b1b05c-6675-4224-8158-caf89589f2db" status: 200 len: 1512 microversion: 2.1 time: 0.277384 Aug 04 10:37:06.100789 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 284/552] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:37:05 2022] GET /compute/v2.1/servers/c0b1b05c-6675-4224-8158-caf89589f2db => generated 1512 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:37:20.547920 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG dbcounter [-] [124456] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1 {{(pid=124456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:37:20.548696 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG dbcounter [-] [124456] Writing DB stats nova_cell1:SELECT=16 {{(pid=124456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:37:20.768361 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-eed58c50-ba9c-4726-8e27-3ed7ca8e9d7d tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Action: 'create', calling method: .version_select at 0x7f67553159d0>, body: {"keypair": {"name": "tempest-TestShelveInstance-392572535", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNGKUvj8qtzCPVvd/rHW2/O4MfJ9n+bmlJh2/p9hpAUdAlUgp1ZlVyTkPzog6CbAckKlzgQBYkubTiMZmkQDRC+EjUjfUAmnFEmjOL2cD+C/Nb7trtXtd9BN9xzRr35tqQ=="}} {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:37:20.814121 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.quota [None req-eed58c50-ba9c-4726-8e27-3ed7ca8e9d7d tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Getting quotas for project bee0d982e3ba4f7dba65f51636856b5a. Resources: {'key_pairs'} {{(pid=124456) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 10:37:20.823103 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.quota [None req-eed58c50-ba9c-4726-8e27-3ed7ca8e9d7d tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Getting quotas for user 6921033062424e14bc30f9b94bf911db and project bee0d982e3ba4f7dba65f51636856b5a. Resources: {'key_pairs'} {{(pid=124456) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 10:37:20.860315 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-eed58c50-ba9c-4726-8e27-3ed7ca8e9d7d tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] 10.222.0.121 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.317705 Aug 04 10:37:20.861529 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 269/553] 10.222.0.121 () {60 vars in 1164 bytes} [Thu Aug 4 10:37:20 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:37:28.453750 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-a8c52f2d-e564-4132-a813-dcd95427f00b tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:37:28.454395 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-a8c52f2d-e564-4132-a813-dcd95427f00b tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] [instance: c6dec6e8-e2f9-4c57-8326-19fc989b5c6e] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:37:28.456720 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG dbcounter [-] [124457] Writing DB stats nova_api:SELECT=15 {{(pid=124457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:37:28.457415 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG dbcounter [-] [124457] Writing DB stats nova_cell1:SELECT=94 {{(pid=124457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:37:28.463738 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-a8c52f2d-e564-4132-a813-dcd95427f00b tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:37:28.464218 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-a8c52f2d-e564-4132-a813-dcd95427f00b tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:37:28.470729 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-a8c52f2d-e564-4132-a813-dcd95427f00b tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:37:28.470729 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-a8c52f2d-e564-4132-a813-dcd95427f00b tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:37:28.496903 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-a8c52f2d-e564-4132-a813-dcd95427f00b tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] 10.222.0.121 "GET /compute/v2.1/servers/c6dec6e8-e2f9-4c57-8326-19fc989b5c6e/ips" status: 200 len: 148 microversion: 2.1 time: 0.047675 Aug 04 10:37:28.497497 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 285/554] 10.222.0.121 () {58 vars in 1253 bytes} [Thu Aug 4 10:37:28 2022] GET /compute/v2.1/servers/c6dec6e8-e2f9-4c57-8326-19fc989b5c6e/ips => generated 148 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:37:29.833166 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-80686aa4-eeec-437d-9d89-59a0492ffcb2 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:37:29.833797 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-80686aa4-eeec-437d-9d89-59a0492ffcb2 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] [instance: 81259012-5f3b-44f6-b979-39119f14929b] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:37:29.840758 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-80686aa4-eeec-437d-9d89-59a0492ffcb2 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:37:29.841213 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-80686aa4-eeec-437d-9d89-59a0492ffcb2 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:37:29.841970 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-80686aa4-eeec-437d-9d89-59a0492ffcb2 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:37:29.842416 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-80686aa4-eeec-437d-9d89-59a0492ffcb2 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:37:29.869766 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-80686aa4-eeec-437d-9d89-59a0492ffcb2 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] 10.222.0.121 "GET /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b/ips" status: 200 len: 143 microversion: 2.1 time: 0.040702 Aug 04 10:37:29.870372 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 270/555] 10.222.0.121 () {58 vars in 1253 bytes} [Thu Aug 4 10:37:29 2022] GET /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b/ips => generated 143 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:37:34.123189 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-8b048fea-7c0b-4dab-a95d-812e8db0353f tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1970f3b7-e967-4458-a0a9-cae2fcbf7e93"}} {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:37:34.125816 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-8b048fea-7c0b-4dab-a95d-812e8db0353f tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] [instance: 81259012-5f3b-44f6-b979-39119f14929b] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:37:34.137699 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-8b048fea-7c0b-4dab-a95d-812e8db0353f tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:37:34.138846 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-8b048fea-7c0b-4dab-a95d-812e8db0353f tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:37:34.140527 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-8b048fea-7c0b-4dab-a95d-812e8db0353f tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:37:34.141341 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-8b048fea-7c0b-4dab-a95d-812e8db0353f tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:37:34.344521 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-b1a3f513-38d2-4015-b66d-e1d023ca761e tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d30c562b-e963-4c2d-ad89-beeaf6a51747"}} {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:37:34.346957 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-b1a3f513-38d2-4015-b66d-e1d023ca761e tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] [instance: c6dec6e8-e2f9-4c57-8326-19fc989b5c6e] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:37:34.349435 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG dbcounter [-] [124456] Writing DB stats nova_cell0:SELECT=4 {{(pid=124456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:37:34.355821 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-b1a3f513-38d2-4015-b66d-e1d023ca761e tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:37:34.356305 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-b1a3f513-38d2-4015-b66d-e1d023ca761e tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:37:34.357237 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-b1a3f513-38d2-4015-b66d-e1d023ca761e tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:37:34.357822 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-b1a3f513-38d2-4015-b66d-e1d023ca761e tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:37:34.563408 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-8b048fea-7c0b-4dab-a95d-812e8db0353f tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] 10.222.0.121 "POST /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.443887 Aug 04 10:37:34.564048 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 286/556] 10.222.0.121 () {60 vars in 1328 bytes} [Thu Aug 4 10:37:34 2022] POST /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b/os-volume_attachments => generated 194 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 10:37:34.851854 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-b1a3f513-38d2-4015-b66d-e1d023ca761e tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] 10.222.0.121 "POST /compute/v2.1/servers/c6dec6e8-e2f9-4c57-8326-19fc989b5c6e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.510523 Aug 04 10:37:34.863888 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 271/557] 10.222.0.121 () {60 vars in 1328 bytes} [Thu Aug 4 10:37:34 2022] POST /compute/v2.1/servers/c6dec6e8-e2f9-4c57-8326-19fc989b5c6e/os-volume_attachments => generated 194 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 10:37:43.385459 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-88888b01-8d1e-4a14-bf59-d8c9088d6e57 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:37:43.392473 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-88888b01-8d1e-4a14-bf59-d8c9088d6e57 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:37:43.392948 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-88888b01-8d1e-4a14-bf59-d8c9088d6e57 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:37:43.460930 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-88888b01-8d1e-4a14-bf59-d8c9088d6e57 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] [instance: 81259012-5f3b-44f6-b979-39119f14929b] Going to try to stop instance {{(pid=124457) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 04 10:37:43.518034 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-88888b01-8d1e-4a14-bf59-d8c9088d6e57 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] 10.222.0.121 "POST /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b/action" status: 202 len: 0 microversion: 2.1 time: 0.137317 Aug 04 10:37:43.518772 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 287/558] 10.222.0.121 () {60 vars in 1283 bytes} [Thu Aug 4 10:37:43 2022] POST /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b/action => generated 0 bytes in 139 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 10:37:43.538400 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-5ebeb3bd-d63e-4c0d-bc07-017ea5965842 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:37:43.539478 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-5ebeb3bd-d63e-4c0d-bc07-017ea5965842 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] [instance: 81259012-5f3b-44f6-b979-39119f14929b] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:37:43.550680 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-5ebeb3bd-d63e-4c0d-bc07-017ea5965842 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:37:43.551595 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-5ebeb3bd-d63e-4c0d-bc07-017ea5965842 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:37:43.553100 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-5ebeb3bd-d63e-4c0d-bc07-017ea5965842 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:37:43.554930 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-5ebeb3bd-d63e-4c0d-bc07-017ea5965842 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:37:43.931663 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-5ebeb3bd-d63e-4c0d-bc07-017ea5965842 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa2e2a5a6ed4c5c9db91269266dd30b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f46ab11dd0b428486c673afc14b5b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:37:43.946958 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-5ebeb3bd-d63e-4c0d-bc07-017ea5965842 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] 10.222.0.121 "GET /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b" status: 200 len: 1724 microversion: 2.1 time: 0.420450 Aug 04 10:37:43.947553 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 272/559] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:37:43 2022] GET /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b => generated 1724 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:37:44.971338 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-a0c6ec4c-4235-4f1b-9329-42e813e93054 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:37:44.972016 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-a0c6ec4c-4235-4f1b-9329-42e813e93054 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] [instance: 81259012-5f3b-44f6-b979-39119f14929b] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:37:44.979976 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-a0c6ec4c-4235-4f1b-9329-42e813e93054 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:37:44.980461 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-a0c6ec4c-4235-4f1b-9329-42e813e93054 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:37:44.981297 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-a0c6ec4c-4235-4f1b-9329-42e813e93054 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:37:44.981719 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-a0c6ec4c-4235-4f1b-9329-42e813e93054 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:37:45.222080 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-a0c6ec4c-4235-4f1b-9329-42e813e93054 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa2e2a5a6ed4c5c9db91269266dd30b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f46ab11dd0b428486c673afc14b5b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:37:45.232396 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-a0c6ec4c-4235-4f1b-9329-42e813e93054 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] 10.222.0.121 "GET /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b" status: 200 len: 1724 microversion: 2.1 time: 0.267243 Aug 04 10:37:45.233012 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 288/560] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:37:44 2022] GET /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b => generated 1724 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:37:46.255564 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-95c1ccb2-b11e-40ea-9f8b-908c496979df tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:37:46.261269 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-95c1ccb2-b11e-40ea-9f8b-908c496979df tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] [instance: 81259012-5f3b-44f6-b979-39119f14929b] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:37:46.265387 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-95c1ccb2-b11e-40ea-9f8b-908c496979df tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:37:46.265964 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-95c1ccb2-b11e-40ea-9f8b-908c496979df tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:37:46.266988 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-95c1ccb2-b11e-40ea-9f8b-908c496979df tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:37:46.267305 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-95c1ccb2-b11e-40ea-9f8b-908c496979df tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:37:46.440703 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-95c1ccb2-b11e-40ea-9f8b-908c496979df tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa2e2a5a6ed4c5c9db91269266dd30b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f46ab11dd0b428486c673afc14b5b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:37:46.450699 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-95c1ccb2-b11e-40ea-9f8b-908c496979df tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] 10.222.0.121 "GET /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b" status: 200 len: 1724 microversion: 2.1 time: 0.199535 Aug 04 10:37:46.451377 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 273/561] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:37:46 2022] GET /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b => generated 1724 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:37:47.474057 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-b1a5990b-48a4-4ff5-85d3-39361f30b761 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:37:47.474757 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-b1a5990b-48a4-4ff5-85d3-39361f30b761 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] [instance: 81259012-5f3b-44f6-b979-39119f14929b] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:37:47.483117 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-b1a5990b-48a4-4ff5-85d3-39361f30b761 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:37:47.483565 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-b1a5990b-48a4-4ff5-85d3-39361f30b761 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:37:47.484422 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-b1a5990b-48a4-4ff5-85d3-39361f30b761 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:37:47.484869 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-b1a5990b-48a4-4ff5-85d3-39361f30b761 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:37:47.722614 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-b1a5990b-48a4-4ff5-85d3-39361f30b761 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa2e2a5a6ed4c5c9db91269266dd30b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f46ab11dd0b428486c673afc14b5b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:37:47.732966 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-b1a5990b-48a4-4ff5-85d3-39361f30b761 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] 10.222.0.121 "GET /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b" status: 200 len: 1724 microversion: 2.1 time: 0.263795 Aug 04 10:37:47.733788 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 289/562] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:37:47 2022] GET /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b => generated 1724 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:37:48.755870 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-a708fd1b-5a07-4e92-961e-c7c16a8b9840 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:37:48.756521 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-a708fd1b-5a07-4e92-961e-c7c16a8b9840 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] [instance: 81259012-5f3b-44f6-b979-39119f14929b] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:37:48.765013 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-a708fd1b-5a07-4e92-961e-c7c16a8b9840 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:37:48.765458 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-a708fd1b-5a07-4e92-961e-c7c16a8b9840 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:37:48.766323 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-a708fd1b-5a07-4e92-961e-c7c16a8b9840 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:37:48.766804 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-a708fd1b-5a07-4e92-961e-c7c16a8b9840 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:37:48.927368 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-a708fd1b-5a07-4e92-961e-c7c16a8b9840 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa2e2a5a6ed4c5c9db91269266dd30b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f46ab11dd0b428486c673afc14b5b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:37:48.937222 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-a708fd1b-5a07-4e92-961e-c7c16a8b9840 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] 10.222.0.121 "GET /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b" status: 200 len: 1724 microversion: 2.1 time: 0.185658 Aug 04 10:37:48.937829 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 274/563] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:37:48 2022] GET /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b => generated 1724 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:37:49.756871 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-d1ae91bb-e44c-40ef-a51d-ee10c646bb20 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "907136af-75bf-42d1-a0e3-c0d359ff022a", "device": "/dev/sdb"}} {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:37:49.762449 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-d1ae91bb-e44c-40ef-a51d-ee10c646bb20 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] [instance: c0b1b05c-6675-4224-8158-caf89589f2db] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:37:49.774034 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-d1ae91bb-e44c-40ef-a51d-ee10c646bb20 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:37:49.774895 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-d1ae91bb-e44c-40ef-a51d-ee10c646bb20 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:37:49.776303 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-d1ae91bb-e44c-40ef-a51d-ee10c646bb20 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:37:49.777061 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-d1ae91bb-e44c-40ef-a51d-ee10c646bb20 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:37:50.107356 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-cce541af-be15-4e14-9085-fd37770206a8 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:37:50.108133 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-cce541af-be15-4e14-9085-fd37770206a8 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] [instance: 81259012-5f3b-44f6-b979-39119f14929b] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:37:50.115448 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-cce541af-be15-4e14-9085-fd37770206a8 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:37:50.116453 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-cce541af-be15-4e14-9085-fd37770206a8 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:37:50.117296 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-cce541af-be15-4e14-9085-fd37770206a8 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:37:50.117738 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-cce541af-be15-4e14-9085-fd37770206a8 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:37:50.215678 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-d1ae91bb-e44c-40ef-a51d-ee10c646bb20 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] 10.222.0.121 "POST /compute/v2.1/servers/c0b1b05c-6675-4224-8158-caf89589f2db/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.467015 Aug 04 10:37:50.220563 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 290/564] 10.222.0.121 () {60 vars in 1328 bytes} [Thu Aug 4 10:37:49 2022] POST /compute/v2.1/servers/c0b1b05c-6675-4224-8158-caf89589f2db/os-volume_attachments => generated 194 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:37:50.316708 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-cce541af-be15-4e14-9085-fd37770206a8 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa2e2a5a6ed4c5c9db91269266dd30b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f46ab11dd0b428486c673afc14b5b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:37:50.326541 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-cce541af-be15-4e14-9085-fd37770206a8 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] 10.222.0.121 "GET /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b" status: 200 len: 1724 microversion: 2.1 time: 0.367079 Aug 04 10:37:50.327409 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 275/565] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:37:49 2022] GET /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b => generated 1724 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 10:37:51.189171 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-ae9daad2-ca9d-41e4-a218-c8488718baa8 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Action: 'create', calling method: .version_select at 0x7f675576c040>, body: {"keypair": {"name": "tempest-keypair-1621578010", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDvq/N647bGK+QD28lAGHTkj88BZZYS5P0oz5mxr83Genq7gKL9oP6arOkq4yWLiwH7rc13QoZAwNqMv1CcpdoZC6ucKzI2f6clPYbaYT+kjIX7DaPLF4WtJdI2+hmr7FQ=="}} {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:37:51.214049 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.quota [None req-ae9daad2-ca9d-41e4-a218-c8488718baa8 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Getting quotas for project 051b6a3defca48d7b4f8bb6705f89f20. Resources: {'key_pairs'} {{(pid=124457) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 10:37:51.219080 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.quota [None req-ae9daad2-ca9d-41e4-a218-c8488718baa8 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Getting quotas for user 41a38b5af1654f44bc6cb5832c2e8e87 and project 051b6a3defca48d7b4f8bb6705f89f20. Resources: {'key_pairs'} {{(pid=124457) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 10:37:51.266772 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-ae9daad2-ca9d-41e4-a218-c8488718baa8 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] 10.222.0.121 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.084321 Aug 04 10:37:51.267452 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 291/566] 10.222.0.121 () {60 vars in 1164 bytes} [Thu Aug 4 10:37:51 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 10:37:51.354094 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-f4016602-f021-44c9-b49e-b48fba46e8dc tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:37:51.357372 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-f4016602-f021-44c9-b49e-b48fba46e8dc tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] [instance: 81259012-5f3b-44f6-b979-39119f14929b] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:37:51.369171 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG dbcounter [-] [124456] Writing DB stats nova_api:SELECT=24,nova_api:INSERT=1 {{(pid=124456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:37:51.372301 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-f4016602-f021-44c9-b49e-b48fba46e8dc tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:37:51.372997 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-f4016602-f021-44c9-b49e-b48fba46e8dc tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:37:51.374486 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-f4016602-f021-44c9-b49e-b48fba46e8dc tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:37:51.375301 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-f4016602-f021-44c9-b49e-b48fba46e8dc tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:37:51.385186 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG dbcounter [-] [124456] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:37:51.612985 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-f4016602-f021-44c9-b49e-b48fba46e8dc tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa2e2a5a6ed4c5c9db91269266dd30b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f46ab11dd0b428486c673afc14b5b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:37:51.627967 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-f4016602-f021-44c9-b49e-b48fba46e8dc tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] 10.222.0.121 "GET /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b" status: 200 len: 1724 microversion: 2.1 time: 0.281636 Aug 04 10:37:51.629145 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 276/567] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:37:51 2022] GET /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b => generated 1724 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:37:52.663418 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-2494aa9b-98dd-4195-b72c-a02ac99c3b66 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:37:52.664358 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-2494aa9b-98dd-4195-b72c-a02ac99c3b66 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] [instance: 81259012-5f3b-44f6-b979-39119f14929b] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:37:52.673301 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-2494aa9b-98dd-4195-b72c-a02ac99c3b66 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:37:52.673860 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-2494aa9b-98dd-4195-b72c-a02ac99c3b66 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:37:52.674690 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-2494aa9b-98dd-4195-b72c-a02ac99c3b66 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:37:52.675122 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-2494aa9b-98dd-4195-b72c-a02ac99c3b66 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:37:52.847749 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-2494aa9b-98dd-4195-b72c-a02ac99c3b66 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa2e2a5a6ed4c5c9db91269266dd30b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f46ab11dd0b428486c673afc14b5b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:37:52.857882 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-2494aa9b-98dd-4195-b72c-a02ac99c3b66 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] 10.222.0.121 "GET /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b" status: 200 len: 1724 microversion: 2.1 time: 0.198571 Aug 04 10:37:52.859369 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 292/568] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:37:52 2022] GET /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b => generated 1724 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:37:52.882850 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-ca06ec2d-94d8-4bff-8746-9b293caf282b tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-324430157", "imageRef": "46724bb5-955f-4f3f-bd6a-b561fdde55e3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ddbd5a12-fb68-4b76-a245-c2162d57f8f9"}], "security_groups": [{"name": "tempest-securitygroup--1243174700"}], "key_name": "tempest-keypair-1621578010", "user_data": "}} {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:37:52.998695 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.network.neutron [None req-ca06ec2d-94d8-4bff-8746-9b293caf282b tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] validate_networks() for [('ddbd5a12-fb68-4b76-a245-c2162d57f8f9', None, None, None, None, None)] {{(pid=124456) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 10:37:53.439248 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.virt.hardware [None req-ca06ec2d-94d8-4bff-8746-9b293caf282b tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Flavor limits 0:0:0 {{(pid=124456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 10:37:53.439811 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.virt.hardware [None req-ca06ec2d-94d8-4bff-8746-9b293caf282b tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Image limits 0:0:0 {{(pid=124456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 10:37:53.440427 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.virt.hardware [None req-ca06ec2d-94d8-4bff-8746-9b293caf282b tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Flavor pref 0:0:0 {{(pid=124456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 10:37:53.440921 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.virt.hardware [None req-ca06ec2d-94d8-4bff-8746-9b293caf282b tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Image pref 0:0:0 {{(pid=124456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 10:37:53.441429 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.virt.hardware [None req-ca06ec2d-94d8-4bff-8746-9b293caf282b tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 10:37:53.451595 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-ca06ec2d-94d8-4bff-8746-9b293caf282b tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:37:53.452081 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-ca06ec2d-94d8-4bff-8746-9b293caf282b tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:37:53.452904 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-ca06ec2d-94d8-4bff-8746-9b293caf282b tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:37:53.453352 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-ca06ec2d-94d8-4bff-8746-9b293caf282b tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:37:53.471351 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.quota [None req-ca06ec2d-94d8-4bff-8746-9b293caf282b tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Getting quotas for project 051b6a3defca48d7b4f8bb6705f89f20. Resources: {'ram', 'instances', 'cores'} {{(pid=124456) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 10:37:53.475802 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.quota [None req-ca06ec2d-94d8-4bff-8746-9b293caf282b tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Getting quotas for user 41a38b5af1654f44bc6cb5832c2e8e87 and project 051b6a3defca48d7b4f8bb6705f89f20. Resources: {'ram', 'instances', 'cores'} {{(pid=124456) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 10:37:53.488296 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-ca06ec2d-94d8-4bff-8746-9b293caf282b tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Going to run 1 instances... {{(pid=124456) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 10:37:53.490651 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-ca06ec2d-94d8-4bff-8746-9b293caf282b tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] [instance: 8534737c-8a94-4755-ba3c-021132edace6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='46724bb5-955f-4f3f-bd6a-b561fdde55e3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124456) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 10:37:53.549305 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-ca06ec2d-94d8-4bff-8746-9b293caf282b tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] 10.222.0.121 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.670804 Aug 04 10:37:53.550319 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 277/569] 10.222.0.121 () {60 vars in 1152 bytes} [Thu Aug 4 10:37:52 2022] POST /compute/v2.1/servers => generated 404 bytes in 673 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 04 10:37:53.564442 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-e0516baa-c15e-4eb5-8174-e5ad732d2584 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:37:53.565554 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-e0516baa-c15e-4eb5-8174-e5ad732d2584 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] [instance: 8534737c-8a94-4755-ba3c-021132edace6] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:37:53.623544 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-e0516baa-c15e-4eb5-8174-e5ad732d2584 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a38b5af1654f44bc6cb5832c2e8e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051b6a3defca48d7b4f8bb6705f89f20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:37:53.631050 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-e0516baa-c15e-4eb5-8174-e5ad732d2584 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] 10.222.0.121 "GET /compute/v2.1/servers/8534737c-8a94-4755-ba3c-021132edace6" status: 200 len: 1245 microversion: 2.1 time: 0.070883 Aug 04 10:37:53.631968 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 293/570] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:37:53 2022] GET /compute/v2.1/servers/8534737c-8a94-4755-ba3c-021132edace6 => generated 1245 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:37:53.883059 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-bedf2dec-73bb-4631-8527-d0360936ac78 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:37:53.883805 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-bedf2dec-73bb-4631-8527-d0360936ac78 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] [instance: 81259012-5f3b-44f6-b979-39119f14929b] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:37:53.893581 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-bedf2dec-73bb-4631-8527-d0360936ac78 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:37:53.894020 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-bedf2dec-73bb-4631-8527-d0360936ac78 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:37:53.895173 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-bedf2dec-73bb-4631-8527-d0360936ac78 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:37:53.895658 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-bedf2dec-73bb-4631-8527-d0360936ac78 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:37:54.081017 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-bedf2dec-73bb-4631-8527-d0360936ac78 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa2e2a5a6ed4c5c9db91269266dd30b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f46ab11dd0b428486c673afc14b5b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:37:54.091617 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-bedf2dec-73bb-4631-8527-d0360936ac78 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] 10.222.0.121 "GET /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b" status: 200 len: 1724 microversion: 2.1 time: 0.213438 Aug 04 10:37:54.092349 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 278/571] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:37:53 2022] GET /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b => generated 1724 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 10:37:54.653100 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-42a5511c-de3d-4e3c-b95f-49d1608a4e39 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:37:54.654208 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-42a5511c-de3d-4e3c-b95f-49d1608a4e39 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] [instance: 8534737c-8a94-4755-ba3c-021132edace6] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:37:54.663982 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-42a5511c-de3d-4e3c-b95f-49d1608a4e39 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:37:54.664486 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-42a5511c-de3d-4e3c-b95f-49d1608a4e39 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:37:54.665309 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-42a5511c-de3d-4e3c-b95f-49d1608a4e39 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:37:54.665772 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-42a5511c-de3d-4e3c-b95f-49d1608a4e39 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:37:54.758541 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-42a5511c-de3d-4e3c-b95f-49d1608a4e39 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a38b5af1654f44bc6cb5832c2e8e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051b6a3defca48d7b4f8bb6705f89f20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:37:54.768383 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-42a5511c-de3d-4e3c-b95f-49d1608a4e39 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] 10.222.0.121 "GET /compute/v2.1/servers/8534737c-8a94-4755-ba3c-021132edace6" status: 200 len: 1297 microversion: 2.1 time: 0.118977 Aug 04 10:37:54.769034 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 294/572] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:37:54 2022] GET /compute/v2.1/servers/8534737c-8a94-4755-ba3c-021132edace6 => generated 1297 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:37:55.115638 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-98257c9b-4907-4c53-8db6-a4839be75c06 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:37:55.116547 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-98257c9b-4907-4c53-8db6-a4839be75c06 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] [instance: 81259012-5f3b-44f6-b979-39119f14929b] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:37:55.124278 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-98257c9b-4907-4c53-8db6-a4839be75c06 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:37:55.124753 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-98257c9b-4907-4c53-8db6-a4839be75c06 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:37:55.125611 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-98257c9b-4907-4c53-8db6-a4839be75c06 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:37:55.126051 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-98257c9b-4907-4c53-8db6-a4839be75c06 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:37:55.366501 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-98257c9b-4907-4c53-8db6-a4839be75c06 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa2e2a5a6ed4c5c9db91269266dd30b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f46ab11dd0b428486c673afc14b5b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:37:55.375447 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-98257c9b-4907-4c53-8db6-a4839be75c06 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] 10.222.0.121 "GET /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b" status: 200 len: 1724 microversion: 2.1 time: 0.264213 Aug 04 10:37:55.376299 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 279/573] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:37:55 2022] GET /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b => generated 1724 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:37:55.796524 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-5aef8ab7-82e5-4256-998a-f6eccaf0d68e tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:37:55.798579 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-5aef8ab7-82e5-4256-998a-f6eccaf0d68e tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] [instance: 8534737c-8a94-4755-ba3c-021132edace6] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:37:55.807306 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-5aef8ab7-82e5-4256-998a-f6eccaf0d68e tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:37:55.807648 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-5aef8ab7-82e5-4256-998a-f6eccaf0d68e tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:37:55.808695 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-5aef8ab7-82e5-4256-998a-f6eccaf0d68e tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:37:55.809139 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-5aef8ab7-82e5-4256-998a-f6eccaf0d68e tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:37:56.386433 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-5aef8ab7-82e5-4256-998a-f6eccaf0d68e tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a38b5af1654f44bc6cb5832c2e8e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051b6a3defca48d7b4f8bb6705f89f20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:37:56.394920 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-5aef8ab7-82e5-4256-998a-f6eccaf0d68e tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] 10.222.0.121 "GET /compute/v2.1/servers/8534737c-8a94-4755-ba3c-021132edace6" status: 200 len: 1371 microversion: 2.1 time: 0.607901 Aug 04 10:37:56.395538 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 295/574] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:37:55 2022] GET /compute/v2.1/servers/8534737c-8a94-4755-ba3c-021132edace6 => generated 1371 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:37:56.408173 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-106f0d1e-044a-4251-ae43-1d5de2ac696c tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:37:56.408831 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-106f0d1e-044a-4251-ae43-1d5de2ac696c tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] [instance: 81259012-5f3b-44f6-b979-39119f14929b] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:37:56.423404 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-106f0d1e-044a-4251-ae43-1d5de2ac696c tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:37:56.424076 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-106f0d1e-044a-4251-ae43-1d5de2ac696c tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:37:56.425748 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-106f0d1e-044a-4251-ae43-1d5de2ac696c tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:37:56.426599 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-106f0d1e-044a-4251-ae43-1d5de2ac696c tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:37:56.725436 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-106f0d1e-044a-4251-ae43-1d5de2ac696c tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa2e2a5a6ed4c5c9db91269266dd30b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f46ab11dd0b428486c673afc14b5b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:37:56.738326 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-106f0d1e-044a-4251-ae43-1d5de2ac696c tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] 10.222.0.121 "GET /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b" status: 200 len: 1724 microversion: 2.1 time: 0.343216 Aug 04 10:37:56.739441 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 280/575] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:37:56 2022] GET /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b => generated 1724 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:37:57.147555 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [req-2f6a4d26-0e93-45aa-a118-d4962c81a0b5 req-814b7e6a-5f19-4563-be64-51a7654d0d99 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8534737c-8a94-4755-ba3c-021132edace6", "tag": "5e2a8967-749e-4b17-b392-9ccf6a550b05"}]} {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:37:57.169854 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [req-2f6a4d26-0e93-45aa-a118-d4962c81a0b5 req-814b7e6a-5f19-4563-be64-51a7654d0d99 service nova] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:37:57.170615 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [req-2f6a4d26-0e93-45aa-a118-d4962c81a0b5 req-814b7e6a-5f19-4563-be64-51a7654d0d99 service nova] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:37:57.190370 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.compute.server_external_events [req-2f6a4d26-0e93-45aa-a118-d4962c81a0b5 req-814b7e6a-5f19-4563-be64-51a7654d0d99 service nova] Creating event network-changed:5e2a8967-749e-4b17-b392-9ccf6a550b05 for instance 8534737c-8a94-4755-ba3c-021132edace6 on hv-cinder-85200 Aug 04 10:37:57.197895 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [req-2f6a4d26-0e93-45aa-a118-d4962c81a0b5 req-814b7e6a-5f19-4563-be64-51a7654d0d99 service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054275 Aug 04 10:37:57.199106 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 296/576] 10.222.0.121 () {64 vars in 1322 bytes} [Thu Aug 4 10:37:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:37:57.498917 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-47e19fbb-8dd4-4237-94c5-1472cc9e28f4 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:37:57.499577 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-47e19fbb-8dd4-4237-94c5-1472cc9e28f4 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] [instance: 8534737c-8a94-4755-ba3c-021132edace6] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:37:57.507490 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-47e19fbb-8dd4-4237-94c5-1472cc9e28f4 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:37:57.508713 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-47e19fbb-8dd4-4237-94c5-1472cc9e28f4 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:37:57.509033 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-47e19fbb-8dd4-4237-94c5-1472cc9e28f4 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:37:57.509212 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-47e19fbb-8dd4-4237-94c5-1472cc9e28f4 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:37:57.682181 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-47e19fbb-8dd4-4237-94c5-1472cc9e28f4 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a38b5af1654f44bc6cb5832c2e8e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051b6a3defca48d7b4f8bb6705f89f20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:37:57.690718 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-47e19fbb-8dd4-4237-94c5-1472cc9e28f4 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] 10.222.0.121 "GET /compute/v2.1/servers/8534737c-8a94-4755-ba3c-021132edace6" status: 200 len: 1371 microversion: 2.1 time: 0.267525 Aug 04 10:37:57.691345 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 281/577] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:37:57 2022] GET /compute/v2.1/servers/8534737c-8a94-4755-ba3c-021132edace6 => generated 1371 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:37:57.775891 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-2c47f384-51fd-44c9-a31f-45a300e483e4 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:37:57.776674 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-2c47f384-51fd-44c9-a31f-45a300e483e4 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] [instance: 81259012-5f3b-44f6-b979-39119f14929b] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:37:57.785151 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-2c47f384-51fd-44c9-a31f-45a300e483e4 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:37:57.785603 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-2c47f384-51fd-44c9-a31f-45a300e483e4 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:37:57.786416 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-2c47f384-51fd-44c9-a31f-45a300e483e4 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:37:57.786859 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-2c47f384-51fd-44c9-a31f-45a300e483e4 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:37:58.006207 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-2c47f384-51fd-44c9-a31f-45a300e483e4 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa2e2a5a6ed4c5c9db91269266dd30b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f46ab11dd0b428486c673afc14b5b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:37:58.015123 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-2c47f384-51fd-44c9-a31f-45a300e483e4 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] 10.222.0.121 "GET /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b" status: 200 len: 1724 microversion: 2.1 time: 0.244646 Aug 04 10:37:58.015750 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 297/578] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:37:57 2022] GET /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b => generated 1724 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:37:58.715591 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-9c1f43ce-0a14-4ad2-8966-ae8ebaa54add tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:37:58.716753 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-9c1f43ce-0a14-4ad2-8966-ae8ebaa54add tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] [instance: 8534737c-8a94-4755-ba3c-021132edace6] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:37:58.726866 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-9c1f43ce-0a14-4ad2-8966-ae8ebaa54add tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:37:58.727266 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-9c1f43ce-0a14-4ad2-8966-ae8ebaa54add tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:37:58.728219 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-9c1f43ce-0a14-4ad2-8966-ae8ebaa54add tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:37:58.728493 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-9c1f43ce-0a14-4ad2-8966-ae8ebaa54add tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:37:58.985104 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-9c1f43ce-0a14-4ad2-8966-ae8ebaa54add tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a38b5af1654f44bc6cb5832c2e8e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051b6a3defca48d7b4f8bb6705f89f20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:37:59.002436 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-9c1f43ce-0a14-4ad2-8966-ae8ebaa54add tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] 10.222.0.121 "GET /compute/v2.1/servers/8534737c-8a94-4755-ba3c-021132edace6" status: 200 len: 1371 microversion: 2.1 time: 0.290843 Aug 04 10:37:59.006483 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 282/579] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:37:58 2022] GET /compute/v2.1/servers/8534737c-8a94-4755-ba3c-021132edace6 => generated 1371 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:37:59.037942 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-58b99a93-66bc-45f3-b739-c202e6e12499 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:37:59.038836 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-58b99a93-66bc-45f3-b739-c202e6e12499 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] [instance: 81259012-5f3b-44f6-b979-39119f14929b] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:37:59.041395 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG dbcounter [-] [124457] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=1 {{(pid=124457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:37:59.061182 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-58b99a93-66bc-45f3-b739-c202e6e12499 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:37:59.061634 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-58b99a93-66bc-45f3-b739-c202e6e12499 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:37:59.062497 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-58b99a93-66bc-45f3-b739-c202e6e12499 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:37:59.062956 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-58b99a93-66bc-45f3-b739-c202e6e12499 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:37:59.078772 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG dbcounter [-] [124457] Writing DB stats nova_cell1:SELECT=75,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=124457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:37:59.373631 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-58b99a93-66bc-45f3-b739-c202e6e12499 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa2e2a5a6ed4c5c9db91269266dd30b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f46ab11dd0b428486c673afc14b5b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:37:59.388846 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-58b99a93-66bc-45f3-b739-c202e6e12499 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] 10.222.0.121 "GET /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b" status: 200 len: 1701 microversion: 2.1 time: 0.354761 Aug 04 10:37:59.389982 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 298/580] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:37:59 2022] GET /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b => generated 1701 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:37:59.421617 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-365a0313-81a3-4957-9e96-2680fa5933b6 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:37:59.429301 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-365a0313-81a3-4957-9e96-2680fa5933b6 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:37:59.430132 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-365a0313-81a3-4957-9e96-2680fa5933b6 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:37:59.503141 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-365a0313-81a3-4957-9e96-2680fa5933b6 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] [instance: 81259012-5f3b-44f6-b979-39119f14929b] Going to try to start instance {{(pid=124456) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 04 10:37:59.570351 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-365a0313-81a3-4957-9e96-2680fa5933b6 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] 10.222.0.121 "POST /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b/action" status: 202 len: 0 microversion: 2.1 time: 0.152644 Aug 04 10:37:59.571006 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 283/581] 10.222.0.121 () {60 vars in 1283 bytes} [Thu Aug 4 10:37:59 2022] POST /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b/action => generated 0 bytes in 154 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 10:37:59.582199 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-32af87d1-4afe-4434-bb64-00b8070f836b tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:37:59.583166 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-32af87d1-4afe-4434-bb64-00b8070f836b tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] [instance: 81259012-5f3b-44f6-b979-39119f14929b] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:37:59.592637 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-32af87d1-4afe-4434-bb64-00b8070f836b tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:37:59.593104 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-32af87d1-4afe-4434-bb64-00b8070f836b tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:37:59.593908 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-32af87d1-4afe-4434-bb64-00b8070f836b tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:37:59.594355 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-32af87d1-4afe-4434-bb64-00b8070f836b tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:37:59.745409 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-32af87d1-4afe-4434-bb64-00b8070f836b tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa2e2a5a6ed4c5c9db91269266dd30b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f46ab11dd0b428486c673afc14b5b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:37:59.754019 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-32af87d1-4afe-4434-bb64-00b8070f836b tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] 10.222.0.121 "GET /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b" status: 200 len: 1710 microversion: 2.1 time: 0.177628 Aug 04 10:37:59.754744 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 299/582] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:37:59 2022] GET /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b => generated 1710 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:38:00.032291 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-23164dbd-e52f-420c-b3cc-f8d1c75345e8 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:38:00.032960 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-23164dbd-e52f-420c-b3cc-f8d1c75345e8 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] [instance: 8534737c-8a94-4755-ba3c-021132edace6] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:38:00.040855 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-23164dbd-e52f-420c-b3cc-f8d1c75345e8 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:38:00.041380 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-23164dbd-e52f-420c-b3cc-f8d1c75345e8 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:38:00.042175 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-23164dbd-e52f-420c-b3cc-f8d1c75345e8 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:38:00.042627 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-23164dbd-e52f-420c-b3cc-f8d1c75345e8 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:38:00.204933 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-23164dbd-e52f-420c-b3cc-f8d1c75345e8 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a38b5af1654f44bc6cb5832c2e8e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051b6a3defca48d7b4f8bb6705f89f20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:38:00.213542 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-23164dbd-e52f-420c-b3cc-f8d1c75345e8 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] 10.222.0.121 "GET /compute/v2.1/servers/8534737c-8a94-4755-ba3c-021132edace6" status: 200 len: 1371 microversion: 2.1 time: 0.186577 Aug 04 10:38:00.214141 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 284/583] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:38:00 2022] GET /compute/v2.1/servers/8534737c-8a94-4755-ba3c-021132edace6 => generated 1371 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:38:00.775521 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-b9d00c7c-b679-4596-823d-6f28f1115a78 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:38:00.776167 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-b9d00c7c-b679-4596-823d-6f28f1115a78 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] [instance: 81259012-5f3b-44f6-b979-39119f14929b] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:38:00.784730 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-b9d00c7c-b679-4596-823d-6f28f1115a78 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:38:00.785288 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-b9d00c7c-b679-4596-823d-6f28f1115a78 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:38:00.786472 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-b9d00c7c-b679-4596-823d-6f28f1115a78 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:38:00.786946 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-b9d00c7c-b679-4596-823d-6f28f1115a78 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:38:00.952129 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-b9d00c7c-b679-4596-823d-6f28f1115a78 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa2e2a5a6ed4c5c9db91269266dd30b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f46ab11dd0b428486c673afc14b5b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:38:00.960636 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-b9d00c7c-b679-4596-823d-6f28f1115a78 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] 10.222.0.121 "GET /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b" status: 200 len: 1710 microversion: 2.1 time: 0.189425 Aug 04 10:38:00.961276 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 300/584] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:38:00 2022] GET /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b => generated 1710 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:38:01.236637 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-aa253fc0-5cbe-41c5-8c32-9830600a0711 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:38:01.237328 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-aa253fc0-5cbe-41c5-8c32-9830600a0711 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] [instance: 8534737c-8a94-4755-ba3c-021132edace6] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:38:01.244829 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-aa253fc0-5cbe-41c5-8c32-9830600a0711 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:38:01.245296 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-aa253fc0-5cbe-41c5-8c32-9830600a0711 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:38:01.246097 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-aa253fc0-5cbe-41c5-8c32-9830600a0711 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:38:01.246531 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-aa253fc0-5cbe-41c5-8c32-9830600a0711 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:38:01.401000 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-aa253fc0-5cbe-41c5-8c32-9830600a0711 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a38b5af1654f44bc6cb5832c2e8e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051b6a3defca48d7b4f8bb6705f89f20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:38:01.412627 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-aa253fc0-5cbe-41c5-8c32-9830600a0711 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] 10.222.0.121 "GET /compute/v2.1/servers/8534737c-8a94-4755-ba3c-021132edace6" status: 200 len: 1371 microversion: 2.1 time: 0.179395 Aug 04 10:38:01.412627 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 285/585] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:38:01 2022] GET /compute/v2.1/servers/8534737c-8a94-4755-ba3c-021132edace6 => generated 1371 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:38:01.983026 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-81344caf-9b96-4223-a57a-5fb5cbbd7b8d tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:38:01.983829 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-81344caf-9b96-4223-a57a-5fb5cbbd7b8d tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] [instance: 81259012-5f3b-44f6-b979-39119f14929b] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:38:01.991178 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-81344caf-9b96-4223-a57a-5fb5cbbd7b8d tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:38:01.991628 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-81344caf-9b96-4223-a57a-5fb5cbbd7b8d tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:38:01.992472 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-81344caf-9b96-4223-a57a-5fb5cbbd7b8d tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:38:01.992913 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-81344caf-9b96-4223-a57a-5fb5cbbd7b8d tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:38:02.158027 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-81344caf-9b96-4223-a57a-5fb5cbbd7b8d tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa2e2a5a6ed4c5c9db91269266dd30b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f46ab11dd0b428486c673afc14b5b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:38:02.169663 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-81344caf-9b96-4223-a57a-5fb5cbbd7b8d tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] 10.222.0.121 "GET /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b" status: 200 len: 1710 microversion: 2.1 time: 0.190593 Aug 04 10:38:02.170725 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 301/586] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:38:01 2022] GET /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b => generated 1710 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:38:02.435718 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-5adbbd07-f0a4-469b-bd55-b9d722a5aa4b tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:38:02.436459 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-5adbbd07-f0a4-469b-bd55-b9d722a5aa4b tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] [instance: 8534737c-8a94-4755-ba3c-021132edace6] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:38:02.446330 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-5adbbd07-f0a4-469b-bd55-b9d722a5aa4b tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:38:02.446784 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-5adbbd07-f0a4-469b-bd55-b9d722a5aa4b tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:38:02.447605 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-5adbbd07-f0a4-469b-bd55-b9d722a5aa4b tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:38:02.448689 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-5adbbd07-f0a4-469b-bd55-b9d722a5aa4b tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:38:02.634580 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-5adbbd07-f0a4-469b-bd55-b9d722a5aa4b tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a38b5af1654f44bc6cb5832c2e8e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051b6a3defca48d7b4f8bb6705f89f20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:38:02.643725 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-5adbbd07-f0a4-469b-bd55-b9d722a5aa4b tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] 10.222.0.121 "GET /compute/v2.1/servers/8534737c-8a94-4755-ba3c-021132edace6" status: 200 len: 1371 microversion: 2.1 time: 0.213330 Aug 04 10:38:02.644385 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 286/587] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:38:02 2022] GET /compute/v2.1/servers/8534737c-8a94-4755-ba3c-021132edace6 => generated 1371 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:38:03.193102 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-964ec287-31df-4815-ada2-f67562a92f4d tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:38:03.193829 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-964ec287-31df-4815-ada2-f67562a92f4d tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] [instance: 81259012-5f3b-44f6-b979-39119f14929b] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:38:03.204467 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-964ec287-31df-4815-ada2-f67562a92f4d tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:38:03.204997 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-964ec287-31df-4815-ada2-f67562a92f4d tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:38:03.205917 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-964ec287-31df-4815-ada2-f67562a92f4d tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:38:03.206530 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-964ec287-31df-4815-ada2-f67562a92f4d tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:38:03.368780 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-964ec287-31df-4815-ada2-f67562a92f4d tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa2e2a5a6ed4c5c9db91269266dd30b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f46ab11dd0b428486c673afc14b5b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:38:03.378784 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-964ec287-31df-4815-ada2-f67562a92f4d tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] 10.222.0.121 "GET /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b" status: 200 len: 1710 microversion: 2.1 time: 0.190216 Aug 04 10:38:03.379811 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 302/588] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:38:03 2022] GET /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b => generated 1710 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:38:03.663228 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG dbcounter [-] [124456] Writing DB stats nova_cell0:SELECT=2 {{(pid=124456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:38:03.664088 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG dbcounter [-] [124456] Writing DB stats nova_cell0:SELECT=6 {{(pid=124456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:38:03.668104 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-b78350be-aa04-4bc1-8998-4224d2108df5 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:38:03.668803 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-b78350be-aa04-4bc1-8998-4224d2108df5 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] [instance: 8534737c-8a94-4755-ba3c-021132edace6] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:38:03.676885 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-b78350be-aa04-4bc1-8998-4224d2108df5 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:38:03.677336 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-b78350be-aa04-4bc1-8998-4224d2108df5 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:38:03.678304 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-b78350be-aa04-4bc1-8998-4224d2108df5 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:38:03.678731 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-b78350be-aa04-4bc1-8998-4224d2108df5 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:38:03.828150 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-b78350be-aa04-4bc1-8998-4224d2108df5 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a38b5af1654f44bc6cb5832c2e8e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051b6a3defca48d7b4f8bb6705f89f20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:38:03.837621 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-b78350be-aa04-4bc1-8998-4224d2108df5 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] 10.222.0.121 "GET /compute/v2.1/servers/8534737c-8a94-4755-ba3c-021132edace6" status: 200 len: 1371 microversion: 2.1 time: 0.174925 Aug 04 10:38:03.838641 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 287/589] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:38:03 2022] GET /compute/v2.1/servers/8534737c-8a94-4755-ba3c-021132edace6 => generated 1371 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:38:04.402964 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-3269a847-8214-4b54-86b4-62e110364a33 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:38:04.403674 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-3269a847-8214-4b54-86b4-62e110364a33 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] [instance: 81259012-5f3b-44f6-b979-39119f14929b] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:38:04.405986 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG dbcounter [-] [124457] Writing DB stats nova_cell0:SELECT=6 {{(pid=124457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:38:04.416640 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-3269a847-8214-4b54-86b4-62e110364a33 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:38:04.417600 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-3269a847-8214-4b54-86b4-62e110364a33 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:38:04.418794 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-3269a847-8214-4b54-86b4-62e110364a33 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:38:04.418913 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-3269a847-8214-4b54-86b4-62e110364a33 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:38:04.583879 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-3269a847-8214-4b54-86b4-62e110364a33 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa2e2a5a6ed4c5c9db91269266dd30b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f46ab11dd0b428486c673afc14b5b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:38:04.592604 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-3269a847-8214-4b54-86b4-62e110364a33 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] 10.222.0.121 "GET /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b" status: 200 len: 1710 microversion: 2.1 time: 0.196285 Aug 04 10:38:04.593209 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 303/590] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:38:04 2022] GET /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b => generated 1710 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:38:04.656343 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 10:38:04.656752 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: Thu Aug 4 10:38:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 10:38:04.862376 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-fd1d9d51-f5a5-4e0b-b82f-ff317b81cd4e tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:38:04.863187 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-fd1d9d51-f5a5-4e0b-b82f-ff317b81cd4e tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] [instance: 8534737c-8a94-4755-ba3c-021132edace6] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:38:04.870609 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-fd1d9d51-f5a5-4e0b-b82f-ff317b81cd4e tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:38:04.871073 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-fd1d9d51-f5a5-4e0b-b82f-ff317b81cd4e tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:38:04.871909 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-fd1d9d51-f5a5-4e0b-b82f-ff317b81cd4e tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:38:04.872487 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-fd1d9d51-f5a5-4e0b-b82f-ff317b81cd4e tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:38:05.032490 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-fd1d9d51-f5a5-4e0b-b82f-ff317b81cd4e tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a38b5af1654f44bc6cb5832c2e8e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051b6a3defca48d7b4f8bb6705f89f20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:38:05.040412 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-fd1d9d51-f5a5-4e0b-b82f-ff317b81cd4e tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] 10.222.0.121 "GET /compute/v2.1/servers/8534737c-8a94-4755-ba3c-021132edace6" status: 200 len: 1371 microversion: 2.1 time: 0.182990 Aug 04 10:38:05.041012 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 288/591] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:38:04 2022] GET /compute/v2.1/servers/8534737c-8a94-4755-ba3c-021132edace6 => generated 1371 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 10:38:05.614974 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-737465b7-f0b2-434a-8e02-094201236597 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:38:05.615719 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-737465b7-f0b2-434a-8e02-094201236597 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] [instance: 81259012-5f3b-44f6-b979-39119f14929b] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:38:05.623335 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-737465b7-f0b2-434a-8e02-094201236597 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:38:05.623796 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-737465b7-f0b2-434a-8e02-094201236597 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:38:05.624722 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-737465b7-f0b2-434a-8e02-094201236597 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:38:05.625159 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-737465b7-f0b2-434a-8e02-094201236597 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:38:05.807660 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-737465b7-f0b2-434a-8e02-094201236597 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa2e2a5a6ed4c5c9db91269266dd30b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f46ab11dd0b428486c673afc14b5b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:38:05.817597 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-737465b7-f0b2-434a-8e02-094201236597 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] 10.222.0.121 "GET /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b" status: 200 len: 1710 microversion: 2.1 time: 0.206688 Aug 04 10:38:05.818240 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 304/592] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:38:05 2022] GET /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b => generated 1710 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:38:06.062340 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-43fd6375-ed16-40ab-8e47-f1d50ffabf78 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:38:06.063024 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-43fd6375-ed16-40ab-8e47-f1d50ffabf78 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] [instance: 8534737c-8a94-4755-ba3c-021132edace6] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:38:06.070655 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-43fd6375-ed16-40ab-8e47-f1d50ffabf78 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:38:06.071132 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-43fd6375-ed16-40ab-8e47-f1d50ffabf78 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:38:06.072064 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-43fd6375-ed16-40ab-8e47-f1d50ffabf78 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:38:06.072538 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-43fd6375-ed16-40ab-8e47-f1d50ffabf78 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:38:06.236823 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-43fd6375-ed16-40ab-8e47-f1d50ffabf78 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a38b5af1654f44bc6cb5832c2e8e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051b6a3defca48d7b4f8bb6705f89f20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:38:06.245363 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-43fd6375-ed16-40ab-8e47-f1d50ffabf78 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] 10.222.0.121 "GET /compute/v2.1/servers/8534737c-8a94-4755-ba3c-021132edace6" status: 200 len: 1371 microversion: 2.1 time: 0.187217 Aug 04 10:38:06.245973 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 289/593] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:38:06 2022] GET /compute/v2.1/servers/8534737c-8a94-4755-ba3c-021132edace6 => generated 1371 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:38:06.603912 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-baa5e57f-21b7-4894-b33a-d259017f77a4 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-887049544", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-392572535", "security_groups": [{"name": "tempest-secgroup-smoke-1164219977"}], "networks": [{"uuid": "850831a8-9089-423a-aa22-c68f5d9a76c3"}], "block_device_mapping_v2": [{"uuid": "9824f41f-6a13-4cad-b067-f5f20e9f6e81", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:38:06.729834 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.network.neutron [None req-baa5e57f-21b7-4894-b33a-d259017f77a4 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] validate_networks() for [('850831a8-9089-423a-aa22-c68f5d9a76c3', None, None, None, None, None)] {{(pid=124457) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 10:38:06.843247 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-5813e322-b51a-491d-870f-e6dd6b4cb241 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:38:06.844270 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-5813e322-b51a-491d-870f-e6dd6b4cb241 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] [instance: 81259012-5f3b-44f6-b979-39119f14929b] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:38:06.854429 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-5813e322-b51a-491d-870f-e6dd6b4cb241 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:38:06.855108 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-5813e322-b51a-491d-870f-e6dd6b4cb241 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:38:06.856341 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-5813e322-b51a-491d-870f-e6dd6b4cb241 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:38:06.857250 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-5813e322-b51a-491d-870f-e6dd6b4cb241 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:38:07.101485 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-5813e322-b51a-491d-870f-e6dd6b4cb241 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa2e2a5a6ed4c5c9db91269266dd30b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f46ab11dd0b428486c673afc14b5b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:38:07.113210 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-5813e322-b51a-491d-870f-e6dd6b4cb241 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] 10.222.0.121 "GET /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b" status: 200 len: 1710 microversion: 2.1 time: 0.276917 Aug 04 10:38:07.114147 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 290/594] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:38:06 2022] GET /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b => generated 1710 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:38:07.271570 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-9adc6000-7835-430e-b3a8-90f195e579eb tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:38:07.272769 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-9adc6000-7835-430e-b3a8-90f195e579eb tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] [instance: 8534737c-8a94-4755-ba3c-021132edace6] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:38:07.283324 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-9adc6000-7835-430e-b3a8-90f195e579eb tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:38:07.284066 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-9adc6000-7835-430e-b3a8-90f195e579eb tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:38:07.285284 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-9adc6000-7835-430e-b3a8-90f195e579eb tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:38:07.285997 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-9adc6000-7835-430e-b3a8-90f195e579eb tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:38:07.487163 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.virt.hardware [None req-baa5e57f-21b7-4894-b33a-d259017f77a4 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Flavor limits 0:0:0 {{(pid=124457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 10:38:07.487380 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.virt.hardware [None req-baa5e57f-21b7-4894-b33a-d259017f77a4 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Image limits 0:0:0 {{(pid=124457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 10:38:07.488128 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.virt.hardware [None req-baa5e57f-21b7-4894-b33a-d259017f77a4 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Flavor pref 0:0:0 {{(pid=124457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 10:38:07.488849 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.virt.hardware [None req-baa5e57f-21b7-4894-b33a-d259017f77a4 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Image pref 0:0:0 {{(pid=124457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 10:38:07.489635 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.virt.hardware [None req-baa5e57f-21b7-4894-b33a-d259017f77a4 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 10:38:07.505544 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-baa5e57f-21b7-4894-b33a-d259017f77a4 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:38:07.506286 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-baa5e57f-21b7-4894-b33a-d259017f77a4 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:38:07.507628 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-baa5e57f-21b7-4894-b33a-d259017f77a4 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:38:07.508399 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-baa5e57f-21b7-4894-b33a-d259017f77a4 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:38:07.512634 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-9adc6000-7835-430e-b3a8-90f195e579eb tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a38b5af1654f44bc6cb5832c2e8e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051b6a3defca48d7b4f8bb6705f89f20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:38:07.522150 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-9adc6000-7835-430e-b3a8-90f195e579eb tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] 10.222.0.121 "GET /compute/v2.1/servers/8534737c-8a94-4755-ba3c-021132edace6" status: 200 len: 1371 microversion: 2.1 time: 0.257206 Aug 04 10:38:07.523652 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 291/595] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:38:07 2022] GET /compute/v2.1/servers/8534737c-8a94-4755-ba3c-021132edace6 => generated 1371 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 10:38:07.545463 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.quota [None req-baa5e57f-21b7-4894-b33a-d259017f77a4 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Getting quotas for project bee0d982e3ba4f7dba65f51636856b5a. Resources: {'ram', 'instances', 'cores'} {{(pid=124457) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 10:38:07.550468 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.quota [None req-baa5e57f-21b7-4894-b33a-d259017f77a4 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Getting quotas for user 6921033062424e14bc30f9b94bf911db and project bee0d982e3ba4f7dba65f51636856b5a. Resources: {'ram', 'instances', 'cores'} {{(pid=124457) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 10:38:07.616236 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-baa5e57f-21b7-4894-b33a-d259017f77a4 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Going to run 1 instances... {{(pid=124457) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 10:38:07.618421 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-baa5e57f-21b7-4894-b33a-d259017f77a4 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] [instance: ec14be1f-7e78-45e3-a70a-587a47b2d1c9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='9824f41f-6a13-4cad-b067-f5f20e9f6e81',volume_size=None,volume_type=None)] {{(pid=124457) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 10:38:07.775003 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-baa5e57f-21b7-4894-b33a-d259017f77a4 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] 10.222.0.121 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.177565 Aug 04 10:38:07.775807 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 305/596] 10.222.0.121 () {60 vars in 1152 bytes} [Thu Aug 4 10:38:06 2022] POST /compute/v2.1/servers => generated 408 bytes in 1179 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 04 10:38:07.787922 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-3af9c262-d6a3-4a2e-aead-d1af009d7a29 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:38:07.788916 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-3af9c262-d6a3-4a2e-aead-d1af009d7a29 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] [instance: ec14be1f-7e78-45e3-a70a-587a47b2d1c9] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:38:07.853106 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-3af9c262-d6a3-4a2e-aead-d1af009d7a29 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6921033062424e14bc30f9b94bf911db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bee0d982e3ba4f7dba65f51636856b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:38:07.860368 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-3af9c262-d6a3-4a2e-aead-d1af009d7a29 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] 10.222.0.121 "GET /compute/v2.1/servers/ec14be1f-7e78-45e3-a70a-587a47b2d1c9" status: 200 len: 1090 microversion: 2.1 time: 0.076734 Aug 04 10:38:07.861055 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 292/597] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:38:07 2022] GET /compute/v2.1/servers/ec14be1f-7e78-45e3-a70a-587a47b2d1c9 => generated 1090 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:38:08.147267 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-827d76f9-115a-4124-a874-3cf0551f50a9 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:38:08.148025 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-827d76f9-115a-4124-a874-3cf0551f50a9 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] [instance: 81259012-5f3b-44f6-b979-39119f14929b] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:38:08.158629 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-827d76f9-115a-4124-a874-3cf0551f50a9 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:38:08.159251 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-827d76f9-115a-4124-a874-3cf0551f50a9 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:38:08.160095 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-827d76f9-115a-4124-a874-3cf0551f50a9 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:38:08.160619 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-827d76f9-115a-4124-a874-3cf0551f50a9 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:38:08.323102 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-827d76f9-115a-4124-a874-3cf0551f50a9 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa2e2a5a6ed4c5c9db91269266dd30b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f46ab11dd0b428486c673afc14b5b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:38:08.334373 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-827d76f9-115a-4124-a874-3cf0551f50a9 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] 10.222.0.121 "GET /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b" status: 200 len: 1710 microversion: 2.1 time: 0.191394 Aug 04 10:38:08.335146 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 306/598] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:38:08 2022] GET /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b => generated 1710 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:38:08.545462 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-e934f430-461d-4794-be06-ff9489b49eed tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:38:08.546372 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-e934f430-461d-4794-be06-ff9489b49eed tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] [instance: 8534737c-8a94-4755-ba3c-021132edace6] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:38:08.554443 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-e934f430-461d-4794-be06-ff9489b49eed tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:38:08.554909 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-e934f430-461d-4794-be06-ff9489b49eed tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:38:08.555830 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-e934f430-461d-4794-be06-ff9489b49eed tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:38:08.556337 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-e934f430-461d-4794-be06-ff9489b49eed tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:38:08.573587 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG dbcounter [-] [124456] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:38:08.711179 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-e934f430-461d-4794-be06-ff9489b49eed tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a38b5af1654f44bc6cb5832c2e8e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051b6a3defca48d7b4f8bb6705f89f20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:38:08.721192 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-e934f430-461d-4794-be06-ff9489b49eed tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] 10.222.0.121 "GET /compute/v2.1/servers/8534737c-8a94-4755-ba3c-021132edace6" status: 200 len: 1371 microversion: 2.1 time: 0.180147 Aug 04 10:38:08.721796 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 293/599] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:38:08 2022] GET /compute/v2.1/servers/8534737c-8a94-4755-ba3c-021132edace6 => generated 1371 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:38:08.889153 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-41c48f0a-78cb-4141-b435-025af6d85160 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:38:08.889986 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-41c48f0a-78cb-4141-b435-025af6d85160 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] [instance: ec14be1f-7e78-45e3-a70a-587a47b2d1c9] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:38:08.899755 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-41c48f0a-78cb-4141-b435-025af6d85160 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:38:08.900239 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-41c48f0a-78cb-4141-b435-025af6d85160 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:38:08.901038 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-41c48f0a-78cb-4141-b435-025af6d85160 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:38:08.901490 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-41c48f0a-78cb-4141-b435-025af6d85160 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:38:08.969674 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-41c48f0a-78cb-4141-b435-025af6d85160 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6921033062424e14bc30f9b94bf911db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bee0d982e3ba4f7dba65f51636856b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:38:08.979192 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-41c48f0a-78cb-4141-b435-025af6d85160 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] 10.222.0.121 "GET /compute/v2.1/servers/ec14be1f-7e78-45e3-a70a-587a47b2d1c9" status: 200 len: 1140 microversion: 2.1 time: 0.095896 Aug 04 10:38:08.979804 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 307/600] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:38:08 2022] GET /compute/v2.1/servers/ec14be1f-7e78-45e3-a70a-587a47b2d1c9 => generated 1140 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:38:09.358069 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-1ec96e98-7a15-491c-a3d0-94f4fb318b6c tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:38:09.358692 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-1ec96e98-7a15-491c-a3d0-94f4fb318b6c tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] [instance: 81259012-5f3b-44f6-b979-39119f14929b] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:38:09.366795 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-1ec96e98-7a15-491c-a3d0-94f4fb318b6c tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:38:09.367224 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-1ec96e98-7a15-491c-a3d0-94f4fb318b6c tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:38:09.368090 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-1ec96e98-7a15-491c-a3d0-94f4fb318b6c tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:38:09.368555 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-1ec96e98-7a15-491c-a3d0-94f4fb318b6c tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:38:09.536373 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-1ec96e98-7a15-491c-a3d0-94f4fb318b6c tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa2e2a5a6ed4c5c9db91269266dd30b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f46ab11dd0b428486c673afc14b5b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:38:09.546774 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-1ec96e98-7a15-491c-a3d0-94f4fb318b6c tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] 10.222.0.121 "GET /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b" status: 200 len: 1710 microversion: 2.1 time: 0.193315 Aug 04 10:38:09.547781 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 294/601] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:38:09 2022] GET /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b => generated 1710 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:38:09.744446 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-f6c92dbb-98a3-45eb-acff-fb10ec0b8179 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:38:09.744976 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-f6c92dbb-98a3-45eb-acff-fb10ec0b8179 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] [instance: 8534737c-8a94-4755-ba3c-021132edace6] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:38:09.752241 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-f6c92dbb-98a3-45eb-acff-fb10ec0b8179 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:38:09.752709 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-f6c92dbb-98a3-45eb-acff-fb10ec0b8179 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:38:09.753555 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-f6c92dbb-98a3-45eb-acff-fb10ec0b8179 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:38:09.753994 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-f6c92dbb-98a3-45eb-acff-fb10ec0b8179 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:38:09.919316 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-f6c92dbb-98a3-45eb-acff-fb10ec0b8179 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a38b5af1654f44bc6cb5832c2e8e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051b6a3defca48d7b4f8bb6705f89f20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:38:09.927752 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-f6c92dbb-98a3-45eb-acff-fb10ec0b8179 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] 10.222.0.121 "GET /compute/v2.1/servers/8534737c-8a94-4755-ba3c-021132edace6" status: 200 len: 1371 microversion: 2.1 time: 0.187507 Aug 04 10:38:09.928375 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 308/602] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:38:09 2022] GET /compute/v2.1/servers/8534737c-8a94-4755-ba3c-021132edace6 => generated 1371 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 10:38:10.000939 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-a83e8e6c-7a9e-4110-aacb-f18fabaf4819 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:38:10.002107 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-a83e8e6c-7a9e-4110-aacb-f18fabaf4819 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] [instance: ec14be1f-7e78-45e3-a70a-587a47b2d1c9] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:38:10.010247 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-a83e8e6c-7a9e-4110-aacb-f18fabaf4819 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:38:10.010677 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-a83e8e6c-7a9e-4110-aacb-f18fabaf4819 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:38:10.011487 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-a83e8e6c-7a9e-4110-aacb-f18fabaf4819 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:38:10.011929 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-a83e8e6c-7a9e-4110-aacb-f18fabaf4819 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:38:10.083997 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-a83e8e6c-7a9e-4110-aacb-f18fabaf4819 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6921033062424e14bc30f9b94bf911db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bee0d982e3ba4f7dba65f51636856b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:38:10.095633 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-a83e8e6c-7a9e-4110-aacb-f18fabaf4819 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] 10.222.0.121 "GET /compute/v2.1/servers/ec14be1f-7e78-45e3-a70a-587a47b2d1c9" status: 200 len: 1140 microversion: 2.1 time: 0.098943 Aug 04 10:38:10.096499 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 295/603] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:38:09 2022] GET /compute/v2.1/servers/ec14be1f-7e78-45e3-a70a-587a47b2d1c9 => generated 1140 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:38:10.570392 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-a2db2361-af70-41c0-a2bc-3b0a1d7ae3e5 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:38:10.571008 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-a2db2361-af70-41c0-a2bc-3b0a1d7ae3e5 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] [instance: 81259012-5f3b-44f6-b979-39119f14929b] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:38:10.577472 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-a2db2361-af70-41c0-a2bc-3b0a1d7ae3e5 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:38:10.577922 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-a2db2361-af70-41c0-a2bc-3b0a1d7ae3e5 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:38:10.578698 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-a2db2361-af70-41c0-a2bc-3b0a1d7ae3e5 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:38:10.579137 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-a2db2361-af70-41c0-a2bc-3b0a1d7ae3e5 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:38:10.725295 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-a2db2361-af70-41c0-a2bc-3b0a1d7ae3e5 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa2e2a5a6ed4c5c9db91269266dd30b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f46ab11dd0b428486c673afc14b5b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:38:10.734723 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-a2db2361-af70-41c0-a2bc-3b0a1d7ae3e5 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] 10.222.0.121 "GET /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b" status: 200 len: 1710 microversion: 2.1 time: 0.168446 Aug 04 10:38:10.735311 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 309/604] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:38:10 2022] GET /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b => generated 1710 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:38:10.950736 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-50f5fc85-b1e4-456f-b701-9aa3639668e5 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:38:10.951441 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-50f5fc85-b1e4-456f-b701-9aa3639668e5 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] [instance: 8534737c-8a94-4755-ba3c-021132edace6] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:38:10.958477 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-50f5fc85-b1e4-456f-b701-9aa3639668e5 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:38:10.959125 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-50f5fc85-b1e4-456f-b701-9aa3639668e5 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:38:10.960070 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-50f5fc85-b1e4-456f-b701-9aa3639668e5 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:38:10.960619 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-50f5fc85-b1e4-456f-b701-9aa3639668e5 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:38:11.111374 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-50f5fc85-b1e4-456f-b701-9aa3639668e5 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a38b5af1654f44bc6cb5832c2e8e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051b6a3defca48d7b4f8bb6705f89f20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:38:11.118768 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-6682235b-b8a9-4623-bc4a-8c81ea03f776 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:38:11.119390 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-6682235b-b8a9-4623-bc4a-8c81ea03f776 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] [instance: ec14be1f-7e78-45e3-a70a-587a47b2d1c9] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:38:11.119981 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-50f5fc85-b1e4-456f-b701-9aa3639668e5 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] 10.222.0.121 "GET /compute/v2.1/servers/8534737c-8a94-4755-ba3c-021132edace6" status: 200 len: 1371 microversion: 2.1 time: 0.173482 Aug 04 10:38:11.120606 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 296/605] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:38:10 2022] GET /compute/v2.1/servers/8534737c-8a94-4755-ba3c-021132edace6 => generated 1371 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:38:11.127023 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-6682235b-b8a9-4623-bc4a-8c81ea03f776 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:38:11.127023 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-6682235b-b8a9-4623-bc4a-8c81ea03f776 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:38:11.127784 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-6682235b-b8a9-4623-bc4a-8c81ea03f776 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:38:11.128316 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-6682235b-b8a9-4623-bc4a-8c81ea03f776 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:38:11.210586 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-6682235b-b8a9-4623-bc4a-8c81ea03f776 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6921033062424e14bc30f9b94bf911db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bee0d982e3ba4f7dba65f51636856b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:38:11.219366 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-6682235b-b8a9-4623-bc4a-8c81ea03f776 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] 10.222.0.121 "GET /compute/v2.1/servers/ec14be1f-7e78-45e3-a70a-587a47b2d1c9" status: 200 len: 1140 microversion: 2.1 time: 0.105078 Aug 04 10:38:11.219972 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 310/606] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:38:11 2022] GET /compute/v2.1/servers/ec14be1f-7e78-45e3-a70a-587a47b2d1c9 => generated 1140 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:38:11.757025 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-890caafd-6b5b-47b3-9450-6667eed4155e tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:38:11.757520 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-890caafd-6b5b-47b3-9450-6667eed4155e tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] [instance: 81259012-5f3b-44f6-b979-39119f14929b] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:38:11.764842 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-890caafd-6b5b-47b3-9450-6667eed4155e tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:38:11.765279 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-890caafd-6b5b-47b3-9450-6667eed4155e tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:38:11.766084 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-890caafd-6b5b-47b3-9450-6667eed4155e tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:38:11.766535 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-890caafd-6b5b-47b3-9450-6667eed4155e tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:38:11.932269 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-890caafd-6b5b-47b3-9450-6667eed4155e tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa2e2a5a6ed4c5c9db91269266dd30b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f46ab11dd0b428486c673afc14b5b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:38:11.941122 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-890caafd-6b5b-47b3-9450-6667eed4155e tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] 10.222.0.121 "GET /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b" status: 200 len: 1710 microversion: 2.1 time: 0.188323 Aug 04 10:38:11.941754 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 297/607] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:38:11 2022] GET /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b => generated 1710 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:38:12.142137 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-bd04809b-2e2d-4618-9580-8c92c9aa5dc8 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:38:12.142803 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-bd04809b-2e2d-4618-9580-8c92c9aa5dc8 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] [instance: 8534737c-8a94-4755-ba3c-021132edace6] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:38:12.151802 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-bd04809b-2e2d-4618-9580-8c92c9aa5dc8 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:38:12.152325 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-bd04809b-2e2d-4618-9580-8c92c9aa5dc8 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:38:12.153214 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-bd04809b-2e2d-4618-9580-8c92c9aa5dc8 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:38:12.153684 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-bd04809b-2e2d-4618-9580-8c92c9aa5dc8 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:38:12.250229 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-7aeb4401-fa88-4461-92e0-0614213d9e9c tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:38:12.251570 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-7aeb4401-fa88-4461-92e0-0614213d9e9c tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] [instance: ec14be1f-7e78-45e3-a70a-587a47b2d1c9] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:38:12.258925 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-7aeb4401-fa88-4461-92e0-0614213d9e9c tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:38:12.259889 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-7aeb4401-fa88-4461-92e0-0614213d9e9c tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:38:12.261337 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-7aeb4401-fa88-4461-92e0-0614213d9e9c tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:38:12.262154 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-7aeb4401-fa88-4461-92e0-0614213d9e9c tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:38:12.319897 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-bd04809b-2e2d-4618-9580-8c92c9aa5dc8 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a38b5af1654f44bc6cb5832c2e8e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051b6a3defca48d7b4f8bb6705f89f20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:38:12.329670 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-bd04809b-2e2d-4618-9580-8c92c9aa5dc8 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] 10.222.0.121 "GET /compute/v2.1/servers/8534737c-8a94-4755-ba3c-021132edace6" status: 200 len: 1371 microversion: 2.1 time: 0.191768 Aug 04 10:38:12.330646 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 311/608] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:38:12 2022] GET /compute/v2.1/servers/8534737c-8a94-4755-ba3c-021132edace6 => generated 1371 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 10:38:12.340558 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-7aeb4401-fa88-4461-92e0-0614213d9e9c tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6921033062424e14bc30f9b94bf911db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bee0d982e3ba4f7dba65f51636856b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:38:12.348817 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-7aeb4401-fa88-4461-92e0-0614213d9e9c tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] 10.222.0.121 "GET /compute/v2.1/servers/ec14be1f-7e78-45e3-a70a-587a47b2d1c9" status: 200 len: 1140 microversion: 2.1 time: 0.105241 Aug 04 10:38:12.349432 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 298/609] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:38:12 2022] GET /compute/v2.1/servers/ec14be1f-7e78-45e3-a70a-587a47b2d1c9 => generated 1140 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:38:12.962716 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-5d5e0daf-52a1-4d6b-8507-8670cbe6458a tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:38:12.963347 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-5d5e0daf-52a1-4d6b-8507-8670cbe6458a tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] [instance: 81259012-5f3b-44f6-b979-39119f14929b] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:38:12.970203 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-5d5e0daf-52a1-4d6b-8507-8670cbe6458a tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:38:12.970660 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-5d5e0daf-52a1-4d6b-8507-8670cbe6458a tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:38:12.971450 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-5d5e0daf-52a1-4d6b-8507-8670cbe6458a tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:38:12.971895 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-5d5e0daf-52a1-4d6b-8507-8670cbe6458a tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:38:13.124914 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-5d5e0daf-52a1-4d6b-8507-8670cbe6458a tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa2e2a5a6ed4c5c9db91269266dd30b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f46ab11dd0b428486c673afc14b5b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:38:13.133966 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-5d5e0daf-52a1-4d6b-8507-8670cbe6458a tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] 10.222.0.121 "GET /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b" status: 200 len: 1710 microversion: 2.1 time: 0.175304 Aug 04 10:38:13.134583 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 312/610] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:38:12 2022] GET /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b => generated 1710 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:38:13.355466 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-cb41889b-b29f-4ea3-a619-0719a4cdf43a tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:38:13.356615 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-cb41889b-b29f-4ea3-a619-0719a4cdf43a tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] [instance: 8534737c-8a94-4755-ba3c-021132edace6] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:38:13.368197 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-cb41889b-b29f-4ea3-a619-0719a4cdf43a tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:38:13.368678 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-cb41889b-b29f-4ea3-a619-0719a4cdf43a tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:38:13.369474 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-cb41889b-b29f-4ea3-a619-0719a4cdf43a tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:38:13.369896 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-cb41889b-b29f-4ea3-a619-0719a4cdf43a tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:38:13.372520 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-3393678d-0325-4e1d-9b03-ad02921e6f6d tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:38:13.373159 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-3393678d-0325-4e1d-9b03-ad02921e6f6d tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] [instance: ec14be1f-7e78-45e3-a70a-587a47b2d1c9] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:38:13.380405 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-3393678d-0325-4e1d-9b03-ad02921e6f6d tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:38:13.380994 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-3393678d-0325-4e1d-9b03-ad02921e6f6d tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:38:13.381838 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-3393678d-0325-4e1d-9b03-ad02921e6f6d tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:38:13.382292 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-3393678d-0325-4e1d-9b03-ad02921e6f6d tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:38:13.467517 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-3393678d-0325-4e1d-9b03-ad02921e6f6d tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6921033062424e14bc30f9b94bf911db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bee0d982e3ba4f7dba65f51636856b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:38:13.475676 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-3393678d-0325-4e1d-9b03-ad02921e6f6d tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] 10.222.0.121 "GET /compute/v2.1/servers/ec14be1f-7e78-45e3-a70a-587a47b2d1c9" status: 200 len: 1140 microversion: 2.1 time: 0.107861 Aug 04 10:38:13.476680 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 313/611] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:38:13 2022] GET /compute/v2.1/servers/ec14be1f-7e78-45e3-a70a-587a47b2d1c9 => generated 1140 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:38:13.540017 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-cb41889b-b29f-4ea3-a619-0719a4cdf43a tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a38b5af1654f44bc6cb5832c2e8e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051b6a3defca48d7b4f8bb6705f89f20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:38:13.552593 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-cb41889b-b29f-4ea3-a619-0719a4cdf43a tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] 10.222.0.121 "GET /compute/v2.1/servers/8534737c-8a94-4755-ba3c-021132edace6" status: 200 len: 1371 microversion: 2.1 time: 0.203572 Aug 04 10:38:13.553234 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 299/612] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:38:13 2022] GET /compute/v2.1/servers/8534737c-8a94-4755-ba3c-021132edace6 => generated 1371 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:38:14.156965 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-75c6df14-54af-4e70-96a8-ab9b76302d30 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:38:14.157618 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-75c6df14-54af-4e70-96a8-ab9b76302d30 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] [instance: 81259012-5f3b-44f6-b979-39119f14929b] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:38:14.164739 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-75c6df14-54af-4e70-96a8-ab9b76302d30 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:38:14.165259 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-75c6df14-54af-4e70-96a8-ab9b76302d30 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:38:14.166379 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-75c6df14-54af-4e70-96a8-ab9b76302d30 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:38:14.166697 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-75c6df14-54af-4e70-96a8-ab9b76302d30 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:38:14.324859 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-75c6df14-54af-4e70-96a8-ab9b76302d30 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa2e2a5a6ed4c5c9db91269266dd30b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f46ab11dd0b428486c673afc14b5b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:38:14.337610 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-75c6df14-54af-4e70-96a8-ab9b76302d30 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] 10.222.0.121 "GET /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b" status: 200 len: 1710 microversion: 2.1 time: 0.184706 Aug 04 10:38:14.338226 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 314/613] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:38:14 2022] GET /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b => generated 1710 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:38:14.499988 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-28fcd6d6-97f2-4dcf-b756-21b28b89951f tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:38:14.500649 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-28fcd6d6-97f2-4dcf-b756-21b28b89951f tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] [instance: ec14be1f-7e78-45e3-a70a-587a47b2d1c9] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:38:14.507675 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-28fcd6d6-97f2-4dcf-b756-21b28b89951f tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:38:14.508176 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-28fcd6d6-97f2-4dcf-b756-21b28b89951f tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:38:14.508938 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-28fcd6d6-97f2-4dcf-b756-21b28b89951f tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:38:14.509536 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-28fcd6d6-97f2-4dcf-b756-21b28b89951f tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:38:14.574414 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-c6c133a6-8647-49be-9092-dbc576998df3 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:38:14.575080 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-c6c133a6-8647-49be-9092-dbc576998df3 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] [instance: 8534737c-8a94-4755-ba3c-021132edace6] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:38:14.578090 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-28fcd6d6-97f2-4dcf-b756-21b28b89951f tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6921033062424e14bc30f9b94bf911db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bee0d982e3ba4f7dba65f51636856b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:38:14.582855 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-c6c133a6-8647-49be-9092-dbc576998df3 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:38:14.583288 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-c6c133a6-8647-49be-9092-dbc576998df3 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:38:14.584128 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-c6c133a6-8647-49be-9092-dbc576998df3 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:38:14.584577 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-c6c133a6-8647-49be-9092-dbc576998df3 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:38:14.586893 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-28fcd6d6-97f2-4dcf-b756-21b28b89951f tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] 10.222.0.121 "GET /compute/v2.1/servers/ec14be1f-7e78-45e3-a70a-587a47b2d1c9" status: 200 len: 1140 microversion: 2.1 time: 0.091056 Aug 04 10:38:14.587684 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 300/614] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:38:14 2022] GET /compute/v2.1/servers/ec14be1f-7e78-45e3-a70a-587a47b2d1c9 => generated 1140 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:38:14.601203 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG dbcounter [-] [124457] Writing DB stats nova_cell1:SELECT=100 {{(pid=124457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:38:14.738126 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-c6c133a6-8647-49be-9092-dbc576998df3 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a38b5af1654f44bc6cb5832c2e8e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051b6a3defca48d7b4f8bb6705f89f20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:38:14.746262 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-c6c133a6-8647-49be-9092-dbc576998df3 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] 10.222.0.121 "GET /compute/v2.1/servers/8534737c-8a94-4755-ba3c-021132edace6" status: 200 len: 1371 microversion: 2.1 time: 0.176079 Aug 04 10:38:14.746853 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 315/615] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:38:14 2022] GET /compute/v2.1/servers/8534737c-8a94-4755-ba3c-021132edace6 => generated 1371 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:38:15.367604 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-d9cc6c49-1cda-40cc-9ab9-300b8e045ebb tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:38:15.368529 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-d9cc6c49-1cda-40cc-9ab9-300b8e045ebb tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] [instance: 81259012-5f3b-44f6-b979-39119f14929b] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:38:15.379141 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-d9cc6c49-1cda-40cc-9ab9-300b8e045ebb tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:38:15.379774 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-d9cc6c49-1cda-40cc-9ab9-300b8e045ebb tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:38:15.380923 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-d9cc6c49-1cda-40cc-9ab9-300b8e045ebb tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:38:15.381551 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-d9cc6c49-1cda-40cc-9ab9-300b8e045ebb tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:38:15.530963 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-d9cc6c49-1cda-40cc-9ab9-300b8e045ebb tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa2e2a5a6ed4c5c9db91269266dd30b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f46ab11dd0b428486c673afc14b5b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:38:15.539974 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-d9cc6c49-1cda-40cc-9ab9-300b8e045ebb tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] 10.222.0.121 "GET /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b" status: 200 len: 1710 microversion: 2.1 time: 0.178944 Aug 04 10:38:15.540545 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 301/616] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:38:15 2022] GET /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b => generated 1710 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:38:15.609855 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-9037af93-4463-4d65-b3c2-d6aa9cfcdbc3 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:38:15.610491 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-9037af93-4463-4d65-b3c2-d6aa9cfcdbc3 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] [instance: ec14be1f-7e78-45e3-a70a-587a47b2d1c9] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:38:15.619534 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-9037af93-4463-4d65-b3c2-d6aa9cfcdbc3 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:38:15.620007 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-9037af93-4463-4d65-b3c2-d6aa9cfcdbc3 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:38:15.620821 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-9037af93-4463-4d65-b3c2-d6aa9cfcdbc3 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:38:15.621266 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-9037af93-4463-4d65-b3c2-d6aa9cfcdbc3 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:38:15.687802 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-9037af93-4463-4d65-b3c2-d6aa9cfcdbc3 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6921033062424e14bc30f9b94bf911db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bee0d982e3ba4f7dba65f51636856b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:38:15.696147 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-9037af93-4463-4d65-b3c2-d6aa9cfcdbc3 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] 10.222.0.121 "GET /compute/v2.1/servers/ec14be1f-7e78-45e3-a70a-587a47b2d1c9" status: 200 len: 1140 microversion: 2.1 time: 0.091985 Aug 04 10:38:15.696768 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 316/617] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:38:15 2022] GET /compute/v2.1/servers/ec14be1f-7e78-45e3-a70a-587a47b2d1c9 => generated 1140 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:38:15.775361 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-c503ea81-1aa6-4995-9c10-f5c3996c5bef tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:38:15.776044 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-c503ea81-1aa6-4995-9c10-f5c3996c5bef tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] [instance: 8534737c-8a94-4755-ba3c-021132edace6] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:38:15.783220 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-c503ea81-1aa6-4995-9c10-f5c3996c5bef tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:38:15.783685 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-c503ea81-1aa6-4995-9c10-f5c3996c5bef tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:38:15.784544 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-c503ea81-1aa6-4995-9c10-f5c3996c5bef tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:38:15.784954 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-c503ea81-1aa6-4995-9c10-f5c3996c5bef tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:38:15.941949 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-c503ea81-1aa6-4995-9c10-f5c3996c5bef tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a38b5af1654f44bc6cb5832c2e8e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051b6a3defca48d7b4f8bb6705f89f20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:38:15.951653 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-c503ea81-1aa6-4995-9c10-f5c3996c5bef tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] 10.222.0.121 "GET /compute/v2.1/servers/8534737c-8a94-4755-ba3c-021132edace6" status: 200 len: 1371 microversion: 2.1 time: 0.180687 Aug 04 10:38:15.952295 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 302/618] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:38:15 2022] GET /compute/v2.1/servers/8534737c-8a94-4755-ba3c-021132edace6 => generated 1371 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:38:16.561305 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-a708d63c-3376-4719-987a-7787284b6e68 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:38:16.562011 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-a708d63c-3376-4719-987a-7787284b6e68 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] [instance: 81259012-5f3b-44f6-b979-39119f14929b] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:38:16.569125 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-a708d63c-3376-4719-987a-7787284b6e68 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:38:16.569593 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-a708d63c-3376-4719-987a-7787284b6e68 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:38:16.570398 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-a708d63c-3376-4719-987a-7787284b6e68 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:38:16.570850 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-a708d63c-3376-4719-987a-7787284b6e68 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:38:16.718996 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-68b820bd-2500-47c8-8acc-ec34dfd034aa tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:38:16.719809 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-68b820bd-2500-47c8-8acc-ec34dfd034aa tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] [instance: ec14be1f-7e78-45e3-a70a-587a47b2d1c9] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:38:16.727154 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-68b820bd-2500-47c8-8acc-ec34dfd034aa tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:38:16.727672 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-68b820bd-2500-47c8-8acc-ec34dfd034aa tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:38:16.728445 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-68b820bd-2500-47c8-8acc-ec34dfd034aa tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:38:16.728861 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-a708d63c-3376-4719-987a-7787284b6e68 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa2e2a5a6ed4c5c9db91269266dd30b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f46ab11dd0b428486c673afc14b5b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:38:16.729372 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-68b820bd-2500-47c8-8acc-ec34dfd034aa tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:38:16.737979 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-a708d63c-3376-4719-987a-7787284b6e68 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] 10.222.0.121 "GET /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b" status: 200 len: 1710 microversion: 2.1 time: 0.180684 Aug 04 10:38:16.738579 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 317/619] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:38:16 2022] GET /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b => generated 1710 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:38:16.839177 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-68b820bd-2500-47c8-8acc-ec34dfd034aa tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6921033062424e14bc30f9b94bf911db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bee0d982e3ba4f7dba65f51636856b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:38:16.849704 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-68b820bd-2500-47c8-8acc-ec34dfd034aa tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] 10.222.0.121 "GET /compute/v2.1/servers/ec14be1f-7e78-45e3-a70a-587a47b2d1c9" status: 200 len: 1140 microversion: 2.1 time: 0.135579 Aug 04 10:38:16.850510 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 303/620] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:38:16 2022] GET /compute/v2.1/servers/ec14be1f-7e78-45e3-a70a-587a47b2d1c9 => generated 1140 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 10:38:16.973312 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-282926e7-54de-438e-ac10-babc6f00658b tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:38:16.974427 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-282926e7-54de-438e-ac10-babc6f00658b tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] [instance: 8534737c-8a94-4755-ba3c-021132edace6] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:38:16.981938 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-282926e7-54de-438e-ac10-babc6f00658b tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:38:16.982392 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-282926e7-54de-438e-ac10-babc6f00658b tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:38:16.983674 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-282926e7-54de-438e-ac10-babc6f00658b tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:38:16.984500 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-282926e7-54de-438e-ac10-babc6f00658b tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:38:17.145518 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-282926e7-54de-438e-ac10-babc6f00658b tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a38b5af1654f44bc6cb5832c2e8e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051b6a3defca48d7b4f8bb6705f89f20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:38:17.154897 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-282926e7-54de-438e-ac10-babc6f00658b tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] 10.222.0.121 "GET /compute/v2.1/servers/8534737c-8a94-4755-ba3c-021132edace6" status: 200 len: 1371 microversion: 2.1 time: 0.185817 Aug 04 10:38:17.155533 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 318/621] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:38:16 2022] GET /compute/v2.1/servers/8534737c-8a94-4755-ba3c-021132edace6 => generated 1371 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:38:17.759975 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-fdfa60ae-1dd5-41ce-94db-1bacc907c476 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:38:17.760752 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-fdfa60ae-1dd5-41ce-94db-1bacc907c476 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] [instance: 81259012-5f3b-44f6-b979-39119f14929b] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:38:17.769130 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-fdfa60ae-1dd5-41ce-94db-1bacc907c476 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:38:17.769580 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-fdfa60ae-1dd5-41ce-94db-1bacc907c476 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:38:17.770372 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-fdfa60ae-1dd5-41ce-94db-1bacc907c476 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:38:17.770819 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-fdfa60ae-1dd5-41ce-94db-1bacc907c476 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:38:17.857553 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG dbcounter [-] [124456] Writing DB stats nova_cell0:SELECT=2 {{(pid=124456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:38:17.872355 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-bdaba3bb-9b01-4b3f-a278-9f7314634a74 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:38:17.873206 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-bdaba3bb-9b01-4b3f-a278-9f7314634a74 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] [instance: ec14be1f-7e78-45e3-a70a-587a47b2d1c9] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:38:17.874939 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG dbcounter [-] [124457] Writing DB stats nova_cell0:SELECT=2 {{(pid=124457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:38:17.875642 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG dbcounter [-] [124457] Writing DB stats nova_cell0:SELECT=6 {{(pid=124457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:38:17.883531 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-bdaba3bb-9b01-4b3f-a278-9f7314634a74 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:38:17.884069 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-bdaba3bb-9b01-4b3f-a278-9f7314634a74 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:38:17.884794 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-bdaba3bb-9b01-4b3f-a278-9f7314634a74 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:38:17.885247 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-bdaba3bb-9b01-4b3f-a278-9f7314634a74 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:38:17.970882 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-fdfa60ae-1dd5-41ce-94db-1bacc907c476 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa2e2a5a6ed4c5c9db91269266dd30b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f46ab11dd0b428486c673afc14b5b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:38:17.980839 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-fdfa60ae-1dd5-41ce-94db-1bacc907c476 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] 10.222.0.121 "GET /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b" status: 200 len: 1710 microversion: 2.1 time: 0.224926 Aug 04 10:38:17.981467 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 304/622] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:38:17 2022] GET /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b => generated 1710 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:38:18.177819 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-a6f3f74d-b7de-4feb-96a0-d1a5530fb9f4 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:38:18.178593 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-a6f3f74d-b7de-4feb-96a0-d1a5530fb9f4 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] [instance: 8534737c-8a94-4755-ba3c-021132edace6] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:38:18.192992 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-a6f3f74d-b7de-4feb-96a0-d1a5530fb9f4 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:38:18.193555 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-a6f3f74d-b7de-4feb-96a0-d1a5530fb9f4 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:38:18.197987 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-a6f3f74d-b7de-4feb-96a0-d1a5530fb9f4 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:38:18.198912 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-a6f3f74d-b7de-4feb-96a0-d1a5530fb9f4 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:38:18.312297 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-bdaba3bb-9b01-4b3f-a278-9f7314634a74 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6921033062424e14bc30f9b94bf911db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bee0d982e3ba4f7dba65f51636856b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:38:18.324748 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-bdaba3bb-9b01-4b3f-a278-9f7314634a74 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] 10.222.0.121 "GET /compute/v2.1/servers/ec14be1f-7e78-45e3-a70a-587a47b2d1c9" status: 200 len: 1188 microversion: 2.1 time: 0.456597 Aug 04 10:38:18.339788 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 319/623] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:38:17 2022] GET /compute/v2.1/servers/ec14be1f-7e78-45e3-a70a-587a47b2d1c9 => generated 1188 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:38:18.369501 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [req-8375fd30-38f6-436e-8108-b5ce1c94ecf7 req-27223663-aa24-4b4e-b687-60dd8ffaf7b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8534737c-8a94-4755-ba3c-021132edace6", "name": "network-vif-plugged", "status": "completed", "tag": "5e2a8967-749e-4b17-b392-9ccf6a550b05"}]} {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:38:18.387437 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [req-8375fd30-38f6-436e-8108-b5ce1c94ecf7 req-27223663-aa24-4b4e-b687-60dd8ffaf7b7 service nova] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:38:18.388071 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [req-8375fd30-38f6-436e-8108-b5ce1c94ecf7 req-27223663-aa24-4b4e-b687-60dd8ffaf7b7 service nova] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:38:18.401033 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.compute.server_external_events [req-8375fd30-38f6-436e-8108-b5ce1c94ecf7 req-27223663-aa24-4b4e-b687-60dd8ffaf7b7 service nova] Creating event network-vif-plugged:5e2a8967-749e-4b17-b392-9ccf6a550b05 for instance 8534737c-8a94-4755-ba3c-021132edace6 on hv-cinder-85200 Aug 04 10:38:18.406976 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [req-8375fd30-38f6-436e-8108-b5ce1c94ecf7 req-27223663-aa24-4b4e-b687-60dd8ffaf7b7 service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041584 Aug 04 10:38:18.407917 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 320/624] 10.222.0.121 () {64 vars in 1322 bytes} [Thu Aug 4 10:38:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:38:18.675752 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-a6f3f74d-b7de-4feb-96a0-d1a5530fb9f4 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a38b5af1654f44bc6cb5832c2e8e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051b6a3defca48d7b4f8bb6705f89f20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:38:18.685060 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-a6f3f74d-b7de-4feb-96a0-d1a5530fb9f4 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] 10.222.0.121 "GET /compute/v2.1/servers/8534737c-8a94-4755-ba3c-021132edace6" status: 200 len: 1371 microversion: 2.1 time: 0.511635 Aug 04 10:38:18.700412 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 305/625] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:38:18 2022] GET /compute/v2.1/servers/8534737c-8a94-4755-ba3c-021132edace6 => generated 1371 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:38:19.013271 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-2cf57678-544a-459c-b485-d139d726bcca tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:38:19.014006 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-2cf57678-544a-459c-b485-d139d726bcca tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] [instance: 81259012-5f3b-44f6-b979-39119f14929b] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:38:19.021479 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-2cf57678-544a-459c-b485-d139d726bcca tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:38:19.021967 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-2cf57678-544a-459c-b485-d139d726bcca tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:38:19.022767 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-2cf57678-544a-459c-b485-d139d726bcca tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:38:19.023219 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-2cf57678-544a-459c-b485-d139d726bcca tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:38:19.194444 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-2cf57678-544a-459c-b485-d139d726bcca tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa2e2a5a6ed4c5c9db91269266dd30b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f46ab11dd0b428486c673afc14b5b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:38:19.206329 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-2cf57678-544a-459c-b485-d139d726bcca tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] 10.222.0.121 "GET /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b" status: 200 len: 1710 microversion: 2.1 time: 0.200433 Aug 04 10:38:19.207060 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 321/626] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:38:19 2022] GET /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b => generated 1710 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:38:19.351034 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-a7b46373-e965-4a8a-a8be-6fe31d178588 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:38:19.351776 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-a7b46373-e965-4a8a-a8be-6fe31d178588 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] [instance: ec14be1f-7e78-45e3-a70a-587a47b2d1c9] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:38:19.359227 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-a7b46373-e965-4a8a-a8be-6fe31d178588 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:38:19.359677 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-a7b46373-e965-4a8a-a8be-6fe31d178588 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:38:19.360508 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-a7b46373-e965-4a8a-a8be-6fe31d178588 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:38:19.360957 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-a7b46373-e965-4a8a-a8be-6fe31d178588 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:38:19.432472 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-a7b46373-e965-4a8a-a8be-6fe31d178588 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6921033062424e14bc30f9b94bf911db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bee0d982e3ba4f7dba65f51636856b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:38:19.441324 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-a7b46373-e965-4a8a-a8be-6fe31d178588 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] 10.222.0.121 "GET /compute/v2.1/servers/ec14be1f-7e78-45e3-a70a-587a47b2d1c9" status: 200 len: 1206 microversion: 2.1 time: 0.094731 Aug 04 10:38:19.441919 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 306/627] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:38:19 2022] GET /compute/v2.1/servers/ec14be1f-7e78-45e3-a70a-587a47b2d1c9 => generated 1206 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 10:38:19.710178 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-1b126acd-86c9-41b8-868c-3af39e78d74c tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:38:19.710719 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-1b126acd-86c9-41b8-868c-3af39e78d74c tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] [instance: 8534737c-8a94-4755-ba3c-021132edace6] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:38:19.720822 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-1b126acd-86c9-41b8-868c-3af39e78d74c tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:38:19.721187 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-1b126acd-86c9-41b8-868c-3af39e78d74c tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:38:19.722403 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-1b126acd-86c9-41b8-868c-3af39e78d74c tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:38:19.722901 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-1b126acd-86c9-41b8-868c-3af39e78d74c tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:38:19.872912 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-1b126acd-86c9-41b8-868c-3af39e78d74c tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a38b5af1654f44bc6cb5832c2e8e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051b6a3defca48d7b4f8bb6705f89f20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:38:19.881092 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-1b126acd-86c9-41b8-868c-3af39e78d74c tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] 10.222.0.121 "GET /compute/v2.1/servers/8534737c-8a94-4755-ba3c-021132edace6" status: 200 len: 1371 microversion: 2.1 time: 0.175314 Aug 04 10:38:19.881692 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 322/628] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:38:19 2022] GET /compute/v2.1/servers/8534737c-8a94-4755-ba3c-021132edace6 => generated 1371 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:38:20.230130 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-e4db09a3-c0f5-4a8f-a58c-fc09e09ef707 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:38:20.230829 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-e4db09a3-c0f5-4a8f-a58c-fc09e09ef707 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] [instance: 81259012-5f3b-44f6-b979-39119f14929b] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:38:20.238074 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-e4db09a3-c0f5-4a8f-a58c-fc09e09ef707 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:38:20.238463 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-e4db09a3-c0f5-4a8f-a58c-fc09e09ef707 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:38:20.239356 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-e4db09a3-c0f5-4a8f-a58c-fc09e09ef707 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:38:20.239879 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-e4db09a3-c0f5-4a8f-a58c-fc09e09ef707 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:38:20.465150 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-833362b2-6a85-4a06-b35e-30e4cec132bf tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:38:20.465800 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-833362b2-6a85-4a06-b35e-30e4cec132bf tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] [instance: ec14be1f-7e78-45e3-a70a-587a47b2d1c9] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:38:20.473401 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-833362b2-6a85-4a06-b35e-30e4cec132bf tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:38:20.473943 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-833362b2-6a85-4a06-b35e-30e4cec132bf tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:38:20.474155 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-e4db09a3-c0f5-4a8f-a58c-fc09e09ef707 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa2e2a5a6ed4c5c9db91269266dd30b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f46ab11dd0b428486c673afc14b5b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:38:20.475038 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-833362b2-6a85-4a06-b35e-30e4cec132bf tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:38:20.476073 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-833362b2-6a85-4a06-b35e-30e4cec132bf tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:38:20.486111 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-e4db09a3-c0f5-4a8f-a58c-fc09e09ef707 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] 10.222.0.121 "GET /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b" status: 200 len: 1710 microversion: 2.1 time: 0.261291 Aug 04 10:38:20.487213 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 307/629] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:38:20 2022] GET /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b => generated 1710 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 10:38:20.835014 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-833362b2-6a85-4a06-b35e-30e4cec132bf tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6921033062424e14bc30f9b94bf911db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bee0d982e3ba4f7dba65f51636856b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:38:20.846866 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-833362b2-6a85-4a06-b35e-30e4cec132bf tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] 10.222.0.121 "GET /compute/v2.1/servers/ec14be1f-7e78-45e3-a70a-587a47b2d1c9" status: 200 len: 1274 microversion: 2.1 time: 0.385696 Aug 04 10:38:20.872517 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 323/630] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:38:20 2022] GET /compute/v2.1/servers/ec14be1f-7e78-45e3-a70a-587a47b2d1c9 => generated 1274 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:38:20.903602 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-97debbe7-e60f-4584-8c79-b274da5208fd tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:38:20.904354 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-97debbe7-e60f-4584-8c79-b274da5208fd tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] [instance: 8534737c-8a94-4755-ba3c-021132edace6] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:38:20.911757 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-97debbe7-e60f-4584-8c79-b274da5208fd tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:38:20.912636 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-97debbe7-e60f-4584-8c79-b274da5208fd tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:38:20.913447 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-97debbe7-e60f-4584-8c79-b274da5208fd tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:38:20.914063 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-97debbe7-e60f-4584-8c79-b274da5208fd tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:38:21.290429 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-97debbe7-e60f-4584-8c79-b274da5208fd tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a38b5af1654f44bc6cb5832c2e8e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051b6a3defca48d7b4f8bb6705f89f20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:38:21.301705 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-97debbe7-e60f-4584-8c79-b274da5208fd tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] 10.222.0.121 "GET /compute/v2.1/servers/8534737c-8a94-4755-ba3c-021132edace6" status: 200 len: 1371 microversion: 2.1 time: 0.402114 Aug 04 10:38:21.302415 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 308/631] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:38:20 2022] GET /compute/v2.1/servers/8534737c-8a94-4755-ba3c-021132edace6 => generated 1371 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:38:21.511674 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-2468cf19-3b78-4c84-9544-071f239339f7 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:38:21.512361 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-2468cf19-3b78-4c84-9544-071f239339f7 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] [instance: 81259012-5f3b-44f6-b979-39119f14929b] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:38:21.519354 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-2468cf19-3b78-4c84-9544-071f239339f7 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:38:21.519838 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-2468cf19-3b78-4c84-9544-071f239339f7 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:38:21.520649 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-2468cf19-3b78-4c84-9544-071f239339f7 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:38:21.521081 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-2468cf19-3b78-4c84-9544-071f239339f7 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:38:21.683328 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [req-9a15caac-7574-4315-91c6-025f90f40ffb req-a80736e8-44b1-435a-b34b-8dd0c875d516 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec14be1f-7e78-45e3-a70a-587a47b2d1c9", "tag": "c3025d1c-cab8-4711-9bcc-0663813275c3"}]} {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:38:21.689184 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG dbcounter [-] [124456] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=3 {{(pid=124456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:38:21.695595 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [req-9a15caac-7574-4315-91c6-025f90f40ffb req-a80736e8-44b1-435a-b34b-8dd0c875d516 service nova] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:38:21.696166 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [req-9a15caac-7574-4315-91c6-025f90f40ffb req-a80736e8-44b1-435a-b34b-8dd0c875d516 service nova] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:38:21.710967 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.compute.server_external_events [req-9a15caac-7574-4315-91c6-025f90f40ffb req-a80736e8-44b1-435a-b34b-8dd0c875d516 service nova] Creating event network-changed:c3025d1c-cab8-4711-9bcc-0663813275c3 for instance ec14be1f-7e78-45e3-a70a-587a47b2d1c9 on hv-cinder-85200 Aug 04 10:38:21.718459 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [req-9a15caac-7574-4315-91c6-025f90f40ffb req-a80736e8-44b1-435a-b34b-8dd0c875d516 service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040148 Aug 04 10:38:21.719166 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 309/632] 10.222.0.121 () {64 vars in 1322 bytes} [Thu Aug 4 10:38:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:38:21.756227 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-2468cf19-3b78-4c84-9544-071f239339f7 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa2e2a5a6ed4c5c9db91269266dd30b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f46ab11dd0b428486c673afc14b5b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:38:21.768763 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-2468cf19-3b78-4c84-9544-071f239339f7 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] 10.222.0.121 "GET /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b" status: 200 len: 1710 microversion: 2.1 time: 0.261528 Aug 04 10:38:21.770035 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 324/633] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:38:21 2022] GET /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b => generated 1710 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:38:21.873315 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-313dbabf-d139-49c0-9ae5-a33074f7206e tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:38:21.873924 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-313dbabf-d139-49c0-9ae5-a33074f7206e tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] [instance: ec14be1f-7e78-45e3-a70a-587a47b2d1c9] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:38:21.881398 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-313dbabf-d139-49c0-9ae5-a33074f7206e tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:38:21.881849 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-313dbabf-d139-49c0-9ae5-a33074f7206e tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:38:21.882643 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-313dbabf-d139-49c0-9ae5-a33074f7206e tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:38:21.883086 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-313dbabf-d139-49c0-9ae5-a33074f7206e tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:38:22.052325 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-313dbabf-d139-49c0-9ae5-a33074f7206e tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6921033062424e14bc30f9b94bf911db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bee0d982e3ba4f7dba65f51636856b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:38:22.055272 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG dbcounter [-] [124456] Writing DB stats nova_cell1:SELECT=100 {{(pid=124456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:38:22.064515 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-313dbabf-d139-49c0-9ae5-a33074f7206e tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] 10.222.0.121 "GET /compute/v2.1/servers/ec14be1f-7e78-45e3-a70a-587a47b2d1c9" status: 200 len: 1262 microversion: 2.1 time: 0.195846 Aug 04 10:38:22.065151 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 310/634] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:38:21 2022] GET /compute/v2.1/servers/ec14be1f-7e78-45e3-a70a-587a47b2d1c9 => generated 1262 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:38:22.069492 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-d0c4ceb3-461b-4785-9828-3af5cce6afeb tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:38:22.070173 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-d0c4ceb3-461b-4785-9828-3af5cce6afeb tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] [instance: c0b1b05c-6675-4224-8158-caf89589f2db] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:38:22.081066 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-d0c4ceb3-461b-4785-9828-3af5cce6afeb tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:38:22.081594 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-d0c4ceb3-461b-4785-9828-3af5cce6afeb tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:38:22.082501 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-d0c4ceb3-461b-4785-9828-3af5cce6afeb tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:38:22.082952 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-d0c4ceb3-461b-4785-9828-3af5cce6afeb tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:38:22.265272 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.objects.instance [None req-d0c4ceb3-461b-4785-9828-3af5cce6afeb tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Lazy-loading 'services' on Instance uuid c0b1b05c-6675-4224-8158-caf89589f2db {{(pid=124457) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 10:38:22.323324 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-8f59dcd8-6333-420b-a8d4-4beca8c90493 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:38:22.324415 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-8f59dcd8-6333-420b-a8d4-4beca8c90493 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] [instance: 8534737c-8a94-4755-ba3c-021132edace6] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:38:22.331621 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-8f59dcd8-6333-420b-a8d4-4beca8c90493 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:38:22.332514 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-8f59dcd8-6333-420b-a8d4-4beca8c90493 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:38:22.333331 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-8f59dcd8-6333-420b-a8d4-4beca8c90493 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:38:22.333759 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-8f59dcd8-6333-420b-a8d4-4beca8c90493 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:38:22.391326 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-d0c4ceb3-461b-4785-9828-3af5cce6afeb tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] 10.222.0.121 "DELETE /compute/v2.1/servers/c0b1b05c-6675-4224-8158-caf89589f2db/os-volume_attachments/907136af-75bf-42d1-a0e3-c0d359ff022a" status: 202 len: 0 microversion: 2.1 time: 0.328153 Aug 04 10:38:22.392189 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 325/635] 10.222.0.121 () {58 vars in 1421 bytes} [Thu Aug 4 10:38:22 2022] DELETE /compute/v2.1/servers/c0b1b05c-6675-4224-8158-caf89589f2db/os-volume_attachments/907136af-75bf-42d1-a0e3-c0d359ff022a => generated 0 bytes in 330 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 10:38:22.534287 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-8f59dcd8-6333-420b-a8d4-4beca8c90493 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a38b5af1654f44bc6cb5832c2e8e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051b6a3defca48d7b4f8bb6705f89f20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:38:22.543829 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-8f59dcd8-6333-420b-a8d4-4beca8c90493 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] 10.222.0.121 "GET /compute/v2.1/servers/8534737c-8a94-4755-ba3c-021132edace6" status: 200 len: 1560 microversion: 2.1 time: 0.224684 Aug 04 10:38:22.544558 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 311/636] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:38:22 2022] GET /compute/v2.1/servers/8534737c-8a94-4755-ba3c-021132edace6 => generated 1560 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:38:22.572560 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-7cacb8f5-4662-4867-bfb6-540c5d6a01fd tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:38:22.573646 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-7cacb8f5-4662-4867-bfb6-540c5d6a01fd tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] [instance: 8534737c-8a94-4755-ba3c-021132edace6] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:38:22.585040 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-7cacb8f5-4662-4867-bfb6-540c5d6a01fd tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:38:22.585808 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-7cacb8f5-4662-4867-bfb6-540c5d6a01fd tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:38:22.587258 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-7cacb8f5-4662-4867-bfb6-540c5d6a01fd tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:38:22.588137 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-7cacb8f5-4662-4867-bfb6-540c5d6a01fd tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:38:22.683093 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-7cacb8f5-4662-4867-bfb6-540c5d6a01fd tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] 10.222.0.121 "GET /compute/v2.1/servers/8534737c-8a94-4755-ba3c-021132edace6/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.119251 Aug 04 10:38:22.683904 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 326/637] 10.222.0.121 () {58 vars in 1280 bytes} [Thu Aug 4 10:38:22 2022] GET /compute/v2.1/servers/8534737c-8a94-4755-ba3c-021132edace6/os-interface => generated 284 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:38:22.806116 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-9769198e-e92d-4176-b146-278a5825f791 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:38:22.806853 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-9769198e-e92d-4176-b146-278a5825f791 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] [instance: 81259012-5f3b-44f6-b979-39119f14929b] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:38:22.814930 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-9769198e-e92d-4176-b146-278a5825f791 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:38:22.815371 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-9769198e-e92d-4176-b146-278a5825f791 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:38:22.816210 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-9769198e-e92d-4176-b146-278a5825f791 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:38:22.816649 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-9769198e-e92d-4176-b146-278a5825f791 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:38:23.006812 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-9769198e-e92d-4176-b146-278a5825f791 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa2e2a5a6ed4c5c9db91269266dd30b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f46ab11dd0b428486c673afc14b5b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:38:23.015936 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-9769198e-e92d-4176-b146-278a5825f791 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] 10.222.0.121 "GET /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b" status: 200 len: 1714 microversion: 2.1 time: 0.213955 Aug 04 10:38:23.016624 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 312/638] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:38:22 2022] GET /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b => generated 1714 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:38:23.090060 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-ac7e6fab-7149-4588-88a5-52f4f87ab730 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:38:23.090681 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-ac7e6fab-7149-4588-88a5-52f4f87ab730 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] [instance: ec14be1f-7e78-45e3-a70a-587a47b2d1c9] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:38:23.097854 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-ac7e6fab-7149-4588-88a5-52f4f87ab730 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:38:23.098425 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-ac7e6fab-7149-4588-88a5-52f4f87ab730 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:38:23.099234 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-ac7e6fab-7149-4588-88a5-52f4f87ab730 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:38:23.099678 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-ac7e6fab-7149-4588-88a5-52f4f87ab730 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:38:23.306528 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-ac7e6fab-7149-4588-88a5-52f4f87ab730 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6921033062424e14bc30f9b94bf911db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bee0d982e3ba4f7dba65f51636856b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:38:23.317754 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-ac7e6fab-7149-4588-88a5-52f4f87ab730 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] 10.222.0.121 "GET /compute/v2.1/servers/ec14be1f-7e78-45e3-a70a-587a47b2d1c9" status: 200 len: 1262 microversion: 2.1 time: 0.231828 Aug 04 10:38:23.318373 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 327/639] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:38:23 2022] GET /compute/v2.1/servers/ec14be1f-7e78-45e3-a70a-587a47b2d1c9 => generated 1262 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:38:24.072201 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [req-3693c67e-1610-4bdd-a857-e48513cf0525 req-799f54d2-8e67-42fe-86ce-a3bdb095f625 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8534737c-8a94-4755-ba3c-021132edace6", "tag": "5e2a8967-749e-4b17-b392-9ccf6a550b05"}]} {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:38:24.084766 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [req-3693c67e-1610-4bdd-a857-e48513cf0525 req-799f54d2-8e67-42fe-86ce-a3bdb095f625 service nova] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:38:24.085212 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [req-3693c67e-1610-4bdd-a857-e48513cf0525 req-799f54d2-8e67-42fe-86ce-a3bdb095f625 service nova] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:38:24.098551 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.compute.server_external_events [req-3693c67e-1610-4bdd-a857-e48513cf0525 req-799f54d2-8e67-42fe-86ce-a3bdb095f625 service nova] Creating event network-changed:5e2a8967-749e-4b17-b392-9ccf6a550b05 for instance 8534737c-8a94-4755-ba3c-021132edace6 on hv-cinder-85200 Aug 04 10:38:24.105065 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [req-3693c67e-1610-4bdd-a857-e48513cf0525 req-799f54d2-8e67-42fe-86ce-a3bdb095f625 service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037154 Aug 04 10:38:24.105890 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 313/640] 10.222.0.121 () {64 vars in 1322 bytes} [Thu Aug 4 10:38:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:38:24.339486 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-f6ac8986-b6a0-4857-ac8a-9dd6bc046d54 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:38:24.341291 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-f6ac8986-b6a0-4857-ac8a-9dd6bc046d54 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] [instance: ec14be1f-7e78-45e3-a70a-587a47b2d1c9] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:38:24.348938 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-f6ac8986-b6a0-4857-ac8a-9dd6bc046d54 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:38:24.349687 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-f6ac8986-b6a0-4857-ac8a-9dd6bc046d54 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:38:24.351149 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-f6ac8986-b6a0-4857-ac8a-9dd6bc046d54 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:38:24.351597 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-f6ac8986-b6a0-4857-ac8a-9dd6bc046d54 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:38:24.502985 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-f6ac8986-b6a0-4857-ac8a-9dd6bc046d54 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6921033062424e14bc30f9b94bf911db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bee0d982e3ba4f7dba65f51636856b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:38:24.511671 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-f6ac8986-b6a0-4857-ac8a-9dd6bc046d54 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] 10.222.0.121 "GET /compute/v2.1/servers/ec14be1f-7e78-45e3-a70a-587a47b2d1c9" status: 200 len: 1262 microversion: 2.1 time: 0.176339 Aug 04 10:38:24.512317 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 328/641] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:38:24 2022] GET /compute/v2.1/servers/ec14be1f-7e78-45e3-a70a-587a47b2d1c9 => generated 1262 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 10:38:24.613253 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-ad09350b-dc31-46cb-9dc5-0d6a5c1c757a tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:38:24.613866 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-ad09350b-dc31-46cb-9dc5-0d6a5c1c757a tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] [instance: c0b1b05c-6675-4224-8158-caf89589f2db] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:38:24.623219 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-ad09350b-dc31-46cb-9dc5-0d6a5c1c757a tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:38:24.623677 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-ad09350b-dc31-46cb-9dc5-0d6a5c1c757a tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:38:24.624521 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-ad09350b-dc31-46cb-9dc5-0d6a5c1c757a tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:38:24.624968 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-ad09350b-dc31-46cb-9dc5-0d6a5c1c757a tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:38:24.655015 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-ad09350b-dc31-46cb-9dc5-0d6a5c1c757a tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] [instance: c0b1b05c-6675-4224-8158-caf89589f2db] Going to try to terminate instance {{(pid=124456) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 10:38:24.742385 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-ad09350b-dc31-46cb-9dc5-0d6a5c1c757a tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] 10.222.0.121 "DELETE /compute/v2.1/servers/c0b1b05c-6675-4224-8158-caf89589f2db" status: 204 len: 0 microversion: 2.1 time: 0.133037 Aug 04 10:38:24.743377 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 314/642] 10.222.0.121 () {58 vars in 1244 bytes} [Thu Aug 4 10:38:24 2022] DELETE /compute/v2.1/servers/c0b1b05c-6675-4224-8158-caf89589f2db => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 10:38:24.752882 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-eb24ed70-b779-46e5-b046-2521d58c19b0 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:38:24.753674 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-eb24ed70-b779-46e5-b046-2521d58c19b0 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] [instance: c0b1b05c-6675-4224-8158-caf89589f2db] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:38:24.760967 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-eb24ed70-b779-46e5-b046-2521d58c19b0 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:38:24.761837 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-eb24ed70-b779-46e5-b046-2521d58c19b0 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:38:24.762778 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-eb24ed70-b779-46e5-b046-2521d58c19b0 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:38:24.763331 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-eb24ed70-b779-46e5-b046-2521d58c19b0 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:38:24.921819 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-eb24ed70-b779-46e5-b046-2521d58c19b0 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9e00718840481ca416e25ef436bb24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacec5c4a2584f60af1ca9843e9e8732', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:38:24.932719 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-eb24ed70-b779-46e5-b046-2521d58c19b0 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] 10.222.0.121 "GET /compute/v2.1/servers/c0b1b05c-6675-4224-8158-caf89589f2db" status: 200 len: 1564 microversion: 2.1 time: 0.183787 Aug 04 10:38:24.933234 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 329/643] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:38:24 2022] GET /compute/v2.1/servers/c0b1b05c-6675-4224-8158-caf89589f2db => generated 1564 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 10:38:25.537989 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-fe89b365-2e04-4456-a0a2-f6dabf4f2c68 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:38:25.538895 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-fe89b365-2e04-4456-a0a2-f6dabf4f2c68 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] [instance: ec14be1f-7e78-45e3-a70a-587a47b2d1c9] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:38:25.547995 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-fe89b365-2e04-4456-a0a2-f6dabf4f2c68 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:38:25.548383 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-fe89b365-2e04-4456-a0a2-f6dabf4f2c68 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:38:25.549163 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-fe89b365-2e04-4456-a0a2-f6dabf4f2c68 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:38:25.549636 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-fe89b365-2e04-4456-a0a2-f6dabf4f2c68 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:38:25.709885 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-fe89b365-2e04-4456-a0a2-f6dabf4f2c68 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6921033062424e14bc30f9b94bf911db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bee0d982e3ba4f7dba65f51636856b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:38:25.718542 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-fe89b365-2e04-4456-a0a2-f6dabf4f2c68 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] 10.222.0.121 "GET /compute/v2.1/servers/ec14be1f-7e78-45e3-a70a-587a47b2d1c9" status: 200 len: 1262 microversion: 2.1 time: 0.187316 Aug 04 10:38:25.719116 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 315/644] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:38:25 2022] GET /compute/v2.1/servers/ec14be1f-7e78-45e3-a70a-587a47b2d1c9 => generated 1262 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:38:25.960357 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-36ccb1c1-d747-49bb-b10b-bef27468b767 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:38:25.961574 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-36ccb1c1-d747-49bb-b10b-bef27468b767 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] [instance: c0b1b05c-6675-4224-8158-caf89589f2db] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:38:25.972890 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-36ccb1c1-d747-49bb-b10b-bef27468b767 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:38:25.973353 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-36ccb1c1-d747-49bb-b10b-bef27468b767 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:38:25.974227 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-36ccb1c1-d747-49bb-b10b-bef27468b767 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:38:25.974671 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-36ccb1c1-d747-49bb-b10b-bef27468b767 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:38:26.127257 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-36ccb1c1-d747-49bb-b10b-bef27468b767 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9e00718840481ca416e25ef436bb24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacec5c4a2584f60af1ca9843e9e8732', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:38:26.136442 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-36ccb1c1-d747-49bb-b10b-bef27468b767 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] 10.222.0.121 "GET /compute/v2.1/servers/c0b1b05c-6675-4224-8158-caf89589f2db" status: 200 len: 1518 microversion: 2.1 time: 0.184436 Aug 04 10:38:26.137009 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 330/645] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:38:25 2022] GET /compute/v2.1/servers/c0b1b05c-6675-4224-8158-caf89589f2db => generated 1518 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:38:26.740049 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-78308405-4ac8-4cbe-9fe2-eca0415af576 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:38:26.740693 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-78308405-4ac8-4cbe-9fe2-eca0415af576 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] [instance: ec14be1f-7e78-45e3-a70a-587a47b2d1c9] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:38:26.748571 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-78308405-4ac8-4cbe-9fe2-eca0415af576 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:38:26.749219 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-78308405-4ac8-4cbe-9fe2-eca0415af576 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:38:26.750229 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-78308405-4ac8-4cbe-9fe2-eca0415af576 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:38:26.750781 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-78308405-4ac8-4cbe-9fe2-eca0415af576 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:38:26.905490 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-78308405-4ac8-4cbe-9fe2-eca0415af576 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6921033062424e14bc30f9b94bf911db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bee0d982e3ba4f7dba65f51636856b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:38:26.914354 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-78308405-4ac8-4cbe-9fe2-eca0415af576 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] 10.222.0.121 "GET /compute/v2.1/servers/ec14be1f-7e78-45e3-a70a-587a47b2d1c9" status: 200 len: 1262 microversion: 2.1 time: 0.178437 Aug 04 10:38:26.915021 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 316/646] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:38:26 2022] GET /compute/v2.1/servers/ec14be1f-7e78-45e3-a70a-587a47b2d1c9 => generated 1262 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:38:27.159595 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-24623ac0-84f1-4203-88de-a1f7c7c0f323 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:38:27.160710 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-24623ac0-84f1-4203-88de-a1f7c7c0f323 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] [instance: c0b1b05c-6675-4224-8158-caf89589f2db] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:38:27.168195 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-24623ac0-84f1-4203-88de-a1f7c7c0f323 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:38:27.168808 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-24623ac0-84f1-4203-88de-a1f7c7c0f323 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:38:27.169760 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-24623ac0-84f1-4203-88de-a1f7c7c0f323 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:38:27.170113 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-24623ac0-84f1-4203-88de-a1f7c7c0f323 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:38:27.630614 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-24623ac0-84f1-4203-88de-a1f7c7c0f323 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9e00718840481ca416e25ef436bb24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacec5c4a2584f60af1ca9843e9e8732', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:38:27.639595 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-24623ac0-84f1-4203-88de-a1f7c7c0f323 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] 10.222.0.121 "GET /compute/v2.1/servers/c0b1b05c-6675-4224-8158-caf89589f2db" status: 200 len: 1518 microversion: 2.1 time: 0.484463 Aug 04 10:38:27.640240 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 331/647] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:38:27 2022] GET /compute/v2.1/servers/c0b1b05c-6675-4224-8158-caf89589f2db => generated 1518 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:38:27.936761 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-044dae4d-004d-4843-ade2-eee65a3ff36a tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:38:27.937461 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-044dae4d-004d-4843-ade2-eee65a3ff36a tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] [instance: ec14be1f-7e78-45e3-a70a-587a47b2d1c9] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:38:27.945181 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-044dae4d-004d-4843-ade2-eee65a3ff36a tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:38:27.945883 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-044dae4d-004d-4843-ade2-eee65a3ff36a tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:38:27.946599 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-044dae4d-004d-4843-ade2-eee65a3ff36a tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:38:27.947065 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-044dae4d-004d-4843-ade2-eee65a3ff36a tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:38:28.205628 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-044dae4d-004d-4843-ade2-eee65a3ff36a tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6921033062424e14bc30f9b94bf911db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bee0d982e3ba4f7dba65f51636856b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:38:28.214399 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-044dae4d-004d-4843-ade2-eee65a3ff36a tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] 10.222.0.121 "GET /compute/v2.1/servers/ec14be1f-7e78-45e3-a70a-587a47b2d1c9" status: 200 len: 1262 microversion: 2.1 time: 0.281662 Aug 04 10:38:28.215272 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 317/648] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:38:27 2022] GET /compute/v2.1/servers/ec14be1f-7e78-45e3-a70a-587a47b2d1c9 => generated 1262 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:38:28.492487 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [req-edf4862d-c3c5-475c-9c90-1e87d6f47757 req-d892908c-f19c-49a2-9901-7635f5a94e3c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0b1b05c-6675-4224-8158-caf89589f2db", "name": "network-vif-deleted", "tag": "a64c6d5f-61ff-4f5b-8dd1-12186cb685ca"}]} {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:38:28.504227 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [req-edf4862d-c3c5-475c-9c90-1e87d6f47757 req-d892908c-f19c-49a2-9901-7635f5a94e3c service nova] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:38:28.504679 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [req-edf4862d-c3c5-475c-9c90-1e87d6f47757 req-d892908c-f19c-49a2-9901-7635f5a94e3c service nova] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:38:28.516567 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.compute.server_external_events [req-edf4862d-c3c5-475c-9c90-1e87d6f47757 req-d892908c-f19c-49a2-9901-7635f5a94e3c service nova] Creating event network-vif-deleted:a64c6d5f-61ff-4f5b-8dd1-12186cb685ca for instance c0b1b05c-6675-4224-8158-caf89589f2db on hv-cinder-85200 Aug 04 10:38:28.522527 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [req-edf4862d-c3c5-475c-9c90-1e87d6f47757 req-d892908c-f19c-49a2-9901-7635f5a94e3c service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034071 Aug 04 10:38:28.523336 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 332/649] 10.222.0.121 () {64 vars in 1322 bytes} [Thu Aug 4 10:38:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:38:28.662645 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-1dca2d4e-4476-4feb-9a67-6e34ba467365 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:38:28.663805 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-1dca2d4e-4476-4feb-9a67-6e34ba467365 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] [instance: c0b1b05c-6675-4224-8158-caf89589f2db] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:38:28.674087 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-1dca2d4e-4476-4feb-9a67-6e34ba467365 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:38:28.674906 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-1dca2d4e-4476-4feb-9a67-6e34ba467365 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:38:28.676430 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-1dca2d4e-4476-4feb-9a67-6e34ba467365 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:38:28.677248 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-1dca2d4e-4476-4feb-9a67-6e34ba467365 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:38:28.715920 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-1dca2d4e-4476-4feb-9a67-6e34ba467365 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:38:28.716360 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-1dca2d4e-4476-4feb-9a67-6e34ba467365 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:38:28.716901 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.objects.instance [None req-1dca2d4e-4476-4feb-9a67-6e34ba467365 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Lazy-loading 'fault' on Instance uuid c0b1b05c-6675-4224-8158-caf89589f2db {{(pid=124456) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 10:38:28.773700 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-1dca2d4e-4476-4feb-9a67-6e34ba467365 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9e00718840481ca416e25ef436bb24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacec5c4a2584f60af1ca9843e9e8732', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:38:28.782411 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-1dca2d4e-4476-4feb-9a67-6e34ba467365 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] 10.222.0.121 "GET /compute/v2.1/servers/c0b1b05c-6675-4224-8158-caf89589f2db" status: 200 len: 1313 microversion: 2.1 time: 0.125082 Aug 04 10:38:28.783002 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 318/650] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:38:28 2022] GET /compute/v2.1/servers/c0b1b05c-6675-4224-8158-caf89589f2db => generated 1313 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:38:29.238691 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-48bc38d7-2782-48a3-953a-6df16c58c09d tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:38:29.239391 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-48bc38d7-2782-48a3-953a-6df16c58c09d tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] [instance: ec14be1f-7e78-45e3-a70a-587a47b2d1c9] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:38:29.241437 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG dbcounter [-] [124457] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=3 {{(pid=124457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:38:29.247577 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-48bc38d7-2782-48a3-953a-6df16c58c09d tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:38:29.248051 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-48bc38d7-2782-48a3-953a-6df16c58c09d tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:38:29.248823 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-48bc38d7-2782-48a3-953a-6df16c58c09d tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:38:29.249373 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-48bc38d7-2782-48a3-953a-6df16c58c09d tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:38:29.255401 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG dbcounter [-] [124457] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:38:29.422986 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-48bc38d7-2782-48a3-953a-6df16c58c09d tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6921033062424e14bc30f9b94bf911db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bee0d982e3ba4f7dba65f51636856b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:38:29.431364 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-48bc38d7-2782-48a3-953a-6df16c58c09d tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] 10.222.0.121 "GET /compute/v2.1/servers/ec14be1f-7e78-45e3-a70a-587a47b2d1c9" status: 200 len: 1262 microversion: 2.1 time: 0.197267 Aug 04 10:38:29.432000 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 333/651] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:38:29 2022] GET /compute/v2.1/servers/ec14be1f-7e78-45e3-a70a-587a47b2d1c9 => generated 1262 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:38:29.807574 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-30c9e3de-3ad8-451d-97cb-19949580a760 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:38:29.808223 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-30c9e3de-3ad8-451d-97cb-19949580a760 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] [instance: c0b1b05c-6675-4224-8158-caf89589f2db] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:38:29.815439 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-30c9e3de-3ad8-451d-97cb-19949580a760 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:38:29.815915 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-30c9e3de-3ad8-451d-97cb-19949580a760 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:38:29.816844 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-30c9e3de-3ad8-451d-97cb-19949580a760 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:38:29.817327 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-30c9e3de-3ad8-451d-97cb-19949580a760 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:38:29.833548 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.wsgi [None req-30c9e3de-3ad8-451d-97cb-19949580a760 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] HTTP exception thrown: Instance c0b1b05c-6675-4224-8158-caf89589f2db could not be found. Aug 04 10:38:29.835281 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-30c9e3de-3ad8-451d-97cb-19949580a760 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Request method failure captured: Aug 04 10:38:29.835281 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: request: GET /compute/v2.1/servers/c0b1b05c-6675-4224-8158-caf89589f2db HTTP/1.1 Aug 04 10:38:29.835281 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: Accept: application/json Aug 04 10:38:29.835281 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: Accept-Encoding: identity Aug 04 10:38:29.835281 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: Connection: close Aug 04 10:38:29.835281 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: Content-Length: 0 Aug 04 10:38:29.835281 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: Content-Type: application/json Aug 04 10:38:29.835281 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: Host: 10.222.0.121 Aug 04 10:38:29.835281 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: Openstack-System-Scope: None Aug 04 10:38:29.835281 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: User-Agent: python-urllib3/1.26.11 Aug 04 10:38:29.835281 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Auth-Token: gAAAAABi66EtWTh6SnTlCi-I0B6RttCfugek-lkS_MEwJekwZ1oU_CXhx69-b1zH31gL6fGIik6VPvMVQjyt8SKEa7LSQ08E0xHQy1t89nK6XhoEKWTUCbLWuNBuk9wK1-Qi2Yoc2qmiSyRS5CR3Zed4w5dKWdu-KHX8JJChiievnw6qixmGgw8 Aug 04 10:38:29.835281 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Domain-Id: None Aug 04 10:38:29.835281 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Domain-Name: None Aug 04 10:38:29.835281 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Identity-Status: Confirmed Aug 04 10:38:29.835281 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Is-Admin-Project: True Aug 04 10:38:29.835281 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Project-Domain-Id: default Aug 04 10:38:29.835281 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Project-Domain-Name: Default Aug 04 10:38:29.835281 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Project-Id: aacec5c4a2584f60af1ca9843e9e8732 Aug 04 10:38:29.835281 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1981735847 Aug 04 10:38:29.835281 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Role: reader,member Aug 04 10:38:29.835281 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Roles: reader,member Aug 04 10:38:29.837081 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/aacec5c4a2584f60af1ca9843e9e8732"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/aacec5c4a2584f60af1ca9843e9e8732"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.121:8080", "publicURL": "http://10.222.0.121:8080/v1/AUTH_aacec5c4a2584f60af1ca9843e9e8732"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2/aacec5c4a2584f60af1ca9843e9e8732"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:9696/networking"}]}] Aug 04 10:38:29.837081 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Tenant: tempest-VolumesSnapshotTestJSON-1981735847 Aug 04 10:38:29.837081 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Tenant-Id: aacec5c4a2584f60af1ca9843e9e8732 Aug 04 10:38:29.837081 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1981735847 Aug 04 10:38:29.837081 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-User: tempest-VolumesSnapshotTestJSON-1981735847-project Aug 04 10:38:29.837081 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-User-Domain-Id: default Aug 04 10:38:29.837081 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-User-Domain-Name: Default Aug 04 10:38:29.837081 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-User-Id: db9e00718840481ca416e25ef436bb24 Aug 04 10:38:29.837081 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-User-Name: tempest-VolumesSnapshotTestJSON-1981735847-project Aug 04 10:38:29.837081 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: method: > Aug 04 10:38:29.837081 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: exception: Instance c0b1b05c-6675-4224-8158-caf89589f2db could not be found. Aug 04 10:38:29.837081 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: action_args: {'id': 'c0b1b05c-6675-4224-8158-caf89589f2db'} Aug 04 10:38:29.838278 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 10:38:29.838278 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:38:29.838278 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 10:38:29.838278 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 10:38:29.838278 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 10:38:29.838278 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 10:38:29.838278 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 10:38:29.838278 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 10:38:29.838278 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 10:38:29.838278 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 10:38:29.838278 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0b1b05c-6675-4224-8158-caf89589f2db could not be found. Aug 04 10:38:29.838278 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi Aug 04 10:38:29.838278 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:38:29.838278 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi Aug 04 10:38:29.838278 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:38:29.838278 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:38:29.838278 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:38:29.838278 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 10:38:29.838278 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 10:38:29.838278 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 10:38:29.839997 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 10:38:29.839997 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 10:38:29.839997 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 10:38:29.839997 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 10:38:29.839997 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 10:38:29.839997 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 10:38:29.839997 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 10:38:29.839997 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0b1b05c-6675-4224-8158-caf89589f2db could not be found. Aug 04 10:38:29.839997 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi Aug 04 10:38:29.839997 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:38:29.839997 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi Aug 04 10:38:29.839997 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:38:29.839997 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:38:29.839997 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:38:29.839997 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 10:38:29.839997 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 10:38:29.839997 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0b1b05c-6675-4224-8158-caf89589f2db could not be found. Aug 04 10:38:29.839997 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi Aug 04 10:38:29.841863 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-30c9e3de-3ad8-451d-97cb-19949580a760 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Returning 404 to user: Instance c0b1b05c-6675-4224-8158-caf89589f2db could not be found. {{(pid=124456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 10:38:29.841863 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-30c9e3de-3ad8-451d-97cb-19949580a760 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] 10.222.0.121 "GET /compute/v2.1/servers/c0b1b05c-6675-4224-8158-caf89589f2db" status: 404 len: 111 microversion: 2.1 time: 0.033545 Aug 04 10:38:29.841863 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 319/652] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:38:29 2022] GET /compute/v2.1/servers/c0b1b05c-6675-4224-8158-caf89589f2db => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 10:38:30.453735 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-3487e4b6-802c-44a6-915e-6cc2085f8ebb tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:38:30.454381 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-3487e4b6-802c-44a6-915e-6cc2085f8ebb tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] [instance: ec14be1f-7e78-45e3-a70a-587a47b2d1c9] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:38:30.461880 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-3487e4b6-802c-44a6-915e-6cc2085f8ebb tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:38:30.462448 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-3487e4b6-802c-44a6-915e-6cc2085f8ebb tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:38:30.463289 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-3487e4b6-802c-44a6-915e-6cc2085f8ebb tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:38:30.463742 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-3487e4b6-802c-44a6-915e-6cc2085f8ebb tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:38:30.613952 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-3487e4b6-802c-44a6-915e-6cc2085f8ebb tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6921033062424e14bc30f9b94bf911db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bee0d982e3ba4f7dba65f51636856b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:38:30.623322 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-3487e4b6-802c-44a6-915e-6cc2085f8ebb tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] 10.222.0.121 "GET /compute/v2.1/servers/ec14be1f-7e78-45e3-a70a-587a47b2d1c9" status: 200 len: 1262 microversion: 2.1 time: 0.173583 Aug 04 10:38:30.623956 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 334/653] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:38:30 2022] GET /compute/v2.1/servers/ec14be1f-7e78-45e3-a70a-587a47b2d1c9 => generated 1262 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:38:31.652197 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-336f020b-6f17-470d-a795-2e07b7202c29 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:38:31.653234 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-336f020b-6f17-470d-a795-2e07b7202c29 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] [instance: ec14be1f-7e78-45e3-a70a-587a47b2d1c9] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:38:31.661892 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-336f020b-6f17-470d-a795-2e07b7202c29 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:38:31.662801 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-336f020b-6f17-470d-a795-2e07b7202c29 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:38:31.663282 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-336f020b-6f17-470d-a795-2e07b7202c29 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:38:31.663827 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-336f020b-6f17-470d-a795-2e07b7202c29 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:38:31.820342 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-336f020b-6f17-470d-a795-2e07b7202c29 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6921033062424e14bc30f9b94bf911db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bee0d982e3ba4f7dba65f51636856b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:38:31.828536 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-336f020b-6f17-470d-a795-2e07b7202c29 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] 10.222.0.121 "GET /compute/v2.1/servers/ec14be1f-7e78-45e3-a70a-587a47b2d1c9" status: 200 len: 1262 microversion: 2.1 time: 0.181944 Aug 04 10:38:31.829108 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 320/654] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:38:31 2022] GET /compute/v2.1/servers/ec14be1f-7e78-45e3-a70a-587a47b2d1c9 => generated 1262 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:38:32.851864 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-cdb42b82-06c4-464a-bd57-a12ea8bd9980 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:38:32.852560 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-cdb42b82-06c4-464a-bd57-a12ea8bd9980 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] [instance: ec14be1f-7e78-45e3-a70a-587a47b2d1c9] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:38:32.860564 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-cdb42b82-06c4-464a-bd57-a12ea8bd9980 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:38:32.861036 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-cdb42b82-06c4-464a-bd57-a12ea8bd9980 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:38:32.861878 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-cdb42b82-06c4-464a-bd57-a12ea8bd9980 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:38:32.862327 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-cdb42b82-06c4-464a-bd57-a12ea8bd9980 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:38:33.017349 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-cdb42b82-06c4-464a-bd57-a12ea8bd9980 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6921033062424e14bc30f9b94bf911db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bee0d982e3ba4f7dba65f51636856b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:38:33.025495 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-cdb42b82-06c4-464a-bd57-a12ea8bd9980 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] 10.222.0.121 "GET /compute/v2.1/servers/ec14be1f-7e78-45e3-a70a-587a47b2d1c9" status: 200 len: 1262 microversion: 2.1 time: 0.178319 Aug 04 10:38:33.026086 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 335/655] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:38:32 2022] GET /compute/v2.1/servers/ec14be1f-7e78-45e3-a70a-587a47b2d1c9 => generated 1262 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:38:34.049479 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-662c1f46-7602-4083-9bf2-b081494c83ba tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:38:34.050230 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-662c1f46-7602-4083-9bf2-b081494c83ba tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] [instance: ec14be1f-7e78-45e3-a70a-587a47b2d1c9] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:38:34.059785 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-662c1f46-7602-4083-9bf2-b081494c83ba tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:38:34.060427 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-662c1f46-7602-4083-9bf2-b081494c83ba tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:38:34.061551 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-662c1f46-7602-4083-9bf2-b081494c83ba tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:38:34.062164 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-662c1f46-7602-4083-9bf2-b081494c83ba tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:38:34.220036 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-662c1f46-7602-4083-9bf2-b081494c83ba tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6921033062424e14bc30f9b94bf911db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bee0d982e3ba4f7dba65f51636856b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:38:34.229126 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-662c1f46-7602-4083-9bf2-b081494c83ba tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] 10.222.0.121 "GET /compute/v2.1/servers/ec14be1f-7e78-45e3-a70a-587a47b2d1c9" status: 200 len: 1262 microversion: 2.1 time: 0.185902 Aug 04 10:38:34.229752 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 321/656] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:38:34 2022] GET /compute/v2.1/servers/ec14be1f-7e78-45e3-a70a-587a47b2d1c9 => generated 1262 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:38:35.251597 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-9b9496e2-7075-45b3-92a3-065dc6b1f0c3 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:38:35.252470 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-9b9496e2-7075-45b3-92a3-065dc6b1f0c3 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] [instance: ec14be1f-7e78-45e3-a70a-587a47b2d1c9] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:38:35.260287 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-9b9496e2-7075-45b3-92a3-065dc6b1f0c3 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:38:35.260907 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-9b9496e2-7075-45b3-92a3-065dc6b1f0c3 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:38:35.265277 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-9b9496e2-7075-45b3-92a3-065dc6b1f0c3 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:38:35.265277 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-9b9496e2-7075-45b3-92a3-065dc6b1f0c3 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:38:35.454791 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-9b9496e2-7075-45b3-92a3-065dc6b1f0c3 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6921033062424e14bc30f9b94bf911db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bee0d982e3ba4f7dba65f51636856b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:38:35.476118 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-9b9496e2-7075-45b3-92a3-065dc6b1f0c3 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] 10.222.0.121 "GET /compute/v2.1/servers/ec14be1f-7e78-45e3-a70a-587a47b2d1c9" status: 200 len: 1262 microversion: 2.1 time: 0.228203 Aug 04 10:38:35.476869 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 336/657] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:38:35 2022] GET /compute/v2.1/servers/ec14be1f-7e78-45e3-a70a-587a47b2d1c9 => generated 1262 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:38:36.499565 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-666bfc8c-61c7-428c-b82d-4e42c8d098ab tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:38:36.500467 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-666bfc8c-61c7-428c-b82d-4e42c8d098ab tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] [instance: ec14be1f-7e78-45e3-a70a-587a47b2d1c9] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:38:36.508482 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-666bfc8c-61c7-428c-b82d-4e42c8d098ab tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:38:36.508905 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-666bfc8c-61c7-428c-b82d-4e42c8d098ab tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:38:36.509748 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-666bfc8c-61c7-428c-b82d-4e42c8d098ab tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:38:36.510237 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-666bfc8c-61c7-428c-b82d-4e42c8d098ab tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:38:36.676628 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-666bfc8c-61c7-428c-b82d-4e42c8d098ab tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6921033062424e14bc30f9b94bf911db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bee0d982e3ba4f7dba65f51636856b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:38:36.685814 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-666bfc8c-61c7-428c-b82d-4e42c8d098ab tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] 10.222.0.121 "GET /compute/v2.1/servers/ec14be1f-7e78-45e3-a70a-587a47b2d1c9" status: 200 len: 1262 microversion: 2.1 time: 0.190220 Aug 04 10:38:36.686418 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 322/658] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:38:36 2022] GET /compute/v2.1/servers/ec14be1f-7e78-45e3-a70a-587a47b2d1c9 => generated 1262 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:38:37.708947 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-2acd6d2e-89aa-4934-8709-9284ed1c4f24 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:38:37.709655 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-2acd6d2e-89aa-4934-8709-9284ed1c4f24 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] [instance: ec14be1f-7e78-45e3-a70a-587a47b2d1c9] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:38:37.717850 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-2acd6d2e-89aa-4934-8709-9284ed1c4f24 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:38:37.718298 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-2acd6d2e-89aa-4934-8709-9284ed1c4f24 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:38:37.719095 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-2acd6d2e-89aa-4934-8709-9284ed1c4f24 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:38:37.719541 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-2acd6d2e-89aa-4934-8709-9284ed1c4f24 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:38:37.867518 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-2acd6d2e-89aa-4934-8709-9284ed1c4f24 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6921033062424e14bc30f9b94bf911db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bee0d982e3ba4f7dba65f51636856b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:38:37.876891 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-2acd6d2e-89aa-4934-8709-9284ed1c4f24 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] 10.222.0.121 "GET /compute/v2.1/servers/ec14be1f-7e78-45e3-a70a-587a47b2d1c9" status: 200 len: 1262 microversion: 2.1 time: 0.171847 Aug 04 10:38:37.877515 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 337/659] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:38:37 2022] GET /compute/v2.1/servers/ec14be1f-7e78-45e3-a70a-587a47b2d1c9 => generated 1262 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:38:38.901753 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-33f2cb8a-6c92-49a4-9160-0e56666eabe3 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:38:38.902491 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-33f2cb8a-6c92-49a4-9160-0e56666eabe3 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] [instance: ec14be1f-7e78-45e3-a70a-587a47b2d1c9] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:38:38.910436 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-33f2cb8a-6c92-49a4-9160-0e56666eabe3 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:38:38.910884 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-33f2cb8a-6c92-49a4-9160-0e56666eabe3 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:38:38.911674 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-33f2cb8a-6c92-49a4-9160-0e56666eabe3 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:38:38.912152 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-33f2cb8a-6c92-49a4-9160-0e56666eabe3 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:38:39.071137 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-33f2cb8a-6c92-49a4-9160-0e56666eabe3 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6921033062424e14bc30f9b94bf911db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bee0d982e3ba4f7dba65f51636856b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:38:39.081456 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-33f2cb8a-6c92-49a4-9160-0e56666eabe3 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] 10.222.0.121 "GET /compute/v2.1/servers/ec14be1f-7e78-45e3-a70a-587a47b2d1c9" status: 200 len: 1262 microversion: 2.1 time: 0.186222 Aug 04 10:38:39.082057 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 323/660] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:38:38 2022] GET /compute/v2.1/servers/ec14be1f-7e78-45e3-a70a-587a47b2d1c9 => generated 1262 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:38:40.111441 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-e1836012-9e39-4d69-aeb1-a907951a7672 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:38:40.112125 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-e1836012-9e39-4d69-aeb1-a907951a7672 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] [instance: ec14be1f-7e78-45e3-a70a-587a47b2d1c9] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:38:40.120636 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-e1836012-9e39-4d69-aeb1-a907951a7672 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:38:40.121222 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-e1836012-9e39-4d69-aeb1-a907951a7672 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:38:40.122334 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-e1836012-9e39-4d69-aeb1-a907951a7672 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:38:40.122929 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-e1836012-9e39-4d69-aeb1-a907951a7672 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:38:40.277321 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-e1836012-9e39-4d69-aeb1-a907951a7672 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6921033062424e14bc30f9b94bf911db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bee0d982e3ba4f7dba65f51636856b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:38:40.286425 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-e1836012-9e39-4d69-aeb1-a907951a7672 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] 10.222.0.121 "GET /compute/v2.1/servers/ec14be1f-7e78-45e3-a70a-587a47b2d1c9" status: 200 len: 1262 microversion: 2.1 time: 0.179173 Aug 04 10:38:40.287797 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 338/661] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:38:40 2022] GET /compute/v2.1/servers/ec14be1f-7e78-45e3-a70a-587a47b2d1c9 => generated 1262 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:38:41.308491 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-21d90228-2428-4601-8a7d-f4af66b5f730 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:38:41.309131 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-21d90228-2428-4601-8a7d-f4af66b5f730 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] [instance: ec14be1f-7e78-45e3-a70a-587a47b2d1c9] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:38:41.316251 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-21d90228-2428-4601-8a7d-f4af66b5f730 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:38:41.316705 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-21d90228-2428-4601-8a7d-f4af66b5f730 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:38:41.317478 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-21d90228-2428-4601-8a7d-f4af66b5f730 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:38:41.317921 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-21d90228-2428-4601-8a7d-f4af66b5f730 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:38:41.487512 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-21d90228-2428-4601-8a7d-f4af66b5f730 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6921033062424e14bc30f9b94bf911db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bee0d982e3ba4f7dba65f51636856b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:38:41.495551 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-21d90228-2428-4601-8a7d-f4af66b5f730 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] 10.222.0.121 "GET /compute/v2.1/servers/ec14be1f-7e78-45e3-a70a-587a47b2d1c9" status: 200 len: 1262 microversion: 2.1 time: 0.191309 Aug 04 10:38:41.496415 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 324/662] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:38:41 2022] GET /compute/v2.1/servers/ec14be1f-7e78-45e3-a70a-587a47b2d1c9 => generated 1262 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:38:42.052155 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-388557dc-b99d-4a6c-ad09-a9acea8be01a tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1782708720", "imageRef": "46724bb5-955f-4f3f-bd6a-b561fdde55e3", "flavorRef": "452", "networks": [{"uuid": "da818991-7f34-479b-940a-a8a044d43867"}]}} {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:38:42.110860 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.network.neutron [None req-388557dc-b99d-4a6c-ad09-a9acea8be01a tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] validate_networks() for [('da818991-7f34-479b-940a-a8a044d43867', None, None, None, None, None)] {{(pid=124457) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 10:38:42.511067 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.virt.hardware [None req-388557dc-b99d-4a6c-ad09-a9acea8be01a tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Flavor limits 0:0:0 {{(pid=124457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 10:38:42.511524 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.virt.hardware [None req-388557dc-b99d-4a6c-ad09-a9acea8be01a tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Image limits 0:0:0 {{(pid=124457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 10:38:42.511996 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.virt.hardware [None req-388557dc-b99d-4a6c-ad09-a9acea8be01a tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Flavor pref 0:0:0 {{(pid=124457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 10:38:42.512437 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.virt.hardware [None req-388557dc-b99d-4a6c-ad09-a9acea8be01a tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Image pref 0:0:0 {{(pid=124457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 10:38:42.512851 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.virt.hardware [None req-388557dc-b99d-4a6c-ad09-a9acea8be01a tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 10:38:42.516904 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-4137161f-9b03-4038-844d-0571287c37e3 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:38:42.517501 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-4137161f-9b03-4038-844d-0571287c37e3 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] [instance: ec14be1f-7e78-45e3-a70a-587a47b2d1c9] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:38:42.522769 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-388557dc-b99d-4a6c-ad09-a9acea8be01a tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:38:42.523221 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-388557dc-b99d-4a6c-ad09-a9acea8be01a tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:38:42.524083 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-388557dc-b99d-4a6c-ad09-a9acea8be01a tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:38:42.524525 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-388557dc-b99d-4a6c-ad09-a9acea8be01a tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:38:42.524665 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-4137161f-9b03-4038-844d-0571287c37e3 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:38:42.525072 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-4137161f-9b03-4038-844d-0571287c37e3 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:38:42.525847 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-4137161f-9b03-4038-844d-0571287c37e3 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:38:42.526284 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-4137161f-9b03-4038-844d-0571287c37e3 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:38:42.545044 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.quota [None req-388557dc-b99d-4a6c-ad09-a9acea8be01a tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Getting quotas for project aacec5c4a2584f60af1ca9843e9e8732. Resources: {'ram', 'instances', 'cores'} {{(pid=124457) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 10:38:42.549755 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.quota [None req-388557dc-b99d-4a6c-ad09-a9acea8be01a tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Getting quotas for user db9e00718840481ca416e25ef436bb24 and project aacec5c4a2584f60af1ca9843e9e8732. Resources: {'ram', 'instances', 'cores'} {{(pid=124457) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 10:38:42.563443 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-388557dc-b99d-4a6c-ad09-a9acea8be01a tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Going to run 1 instances... {{(pid=124457) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 10:38:42.565815 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-388557dc-b99d-4a6c-ad09-a9acea8be01a tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] [instance: 9f04c3fe-f5f2-453a-946b-974c9b77a392] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='46724bb5-955f-4f3f-bd6a-b561fdde55e3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124457) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 10:38:42.615467 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-388557dc-b99d-4a6c-ad09-a9acea8be01a tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] 10.222.0.121 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 0.567414 Aug 04 10:38:42.616552 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 339/663] 10.222.0.121 () {60 vars in 1152 bytes} [Thu Aug 4 10:38:42 2022] POST /compute/v2.1/servers => generated 382 bytes in 569 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 04 10:38:42.627712 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-d97cbdd7-a485-4e13-9445-4a9fd08f8736 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:38:42.628386 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-d97cbdd7-a485-4e13-9445-4a9fd08f8736 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] [instance: 9f04c3fe-f5f2-453a-946b-974c9b77a392] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:38:42.685892 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-4137161f-9b03-4038-844d-0571287c37e3 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6921033062424e14bc30f9b94bf911db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bee0d982e3ba4f7dba65f51636856b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:38:42.697144 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-4137161f-9b03-4038-844d-0571287c37e3 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] 10.222.0.121 "GET /compute/v2.1/servers/ec14be1f-7e78-45e3-a70a-587a47b2d1c9" status: 200 len: 1262 microversion: 2.1 time: 0.184550 Aug 04 10:38:42.699073 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 325/664] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:38:42 2022] GET /compute/v2.1/servers/ec14be1f-7e78-45e3-a70a-587a47b2d1c9 => generated 1262 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:38:42.704247 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-d97cbdd7-a485-4e13-9445-4a9fd08f8736 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9e00718840481ca416e25ef436bb24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacec5c4a2584f60af1ca9843e9e8732', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:38:42.712329 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-d97cbdd7-a485-4e13-9445-4a9fd08f8736 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] 10.222.0.121 "GET /compute/v2.1/servers/9f04c3fe-f5f2-453a-946b-974c9b77a392" status: 200 len: 1223 microversion: 2.1 time: 0.088302 Aug 04 10:38:42.713394 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 340/665] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:38:42 2022] GET /compute/v2.1/servers/9f04c3fe-f5f2-453a-946b-974c9b77a392 => generated 1223 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:38:43.192078 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [req-1df8bc5c-8780-459e-b90c-60221fec2eca req-537aa4ac-e4b4-4828-b705-5cf7978e5e96 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec14be1f-7e78-45e3-a70a-587a47b2d1c9", "name": "network-vif-plugged", "status": "completed", "tag": "c3025d1c-cab8-4711-9bcc-0663813275c3"}]} {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:38:43.205051 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [req-1df8bc5c-8780-459e-b90c-60221fec2eca req-537aa4ac-e4b4-4828-b705-5cf7978e5e96 service nova] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:38:43.205556 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [req-1df8bc5c-8780-459e-b90c-60221fec2eca req-537aa4ac-e4b4-4828-b705-5cf7978e5e96 service nova] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:38:43.219833 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.compute.server_external_events [req-1df8bc5c-8780-459e-b90c-60221fec2eca req-537aa4ac-e4b4-4828-b705-5cf7978e5e96 service nova] Creating event network-vif-plugged:c3025d1c-cab8-4711-9bcc-0663813275c3 for instance ec14be1f-7e78-45e3-a70a-587a47b2d1c9 on hv-cinder-85200 Aug 04 10:38:43.226388 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [req-1df8bc5c-8780-459e-b90c-60221fec2eca req-537aa4ac-e4b4-4828-b705-5cf7978e5e96 service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038080 Aug 04 10:38:43.227053 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 326/666] 10.222.0.121 () {64 vars in 1322 bytes} [Thu Aug 4 10:38:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:38:43.722738 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-0622655d-f3c9-4fe2-b61b-b84e523062fe tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:38:43.723428 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-0622655d-f3c9-4fe2-b61b-b84e523062fe tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] [instance: ec14be1f-7e78-45e3-a70a-587a47b2d1c9] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:38:43.731898 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-0622655d-f3c9-4fe2-b61b-b84e523062fe tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:38:43.732406 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-0622655d-f3c9-4fe2-b61b-b84e523062fe tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:38:43.733194 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-0622655d-f3c9-4fe2-b61b-b84e523062fe tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:38:43.733652 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-0622655d-f3c9-4fe2-b61b-b84e523062fe tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:38:43.735528 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-11a555f7-f5dd-4482-a805-ff4834206d84 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:38:43.736264 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-11a555f7-f5dd-4482-a805-ff4834206d84 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] [instance: 9f04c3fe-f5f2-453a-946b-974c9b77a392] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:38:43.743561 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-11a555f7-f5dd-4482-a805-ff4834206d84 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:38:43.744054 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-11a555f7-f5dd-4482-a805-ff4834206d84 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:38:43.744868 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-11a555f7-f5dd-4482-a805-ff4834206d84 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:38:43.745498 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-11a555f7-f5dd-4482-a805-ff4834206d84 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:38:43.761659 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG dbcounter [-] [124456] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:38:43.879761 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-11a555f7-f5dd-4482-a805-ff4834206d84 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9e00718840481ca416e25ef436bb24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacec5c4a2584f60af1ca9843e9e8732', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:38:43.889712 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-11a555f7-f5dd-4482-a805-ff4834206d84 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] 10.222.0.121 "GET /compute/v2.1/servers/9f04c3fe-f5f2-453a-946b-974c9b77a392" status: 200 len: 1275 microversion: 2.1 time: 0.158971 Aug 04 10:38:43.897547 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 327/667] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:38:43 2022] GET /compute/v2.1/servers/9f04c3fe-f5f2-453a-946b-974c9b77a392 => generated 1275 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:38:44.045998 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-0622655d-f3c9-4fe2-b61b-b84e523062fe tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6921033062424e14bc30f9b94bf911db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bee0d982e3ba4f7dba65f51636856b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:38:44.055189 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-0622655d-f3c9-4fe2-b61b-b84e523062fe tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] 10.222.0.121 "GET /compute/v2.1/servers/ec14be1f-7e78-45e3-a70a-587a47b2d1c9" status: 200 len: 1262 microversion: 2.1 time: 0.336736 Aug 04 10:38:44.056010 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 341/668] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:38:43 2022] GET /compute/v2.1/servers/ec14be1f-7e78-45e3-a70a-587a47b2d1c9 => generated 1262 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:38:44.919921 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-f0d4828d-9059-42d2-a492-ef4325e16ab2 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:38:44.921230 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-f0d4828d-9059-42d2-a492-ef4325e16ab2 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] [instance: 9f04c3fe-f5f2-453a-946b-974c9b77a392] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:38:44.928634 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-f0d4828d-9059-42d2-a492-ef4325e16ab2 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:38:44.929082 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-f0d4828d-9059-42d2-a492-ef4325e16ab2 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:38:44.929888 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-f0d4828d-9059-42d2-a492-ef4325e16ab2 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:38:44.930324 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-f0d4828d-9059-42d2-a492-ef4325e16ab2 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:38:45.009134 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-f0d4828d-9059-42d2-a492-ef4325e16ab2 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9e00718840481ca416e25ef436bb24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacec5c4a2584f60af1ca9843e9e8732', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:38:45.017301 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-f0d4828d-9059-42d2-a492-ef4325e16ab2 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] 10.222.0.121 "GET /compute/v2.1/servers/9f04c3fe-f5f2-453a-946b-974c9b77a392" status: 200 len: 1281 microversion: 2.1 time: 0.102127 Aug 04 10:38:45.017873 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 328/669] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:38:44 2022] GET /compute/v2.1/servers/9f04c3fe-f5f2-453a-946b-974c9b77a392 => generated 1281 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:38:45.080239 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-da318ce1-1f44-4f3a-9330-b20ebb3ba312 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:38:45.081038 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-da318ce1-1f44-4f3a-9330-b20ebb3ba312 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] [instance: ec14be1f-7e78-45e3-a70a-587a47b2d1c9] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:38:45.088179 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-da318ce1-1f44-4f3a-9330-b20ebb3ba312 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:38:45.088648 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-da318ce1-1f44-4f3a-9330-b20ebb3ba312 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:38:45.089453 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-da318ce1-1f44-4f3a-9330-b20ebb3ba312 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:38:45.089902 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-da318ce1-1f44-4f3a-9330-b20ebb3ba312 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:38:45.277435 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-da318ce1-1f44-4f3a-9330-b20ebb3ba312 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6921033062424e14bc30f9b94bf911db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bee0d982e3ba4f7dba65f51636856b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:38:45.286026 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-da318ce1-1f44-4f3a-9330-b20ebb3ba312 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] 10.222.0.121 "GET /compute/v2.1/servers/ec14be1f-7e78-45e3-a70a-587a47b2d1c9" status: 200 len: 1262 microversion: 2.1 time: 0.210817 Aug 04 10:38:45.286614 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 342/670] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:38:45 2022] GET /compute/v2.1/servers/ec14be1f-7e78-45e3-a70a-587a47b2d1c9 => generated 1262 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:38:46.041562 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-a0008b15-5d3a-4a90-b67f-a38085c2c458 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:38:46.042260 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-a0008b15-5d3a-4a90-b67f-a38085c2c458 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] [instance: 9f04c3fe-f5f2-453a-946b-974c9b77a392] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:38:46.048907 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-a0008b15-5d3a-4a90-b67f-a38085c2c458 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:38:46.049370 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-a0008b15-5d3a-4a90-b67f-a38085c2c458 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:38:46.050179 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-a0008b15-5d3a-4a90-b67f-a38085c2c458 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:38:46.050627 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-a0008b15-5d3a-4a90-b67f-a38085c2c458 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:38:46.279660 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-a0008b15-5d3a-4a90-b67f-a38085c2c458 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9e00718840481ca416e25ef436bb24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacec5c4a2584f60af1ca9843e9e8732', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:38:46.294975 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-a0008b15-5d3a-4a90-b67f-a38085c2c458 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] 10.222.0.121 "GET /compute/v2.1/servers/9f04c3fe-f5f2-453a-946b-974c9b77a392" status: 200 len: 1323 microversion: 2.1 time: 0.258516 Aug 04 10:38:46.308685 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 329/671] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:38:46 2022] GET /compute/v2.1/servers/9f04c3fe-f5f2-453a-946b-974c9b77a392 => generated 1323 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:38:46.321794 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-f14b3883-220e-4ac5-bee7-e3c918066d44 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:38:46.322503 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-f14b3883-220e-4ac5-bee7-e3c918066d44 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] [instance: ec14be1f-7e78-45e3-a70a-587a47b2d1c9] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:38:46.329556 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-f14b3883-220e-4ac5-bee7-e3c918066d44 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:38:46.330041 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-f14b3883-220e-4ac5-bee7-e3c918066d44 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:38:46.330841 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-f14b3883-220e-4ac5-bee7-e3c918066d44 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:38:46.331310 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-f14b3883-220e-4ac5-bee7-e3c918066d44 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:38:46.333160 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [req-eb0a8746-3bc1-45d7-8482-e59c4afa9b35 req-467f7de0-5b1a-4231-bdad-b3b7a9742a21 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f04c3fe-f5f2-453a-946b-974c9b77a392", "tag": "9e74cc34-c224-411e-a407-81074c758b01"}]} {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:38:46.342950 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [req-eb0a8746-3bc1-45d7-8482-e59c4afa9b35 req-467f7de0-5b1a-4231-bdad-b3b7a9742a21 service nova] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:38:46.343398 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [req-eb0a8746-3bc1-45d7-8482-e59c4afa9b35 req-467f7de0-5b1a-4231-bdad-b3b7a9742a21 service nova] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:38:46.357022 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.compute.server_external_events [req-eb0a8746-3bc1-45d7-8482-e59c4afa9b35 req-467f7de0-5b1a-4231-bdad-b3b7a9742a21 service nova] Creating event network-changed:9e74cc34-c224-411e-a407-81074c758b01 for instance 9f04c3fe-f5f2-453a-946b-974c9b77a392 on hv-cinder-85200 Aug 04 10:38:46.362295 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [req-eb0a8746-3bc1-45d7-8482-e59c4afa9b35 req-467f7de0-5b1a-4231-bdad-b3b7a9742a21 service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104981 Aug 04 10:38:46.362955 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 343/672] 10.222.0.121 () {64 vars in 1322 bytes} [Thu Aug 4 10:38:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 10:38:46.489514 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-f14b3883-220e-4ac5-bee7-e3c918066d44 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6921033062424e14bc30f9b94bf911db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bee0d982e3ba4f7dba65f51636856b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:38:46.497708 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-f14b3883-220e-4ac5-bee7-e3c918066d44 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] 10.222.0.121 "GET /compute/v2.1/servers/ec14be1f-7e78-45e3-a70a-587a47b2d1c9" status: 200 len: 1262 microversion: 2.1 time: 0.187320 Aug 04 10:38:46.498467 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 330/673] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:38:46 2022] GET /compute/v2.1/servers/ec14be1f-7e78-45e3-a70a-587a47b2d1c9 => generated 1262 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:38:47.328322 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-afcf2cdd-441c-4e4b-91c0-3d80555c6a07 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:38:47.329033 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-afcf2cdd-441c-4e4b-91c0-3d80555c6a07 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] [instance: 9f04c3fe-f5f2-453a-946b-974c9b77a392] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:38:47.336411 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-afcf2cdd-441c-4e4b-91c0-3d80555c6a07 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:38:47.337125 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-afcf2cdd-441c-4e4b-91c0-3d80555c6a07 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:38:47.337657 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-afcf2cdd-441c-4e4b-91c0-3d80555c6a07 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:38:47.338103 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-afcf2cdd-441c-4e4b-91c0-3d80555c6a07 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:38:47.519059 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-9718406b-7ed9-46aa-adb9-b94dc4f8c7e7 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:38:47.519857 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-9718406b-7ed9-46aa-adb9-b94dc4f8c7e7 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] [instance: ec14be1f-7e78-45e3-a70a-587a47b2d1c9] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:38:47.527816 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-9718406b-7ed9-46aa-adb9-b94dc4f8c7e7 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:38:47.528312 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-9718406b-7ed9-46aa-adb9-b94dc4f8c7e7 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:38:47.529367 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-9718406b-7ed9-46aa-adb9-b94dc4f8c7e7 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:38:47.529823 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-9718406b-7ed9-46aa-adb9-b94dc4f8c7e7 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:38:47.637822 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-afcf2cdd-441c-4e4b-91c0-3d80555c6a07 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9e00718840481ca416e25ef436bb24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacec5c4a2584f60af1ca9843e9e8732', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:38:47.646101 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-afcf2cdd-441c-4e4b-91c0-3d80555c6a07 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] 10.222.0.121 "GET /compute/v2.1/servers/9f04c3fe-f5f2-453a-946b-974c9b77a392" status: 200 len: 1323 microversion: 2.1 time: 0.322789 Aug 04 10:38:47.646948 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 344/674] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:38:47 2022] GET /compute/v2.1/servers/9f04c3fe-f5f2-453a-946b-974c9b77a392 => generated 1323 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:38:47.776316 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-9718406b-7ed9-46aa-adb9-b94dc4f8c7e7 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6921033062424e14bc30f9b94bf911db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bee0d982e3ba4f7dba65f51636856b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:38:47.785321 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-9718406b-7ed9-46aa-adb9-b94dc4f8c7e7 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] 10.222.0.121 "GET /compute/v2.1/servers/ec14be1f-7e78-45e3-a70a-587a47b2d1c9" status: 200 len: 1445 microversion: 2.1 time: 0.271009 Aug 04 10:38:47.785923 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 331/675] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:38:47 2022] GET /compute/v2.1/servers/ec14be1f-7e78-45e3-a70a-587a47b2d1c9 => generated 1445 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:38:47.806793 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-87ae528f-790b-43fb-9040-9cd8e25c88b0 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:38:47.807432 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-87ae528f-790b-43fb-9040-9cd8e25c88b0 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] [instance: ec14be1f-7e78-45e3-a70a-587a47b2d1c9] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:38:47.813996 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-87ae528f-790b-43fb-9040-9cd8e25c88b0 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:38:47.814466 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-87ae528f-790b-43fb-9040-9cd8e25c88b0 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:38:47.815255 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-87ae528f-790b-43fb-9040-9cd8e25c88b0 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:38:47.815705 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-87ae528f-790b-43fb-9040-9cd8e25c88b0 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:38:47.976748 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-87ae528f-790b-43fb-9040-9cd8e25c88b0 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6921033062424e14bc30f9b94bf911db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bee0d982e3ba4f7dba65f51636856b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:38:47.986465 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-87ae528f-790b-43fb-9040-9cd8e25c88b0 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] 10.222.0.121 "GET /compute/v2.1/servers/ec14be1f-7e78-45e3-a70a-587a47b2d1c9" status: 200 len: 1445 microversion: 2.1 time: 0.183739 Aug 04 10:38:47.987084 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 345/676] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:38:47 2022] GET /compute/v2.1/servers/ec14be1f-7e78-45e3-a70a-587a47b2d1c9 => generated 1445 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:38:48.667388 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-f20712cd-0504-4cba-83ff-4b81b339a637 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:38:48.668154 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-f20712cd-0504-4cba-83ff-4b81b339a637 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] [instance: 9f04c3fe-f5f2-453a-946b-974c9b77a392] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:38:48.675566 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-f20712cd-0504-4cba-83ff-4b81b339a637 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:38:48.676138 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-f20712cd-0504-4cba-83ff-4b81b339a637 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:38:48.676986 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-f20712cd-0504-4cba-83ff-4b81b339a637 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:38:48.677668 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-f20712cd-0504-4cba-83ff-4b81b339a637 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:38:48.816858 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-f20712cd-0504-4cba-83ff-4b81b339a637 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9e00718840481ca416e25ef436bb24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacec5c4a2584f60af1ca9843e9e8732', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:38:48.825411 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-f20712cd-0504-4cba-83ff-4b81b339a637 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] 10.222.0.121 "GET /compute/v2.1/servers/9f04c3fe-f5f2-453a-946b-974c9b77a392" status: 200 len: 1323 microversion: 2.1 time: 0.162158 Aug 04 10:38:48.826001 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 332/677] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:38:48 2022] GET /compute/v2.1/servers/9f04c3fe-f5f2-453a-946b-974c9b77a392 => generated 1323 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:38:49.849814 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-948a46ef-e51d-42dd-bf5e-8c1eeea44c73 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:38:49.851709 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-948a46ef-e51d-42dd-bf5e-8c1eeea44c73 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] [instance: 9f04c3fe-f5f2-453a-946b-974c9b77a392] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:38:49.860495 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-948a46ef-e51d-42dd-bf5e-8c1eeea44c73 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:38:49.861316 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-948a46ef-e51d-42dd-bf5e-8c1eeea44c73 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:38:49.862309 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-948a46ef-e51d-42dd-bf5e-8c1eeea44c73 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:38:49.862932 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-948a46ef-e51d-42dd-bf5e-8c1eeea44c73 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:38:49.972885 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [req-6f20dd79-cc62-48c3-bd2b-a4c212d47a34 req-d40189a5-7509-4efa-ba0b-c5b97192012a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec14be1f-7e78-45e3-a70a-587a47b2d1c9", "tag": "c3025d1c-cab8-4711-9bcc-0663813275c3"}]} {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:38:49.986525 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [req-6f20dd79-cc62-48c3-bd2b-a4c212d47a34 req-d40189a5-7509-4efa-ba0b-c5b97192012a service nova] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:38:49.987264 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [req-6f20dd79-cc62-48c3-bd2b-a4c212d47a34 req-d40189a5-7509-4efa-ba0b-c5b97192012a service nova] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:38:50.001378 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.compute.server_external_events [req-6f20dd79-cc62-48c3-bd2b-a4c212d47a34 req-d40189a5-7509-4efa-ba0b-c5b97192012a service nova] Creating event network-changed:c3025d1c-cab8-4711-9bcc-0663813275c3 for instance ec14be1f-7e78-45e3-a70a-587a47b2d1c9 on hv-cinder-85200 Aug 04 10:38:50.007120 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [req-6f20dd79-cc62-48c3-bd2b-a4c212d47a34 req-d40189a5-7509-4efa-ba0b-c5b97192012a service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109034 Aug 04 10:38:50.008226 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 333/678] 10.222.0.121 () {64 vars in 1322 bytes} [Thu Aug 4 10:38:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 10:38:50.282163 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-948a46ef-e51d-42dd-bf5e-8c1eeea44c73 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9e00718840481ca416e25ef436bb24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacec5c4a2584f60af1ca9843e9e8732', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:38:50.290232 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-948a46ef-e51d-42dd-bf5e-8c1eeea44c73 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] 10.222.0.121 "GET /compute/v2.1/servers/9f04c3fe-f5f2-453a-946b-974c9b77a392" status: 200 len: 1323 microversion: 2.1 time: 0.446133 Aug 04 10:38:50.291085 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 346/679] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:38:49 2022] GET /compute/v2.1/servers/9f04c3fe-f5f2-453a-946b-974c9b77a392 => generated 1323 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:38:51.314016 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-5eef183d-6f88-4eea-837f-8f86ccdbf49d tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:38:51.314646 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-5eef183d-6f88-4eea-837f-8f86ccdbf49d tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] [instance: 9f04c3fe-f5f2-453a-946b-974c9b77a392] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:38:51.322141 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-5eef183d-6f88-4eea-837f-8f86ccdbf49d tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:38:51.322604 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-5eef183d-6f88-4eea-837f-8f86ccdbf49d tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:38:51.323398 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-5eef183d-6f88-4eea-837f-8f86ccdbf49d tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:38:51.323880 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-5eef183d-6f88-4eea-837f-8f86ccdbf49d tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:38:51.477601 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-5eef183d-6f88-4eea-837f-8f86ccdbf49d tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9e00718840481ca416e25ef436bb24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacec5c4a2584f60af1ca9843e9e8732', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:38:51.488593 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-5eef183d-6f88-4eea-837f-8f86ccdbf49d tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] 10.222.0.121 "GET /compute/v2.1/servers/9f04c3fe-f5f2-453a-946b-974c9b77a392" status: 200 len: 1323 microversion: 2.1 time: 0.179476 Aug 04 10:38:51.492457 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 334/680] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:38:51 2022] GET /compute/v2.1/servers/9f04c3fe-f5f2-453a-946b-974c9b77a392 => generated 1323 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:38:52.529846 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-a48c3476-7ec6-4bf9-9c5c-df514fc4dd08 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:38:52.530617 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-a48c3476-7ec6-4bf9-9c5c-df514fc4dd08 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] [instance: 9f04c3fe-f5f2-453a-946b-974c9b77a392] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:38:52.533179 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG dbcounter [-] [124457] Writing DB stats nova_cell0:SELECT=2 {{(pid=124457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:38:52.540212 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-a48c3476-7ec6-4bf9-9c5c-df514fc4dd08 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:38:52.540804 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-a48c3476-7ec6-4bf9-9c5c-df514fc4dd08 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:38:52.541508 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-a48c3476-7ec6-4bf9-9c5c-df514fc4dd08 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:38:52.541962 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-a48c3476-7ec6-4bf9-9c5c-df514fc4dd08 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:38:52.709371 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG dbcounter [-] [124457] Writing DB stats nova_cell0:SELECT=8 {{(pid=124457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:38:52.916454 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-a48c3476-7ec6-4bf9-9c5c-df514fc4dd08 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9e00718840481ca416e25ef436bb24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacec5c4a2584f60af1ca9843e9e8732', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:38:52.942105 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-a48c3476-7ec6-4bf9-9c5c-df514fc4dd08 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] 10.222.0.121 "GET /compute/v2.1/servers/9f04c3fe-f5f2-453a-946b-974c9b77a392" status: 200 len: 1323 microversion: 2.1 time: 0.414211 Aug 04 10:38:52.942105 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 347/681] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:38:52 2022] GET /compute/v2.1/servers/9f04c3fe-f5f2-453a-946b-974c9b77a392 => generated 1323 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:38:53.968652 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-5191c864-30e6-46d2-a501-8d6bbed470ed tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:38:53.969577 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-5191c864-30e6-46d2-a501-8d6bbed470ed tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] [instance: 9f04c3fe-f5f2-453a-946b-974c9b77a392] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:38:53.972516 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG dbcounter [-] [124456] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=1 {{(pid=124456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:38:53.980520 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-5191c864-30e6-46d2-a501-8d6bbed470ed tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:38:53.981586 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-5191c864-30e6-46d2-a501-8d6bbed470ed tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:38:53.982811 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-5191c864-30e6-46d2-a501-8d6bbed470ed tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:38:53.983269 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-5191c864-30e6-46d2-a501-8d6bbed470ed tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:38:54.154924 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-5191c864-30e6-46d2-a501-8d6bbed470ed tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9e00718840481ca416e25ef436bb24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacec5c4a2584f60af1ca9843e9e8732', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:38:54.163641 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-5191c864-30e6-46d2-a501-8d6bbed470ed tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] 10.222.0.121 "GET /compute/v2.1/servers/9f04c3fe-f5f2-453a-946b-974c9b77a392" status: 200 len: 1323 microversion: 2.1 time: 0.199970 Aug 04 10:38:54.164375 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 335/682] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:38:53 2022] GET /compute/v2.1/servers/9f04c3fe-f5f2-453a-946b-974c9b77a392 => generated 1323 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:38:55.187202 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-9e799243-c09f-4234-8baf-c2616c6d06ad tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:38:55.187978 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-9e799243-c09f-4234-8baf-c2616c6d06ad tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] [instance: 9f04c3fe-f5f2-453a-946b-974c9b77a392] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:38:55.197033 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-9e799243-c09f-4234-8baf-c2616c6d06ad tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:38:55.197521 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-9e799243-c09f-4234-8baf-c2616c6d06ad tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:38:55.198332 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-9e799243-c09f-4234-8baf-c2616c6d06ad tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:38:55.198780 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-9e799243-c09f-4234-8baf-c2616c6d06ad tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:38:55.351712 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-9e799243-c09f-4234-8baf-c2616c6d06ad tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9e00718840481ca416e25ef436bb24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacec5c4a2584f60af1ca9843e9e8732', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:38:55.366200 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-9e799243-c09f-4234-8baf-c2616c6d06ad tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] 10.222.0.121 "GET /compute/v2.1/servers/9f04c3fe-f5f2-453a-946b-974c9b77a392" status: 200 len: 1323 microversion: 2.1 time: 0.182799 Aug 04 10:38:55.367317 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 348/683] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:38:55 2022] GET /compute/v2.1/servers/9f04c3fe-f5f2-453a-946b-974c9b77a392 => generated 1323 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:38:55.503812 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [req-12550df3-801d-427f-8203-db1d0bd35bd5 req-96cd6bc8-e6b4-4c94-8395-c60a962595d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f04c3fe-f5f2-453a-946b-974c9b77a392", "name": "network-vif-plugged", "status": "completed", "tag": "9e74cc34-c224-411e-a407-81074c758b01"}]} {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:38:55.514348 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [req-12550df3-801d-427f-8203-db1d0bd35bd5 req-96cd6bc8-e6b4-4c94-8395-c60a962595d7 service nova] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:38:55.514865 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [req-12550df3-801d-427f-8203-db1d0bd35bd5 req-96cd6bc8-e6b4-4c94-8395-c60a962595d7 service nova] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:38:55.527616 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.compute.server_external_events [req-12550df3-801d-427f-8203-db1d0bd35bd5 req-96cd6bc8-e6b4-4c94-8395-c60a962595d7 service nova] Creating event network-vif-plugged:9e74cc34-c224-411e-a407-81074c758b01 for instance 9f04c3fe-f5f2-453a-946b-974c9b77a392 on hv-cinder-85200 Aug 04 10:38:55.532990 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [req-12550df3-801d-427f-8203-db1d0bd35bd5 req-96cd6bc8-e6b4-4c94-8395-c60a962595d7 service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125696 Aug 04 10:38:55.533638 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 336/684] 10.222.0.121 () {64 vars in 1322 bytes} [Thu Aug 4 10:38:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:38:56.401141 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-326aa793-3fc6-4428-802c-fb0a20f12061 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:38:56.401913 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-326aa793-3fc6-4428-802c-fb0a20f12061 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] [instance: 9f04c3fe-f5f2-453a-946b-974c9b77a392] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:38:56.409467 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-326aa793-3fc6-4428-802c-fb0a20f12061 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:38:56.409928 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-326aa793-3fc6-4428-802c-fb0a20f12061 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:38:56.410745 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-326aa793-3fc6-4428-802c-fb0a20f12061 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:38:56.411192 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-326aa793-3fc6-4428-802c-fb0a20f12061 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:38:56.593040 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-326aa793-3fc6-4428-802c-fb0a20f12061 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9e00718840481ca416e25ef436bb24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacec5c4a2584f60af1ca9843e9e8732', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:38:56.602818 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-326aa793-3fc6-4428-802c-fb0a20f12061 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] 10.222.0.121 "GET /compute/v2.1/servers/9f04c3fe-f5f2-453a-946b-974c9b77a392" status: 200 len: 1323 microversion: 2.1 time: 0.205331 Aug 04 10:38:56.603438 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 349/685] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:38:56 2022] GET /compute/v2.1/servers/9f04c3fe-f5f2-453a-946b-974c9b77a392 => generated 1323 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:38:57.630389 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-ad18c9ea-2a5e-472d-8c8d-98fb99f074c5 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:38:57.631329 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-ad18c9ea-2a5e-472d-8c8d-98fb99f074c5 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] [instance: 9f04c3fe-f5f2-453a-946b-974c9b77a392] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:38:57.639707 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-ad18c9ea-2a5e-472d-8c8d-98fb99f074c5 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:38:57.640379 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-ad18c9ea-2a5e-472d-8c8d-98fb99f074c5 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:38:57.641628 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-ad18c9ea-2a5e-472d-8c8d-98fb99f074c5 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:38:57.642175 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-ad18c9ea-2a5e-472d-8c8d-98fb99f074c5 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:38:57.811788 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-ad18c9ea-2a5e-472d-8c8d-98fb99f074c5 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9e00718840481ca416e25ef436bb24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacec5c4a2584f60af1ca9843e9e8732', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:38:57.820404 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-ad18c9ea-2a5e-472d-8c8d-98fb99f074c5 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] 10.222.0.121 "GET /compute/v2.1/servers/9f04c3fe-f5f2-453a-946b-974c9b77a392" status: 200 len: 1323 microversion: 2.1 time: 0.198967 Aug 04 10:38:57.821032 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 337/686] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:38:57 2022] GET /compute/v2.1/servers/9f04c3fe-f5f2-453a-946b-974c9b77a392 => generated 1323 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:38:58.844054 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-daea8e6a-dbe3-4599-8520-9ecf10b87509 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:38:58.844866 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-daea8e6a-dbe3-4599-8520-9ecf10b87509 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] [instance: 9f04c3fe-f5f2-453a-946b-974c9b77a392] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:38:58.852661 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-daea8e6a-dbe3-4599-8520-9ecf10b87509 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:38:58.853123 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-daea8e6a-dbe3-4599-8520-9ecf10b87509 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:38:58.853915 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-daea8e6a-dbe3-4599-8520-9ecf10b87509 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:38:58.854364 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-daea8e6a-dbe3-4599-8520-9ecf10b87509 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:38:59.004953 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-daea8e6a-dbe3-4599-8520-9ecf10b87509 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9e00718840481ca416e25ef436bb24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacec5c4a2584f60af1ca9843e9e8732', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:38:59.013649 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-daea8e6a-dbe3-4599-8520-9ecf10b87509 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] 10.222.0.121 "GET /compute/v2.1/servers/9f04c3fe-f5f2-453a-946b-974c9b77a392" status: 200 len: 1512 microversion: 2.1 time: 0.173756 Aug 04 10:38:59.014635 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 350/687] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:38:58 2022] GET /compute/v2.1/servers/9f04c3fe-f5f2-453a-946b-974c9b77a392 => generated 1512 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:38:59.040039 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-8b9c15bb-a37d-405a-9c28-80aeb8b98fc1 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "47f68c38-da04-450c-b757-c4620464c605", "device": "/dev/sdb"}} {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:38:59.043228 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-8b9c15bb-a37d-405a-9c28-80aeb8b98fc1 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] [instance: 9f04c3fe-f5f2-453a-946b-974c9b77a392] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:38:59.050885 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-8b9c15bb-a37d-405a-9c28-80aeb8b98fc1 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:38:59.051343 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-8b9c15bb-a37d-405a-9c28-80aeb8b98fc1 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:38:59.052196 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-8b9c15bb-a37d-405a-9c28-80aeb8b98fc1 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:38:59.052643 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-8b9c15bb-a37d-405a-9c28-80aeb8b98fc1 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:38:59.367232 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-8b9c15bb-a37d-405a-9c28-80aeb8b98fc1 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] 10.222.0.121 "POST /compute/v2.1/servers/9f04c3fe-f5f2-453a-946b-974c9b77a392/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.332596 Aug 04 10:38:59.367765 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 338/688] 10.222.0.121 () {60 vars in 1328 bytes} [Thu Aug 4 10:38:59 2022] POST /compute/v2.1/servers/9f04c3fe-f5f2-453a-946b-974c9b77a392/os-volume_attachments => generated 194 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:39:24.253048 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-211c439b-af03-48be-b2d2-0b6946b243bd tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:39:24.253824 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-211c439b-af03-48be-b2d2-0b6946b243bd tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] [instance: 9f04c3fe-f5f2-453a-946b-974c9b77a392] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:39:24.255759 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG dbcounter [-] [124457] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=3 {{(pid=124457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:39:24.256547 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG dbcounter [-] [124457] Writing DB stats nova_cell1:SELECT=93 {{(pid=124457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:39:24.265275 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-211c439b-af03-48be-b2d2-0b6946b243bd tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:39:24.265732 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-211c439b-af03-48be-b2d2-0b6946b243bd tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:39:24.266553 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-211c439b-af03-48be-b2d2-0b6946b243bd tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:39:24.267000 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-211c439b-af03-48be-b2d2-0b6946b243bd tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:39:24.371000 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.objects.instance [None req-211c439b-af03-48be-b2d2-0b6946b243bd tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Lazy-loading 'services' on Instance uuid 9f04c3fe-f5f2-453a-946b-974c9b77a392 {{(pid=124457) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 10:39:24.466764 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-211c439b-af03-48be-b2d2-0b6946b243bd tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] 10.222.0.121 "DELETE /compute/v2.1/servers/9f04c3fe-f5f2-453a-946b-974c9b77a392/os-volume_attachments/47f68c38-da04-450c-b757-c4620464c605" status: 202 len: 0 microversion: 2.1 time: 0.216653 Aug 04 10:39:24.467574 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 351/689] 10.222.0.121 () {58 vars in 1421 bytes} [Thu Aug 4 10:39:24 2022] DELETE /compute/v2.1/servers/9f04c3fe-f5f2-453a-946b-974c9b77a392/os-volume_attachments/47f68c38-da04-450c-b757-c4620464c605 => generated 0 bytes in 220 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 10:39:26.680173 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG dbcounter [-] [124456] Writing DB stats nova_api:SELECT=7 {{(pid=124456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:39:26.681194 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG dbcounter [-] [124456] Writing DB stats nova_cell1:SELECT=66,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:39:26.686352 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-6aa24968-c058-43f6-823c-79ccf3d879b0 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:39:26.686975 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-6aa24968-c058-43f6-823c-79ccf3d879b0 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] [instance: 9f04c3fe-f5f2-453a-946b-974c9b77a392] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:39:26.695425 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-6aa24968-c058-43f6-823c-79ccf3d879b0 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:39:26.696153 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-6aa24968-c058-43f6-823c-79ccf3d879b0 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:39:26.696967 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-6aa24968-c058-43f6-823c-79ccf3d879b0 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:39:26.697419 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-6aa24968-c058-43f6-823c-79ccf3d879b0 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:39:26.729458 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-6aa24968-c058-43f6-823c-79ccf3d879b0 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] [instance: 9f04c3fe-f5f2-453a-946b-974c9b77a392] Going to try to terminate instance {{(pid=124456) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 10:39:26.831256 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-6aa24968-c058-43f6-823c-79ccf3d879b0 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] 10.222.0.121 "DELETE /compute/v2.1/servers/9f04c3fe-f5f2-453a-946b-974c9b77a392" status: 204 len: 0 microversion: 2.1 time: 0.152220 Aug 04 10:39:26.832300 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 339/690] 10.222.0.121 () {58 vars in 1244 bytes} [Thu Aug 4 10:39:26 2022] DELETE /compute/v2.1/servers/9f04c3fe-f5f2-453a-946b-974c9b77a392 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 10:39:26.846360 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-4c8829a1-8e3c-49a2-ab12-a32e7ef109a2 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:39:26.847507 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-4c8829a1-8e3c-49a2-ab12-a32e7ef109a2 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] [instance: 9f04c3fe-f5f2-453a-946b-974c9b77a392] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:39:26.857985 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-4c8829a1-8e3c-49a2-ab12-a32e7ef109a2 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:39:26.858778 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-4c8829a1-8e3c-49a2-ab12-a32e7ef109a2 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:39:26.860036 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-4c8829a1-8e3c-49a2-ab12-a32e7ef109a2 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:39:26.860808 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-4c8829a1-8e3c-49a2-ab12-a32e7ef109a2 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:39:27.050430 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-4c8829a1-8e3c-49a2-ab12-a32e7ef109a2 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9e00718840481ca416e25ef436bb24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacec5c4a2584f60af1ca9843e9e8732', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:39:27.060234 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-4c8829a1-8e3c-49a2-ab12-a32e7ef109a2 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] 10.222.0.121 "GET /compute/v2.1/servers/9f04c3fe-f5f2-453a-946b-974c9b77a392" status: 200 len: 1518 microversion: 2.1 time: 0.221732 Aug 04 10:39:27.060947 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 352/691] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:39:26 2022] GET /compute/v2.1/servers/9f04c3fe-f5f2-453a-946b-974c9b77a392 => generated 1518 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:39:28.098829 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-b1487f96-360f-4469-8155-4a0a989530ea tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:39:28.099609 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-b1487f96-360f-4469-8155-4a0a989530ea tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] [instance: 9f04c3fe-f5f2-453a-946b-974c9b77a392] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:39:28.108176 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-b1487f96-360f-4469-8155-4a0a989530ea tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:39:28.108682 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-b1487f96-360f-4469-8155-4a0a989530ea tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:39:28.109610 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-b1487f96-360f-4469-8155-4a0a989530ea tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:39:28.110091 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-b1487f96-360f-4469-8155-4a0a989530ea tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:39:28.280952 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-b1487f96-360f-4469-8155-4a0a989530ea tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9e00718840481ca416e25ef436bb24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacec5c4a2584f60af1ca9843e9e8732', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:39:28.290516 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-b1487f96-360f-4469-8155-4a0a989530ea tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] 10.222.0.121 "GET /compute/v2.1/servers/9f04c3fe-f5f2-453a-946b-974c9b77a392" status: 200 len: 1518 microversion: 2.1 time: 0.196428 Aug 04 10:39:28.291265 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 340/692] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:39:28 2022] GET /compute/v2.1/servers/9f04c3fe-f5f2-453a-946b-974c9b77a392 => generated 1518 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:39:29.315004 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-547a37f4-ab76-448e-9087-31df0c3f4456 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:39:29.315701 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-547a37f4-ab76-448e-9087-31df0c3f4456 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] [instance: 9f04c3fe-f5f2-453a-946b-974c9b77a392] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:39:29.323258 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-547a37f4-ab76-448e-9087-31df0c3f4456 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:39:29.323779 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-547a37f4-ab76-448e-9087-31df0c3f4456 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:39:29.324686 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-547a37f4-ab76-448e-9087-31df0c3f4456 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:39:29.325124 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-547a37f4-ab76-448e-9087-31df0c3f4456 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:39:29.613573 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-547a37f4-ab76-448e-9087-31df0c3f4456 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9e00718840481ca416e25ef436bb24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacec5c4a2584f60af1ca9843e9e8732', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:39:29.622709 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-547a37f4-ab76-448e-9087-31df0c3f4456 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] 10.222.0.121 "GET /compute/v2.1/servers/9f04c3fe-f5f2-453a-946b-974c9b77a392" status: 200 len: 1518 microversion: 2.1 time: 0.312866 Aug 04 10:39:29.623681 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 353/693] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:39:29 2022] GET /compute/v2.1/servers/9f04c3fe-f5f2-453a-946b-974c9b77a392 => generated 1518 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:39:30.085942 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [req-bac32419-d52f-41d7-8225-6411e59b2b3f req-8e911416-f3b8-4660-bf04-b43dc065bce9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f04c3fe-f5f2-453a-946b-974c9b77a392", "name": "network-vif-deleted", "tag": "9e74cc34-c224-411e-a407-81074c758b01"}]} {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:39:30.097729 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [req-bac32419-d52f-41d7-8225-6411e59b2b3f req-8e911416-f3b8-4660-bf04-b43dc065bce9 service nova] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:39:30.098177 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [req-bac32419-d52f-41d7-8225-6411e59b2b3f req-8e911416-f3b8-4660-bf04-b43dc065bce9 service nova] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:39:30.114818 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.compute.server_external_events [req-bac32419-d52f-41d7-8225-6411e59b2b3f req-8e911416-f3b8-4660-bf04-b43dc065bce9 service nova] Creating event network-vif-deleted:9e74cc34-c224-411e-a407-81074c758b01 for instance 9f04c3fe-f5f2-453a-946b-974c9b77a392 on hv-cinder-85200 Aug 04 10:39:30.121143 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [req-bac32419-d52f-41d7-8225-6411e59b2b3f req-8e911416-f3b8-4660-bf04-b43dc065bce9 service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039163 Aug 04 10:39:30.122140 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 341/694] 10.222.0.121 () {64 vars in 1322 bytes} [Thu Aug 4 10:39:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:39:30.645729 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-925c0833-9b70-42bd-8e9a-d2bfc0f53139 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:39:30.646837 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-925c0833-9b70-42bd-8e9a-d2bfc0f53139 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] [instance: 9f04c3fe-f5f2-453a-946b-974c9b77a392] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:39:30.654072 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-925c0833-9b70-42bd-8e9a-d2bfc0f53139 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:39:30.654519 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-925c0833-9b70-42bd-8e9a-d2bfc0f53139 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:39:30.655480 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-925c0833-9b70-42bd-8e9a-d2bfc0f53139 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:39:30.656088 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-925c0833-9b70-42bd-8e9a-d2bfc0f53139 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:39:30.700532 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-925c0833-9b70-42bd-8e9a-d2bfc0f53139 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:39:30.700970 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-925c0833-9b70-42bd-8e9a-d2bfc0f53139 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:39:30.701438 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.objects.instance [None req-925c0833-9b70-42bd-8e9a-d2bfc0f53139 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Lazy-loading 'fault' on Instance uuid 9f04c3fe-f5f2-453a-946b-974c9b77a392 {{(pid=124457) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 10:39:30.754879 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-925c0833-9b70-42bd-8e9a-d2bfc0f53139 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9e00718840481ca416e25ef436bb24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aacec5c4a2584f60af1ca9843e9e8732', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:39:30.767559 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-925c0833-9b70-42bd-8e9a-d2bfc0f53139 tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] 10.222.0.121 "GET /compute/v2.1/servers/9f04c3fe-f5f2-453a-946b-974c9b77a392" status: 200 len: 1313 microversion: 2.1 time: 0.126356 Aug 04 10:39:30.768102 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 354/695] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:39:30 2022] GET /compute/v2.1/servers/9f04c3fe-f5f2-453a-946b-974c9b77a392 => generated 1313 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:39:31.791575 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-0c958c0e-7ff9-407a-95ff-10de77b647ca tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:39:31.792319 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-0c958c0e-7ff9-407a-95ff-10de77b647ca tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] [instance: 9f04c3fe-f5f2-453a-946b-974c9b77a392] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:39:31.799841 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-0c958c0e-7ff9-407a-95ff-10de77b647ca tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:39:31.800501 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-0c958c0e-7ff9-407a-95ff-10de77b647ca tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:39:31.801498 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-0c958c0e-7ff9-407a-95ff-10de77b647ca tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:39:31.801989 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-0c958c0e-7ff9-407a-95ff-10de77b647ca tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:39:31.818326 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.wsgi [None req-0c958c0e-7ff9-407a-95ff-10de77b647ca tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] HTTP exception thrown: Instance 9f04c3fe-f5f2-453a-946b-974c9b77a392 could not be found. Aug 04 10:39:31.820164 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-0c958c0e-7ff9-407a-95ff-10de77b647ca tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Request method failure captured: Aug 04 10:39:31.820164 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: request: GET /compute/v2.1/servers/9f04c3fe-f5f2-453a-946b-974c9b77a392 HTTP/1.1 Aug 04 10:39:31.820164 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: Accept: application/json Aug 04 10:39:31.820164 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: Accept-Encoding: identity Aug 04 10:39:31.820164 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: Connection: close Aug 04 10:39:31.820164 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: Content-Length: 0 Aug 04 10:39:31.820164 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: Content-Type: application/json Aug 04 10:39:31.820164 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: Host: 10.222.0.121 Aug 04 10:39:31.820164 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: Openstack-System-Scope: None Aug 04 10:39:31.820164 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: User-Agent: python-urllib3/1.26.11 Aug 04 10:39:31.820164 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Auth-Token: gAAAAABi66EtWTh6SnTlCi-I0B6RttCfugek-lkS_MEwJekwZ1oU_CXhx69-b1zH31gL6fGIik6VPvMVQjyt8SKEa7LSQ08E0xHQy1t89nK6XhoEKWTUCbLWuNBuk9wK1-Qi2Yoc2qmiSyRS5CR3Zed4w5dKWdu-KHX8JJChiievnw6qixmGgw8 Aug 04 10:39:31.820164 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Domain-Id: None Aug 04 10:39:31.820164 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Domain-Name: None Aug 04 10:39:31.820164 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Identity-Status: Confirmed Aug 04 10:39:31.820164 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Is-Admin-Project: True Aug 04 10:39:31.820164 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Project-Domain-Id: default Aug 04 10:39:31.820164 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Project-Domain-Name: Default Aug 04 10:39:31.820164 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Project-Id: aacec5c4a2584f60af1ca9843e9e8732 Aug 04 10:39:31.820164 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1981735847 Aug 04 10:39:31.820164 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Role: reader,member Aug 04 10:39:31.820164 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Roles: reader,member Aug 04 10:39:31.821978 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/aacec5c4a2584f60af1ca9843e9e8732"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/aacec5c4a2584f60af1ca9843e9e8732"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.121:8080", "publicURL": "http://10.222.0.121:8080/v1/AUTH_aacec5c4a2584f60af1ca9843e9e8732"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2/aacec5c4a2584f60af1ca9843e9e8732"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:9696/networking"}]}] Aug 04 10:39:31.821978 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Tenant: tempest-VolumesSnapshotTestJSON-1981735847 Aug 04 10:39:31.821978 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Tenant-Id: aacec5c4a2584f60af1ca9843e9e8732 Aug 04 10:39:31.821978 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1981735847 Aug 04 10:39:31.821978 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-User: tempest-VolumesSnapshotTestJSON-1981735847-project Aug 04 10:39:31.821978 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-User-Domain-Id: default Aug 04 10:39:31.821978 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-User-Domain-Name: Default Aug 04 10:39:31.821978 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-User-Id: db9e00718840481ca416e25ef436bb24 Aug 04 10:39:31.821978 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-User-Name: tempest-VolumesSnapshotTestJSON-1981735847-project Aug 04 10:39:31.821978 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: method: > Aug 04 10:39:31.821978 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: exception: Instance 9f04c3fe-f5f2-453a-946b-974c9b77a392 could not be found. Aug 04 10:39:31.821978 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: action_args: {'id': '9f04c3fe-f5f2-453a-946b-974c9b77a392'} Aug 04 10:39:31.822930 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 10:39:31.822930 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:39:31.822930 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 10:39:31.822930 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 10:39:31.822930 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 10:39:31.822930 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 10:39:31.822930 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 10:39:31.822930 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 10:39:31.822930 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 10:39:31.822930 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 10:39:31.822930 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f04c3fe-f5f2-453a-946b-974c9b77a392 could not be found. Aug 04 10:39:31.822930 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi Aug 04 10:39:31.822930 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:39:31.822930 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi Aug 04 10:39:31.822930 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:39:31.822930 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:39:31.822930 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:39:31.822930 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 10:39:31.822930 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 10:39:31.822930 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 10:39:31.824887 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 10:39:31.824887 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 10:39:31.824887 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 10:39:31.824887 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 10:39:31.824887 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 10:39:31.824887 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 10:39:31.824887 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 10:39:31.824887 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f04c3fe-f5f2-453a-946b-974c9b77a392 could not be found. Aug 04 10:39:31.824887 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi Aug 04 10:39:31.824887 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:39:31.824887 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi Aug 04 10:39:31.824887 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:39:31.824887 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:39:31.824887 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:39:31.824887 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 10:39:31.824887 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 10:39:31.824887 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f04c3fe-f5f2-453a-946b-974c9b77a392 could not be found. Aug 04 10:39:31.824887 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi Aug 04 10:39:31.826292 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-0c958c0e-7ff9-407a-95ff-10de77b647ca tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] Returning 404 to user: Instance 9f04c3fe-f5f2-453a-946b-974c9b77a392 could not be found. {{(pid=124456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 10:39:31.826292 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-0c958c0e-7ff9-407a-95ff-10de77b647ca tempest-VolumesSnapshotTestJSON-1981735847 tempest-VolumesSnapshotTestJSON-1981735847-project] 10.222.0.121 "GET /compute/v2.1/servers/9f04c3fe-f5f2-453a-946b-974c9b77a392" status: 404 len: 111 microversion: 2.1 time: 0.035203 Aug 04 10:39:31.826292 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 342/696] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:39:31 2022] GET /compute/v2.1/servers/9f04c3fe-f5f2-453a-946b-974c9b77a392 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 10:40:05.013820 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG dbcounter [-] [124457] Writing DB stats nova_api:SELECT=10 {{(pid=124457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:40:05.014727 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG dbcounter [-] [124457] Writing DB stats nova_cell1:SELECT=29,nova_cell1:INSERT=1 {{(pid=124457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:40:05.276690 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-6011e8ff-d710-48b5-8b97-4419a34cee5d tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7f8727a2-14a3-4554-8cd9-3a24eda1ba1d"}} {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:40:05.279265 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-6011e8ff-d710-48b5-8b97-4419a34cee5d tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] [instance: a5fe2c05-1417-4bc2-855e-52c9d7457a49] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:40:05.286221 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-6011e8ff-d710-48b5-8b97-4419a34cee5d tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:40:05.286691 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-6011e8ff-d710-48b5-8b97-4419a34cee5d tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:40:05.287490 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-6011e8ff-d710-48b5-8b97-4419a34cee5d tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:40:05.288001 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-6011e8ff-d710-48b5-8b97-4419a34cee5d tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:40:05.605931 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-6011e8ff-d710-48b5-8b97-4419a34cee5d tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] 10.222.0.121 "POST /compute/v2.1/servers/a5fe2c05-1417-4bc2-855e-52c9d7457a49/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.597163 Aug 04 10:40:05.607025 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 355/697] 10.222.0.121 () {60 vars in 1328 bytes} [Thu Aug 4 10:40:05 2022] POST /compute/v2.1/servers/a5fe2c05-1417-4bc2-855e-52c9d7457a49/os-volume_attachments => generated 194 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 10:40:13.215441 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-eb03b31f-f8bb-4890-8f15-14c23ed4a5aa tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:40:13.217700 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-eb03b31f-f8bb-4890-8f15-14c23ed4a5aa tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] [instance: a5fe2c05-1417-4bc2-855e-52c9d7457a49] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:40:13.220175 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG dbcounter [-] [124456] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=124456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:40:13.220811 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG dbcounter [-] [124456] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:40:13.229168 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-eb03b31f-f8bb-4890-8f15-14c23ed4a5aa tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:40:13.229624 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-eb03b31f-f8bb-4890-8f15-14c23ed4a5aa tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:40:13.230407 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-eb03b31f-f8bb-4890-8f15-14c23ed4a5aa tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:40:13.230850 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-eb03b31f-f8bb-4890-8f15-14c23ed4a5aa tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:40:13.260634 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.objects.instance [None req-eb03b31f-f8bb-4890-8f15-14c23ed4a5aa tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lazy-loading 'flavor' on Instance uuid a5fe2c05-1417-4bc2-855e-52c9d7457a49 {{(pid=124456) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 10:40:13.434375 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-eb03b31f-f8bb-4890-8f15-14c23ed4a5aa tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] 10.222.0.121 "POST /compute/v2.1/servers/a5fe2c05-1417-4bc2-855e-52c9d7457a49/action" status: 200 len: 32 microversion: 2.1 time: 0.222443 Aug 04 10:40:13.434864 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 343/698] 10.222.0.121 () {60 vars in 1283 bytes} [Thu Aug 4 10:40:13 2022] POST /compute/v2.1/servers/a5fe2c05-1417-4bc2-855e-52c9d7457a49/action => generated 32 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 10:40:13.445787 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-fba4900d-cd14-4a6f-8a52-9576f2264e48 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:40:13.446545 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-fba4900d-cd14-4a6f-8a52-9576f2264e48 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] [instance: a5fe2c05-1417-4bc2-855e-52c9d7457a49] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:40:13.453868 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-fba4900d-cd14-4a6f-8a52-9576f2264e48 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:40:13.454328 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-fba4900d-cd14-4a6f-8a52-9576f2264e48 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:40:13.455133 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-fba4900d-cd14-4a6f-8a52-9576f2264e48 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:40:13.455600 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-fba4900d-cd14-4a6f-8a52-9576f2264e48 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:40:13.687443 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-fba4900d-cd14-4a6f-8a52-9576f2264e48 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3170dc3323f54512bc8819c8efa86b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7121bd118a2549c39332cfdb7edaa92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:40:13.695828 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-fba4900d-cd14-4a6f-8a52-9576f2264e48 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] 10.222.0.121 "GET /compute/v2.1/servers/a5fe2c05-1417-4bc2-855e-52c9d7457a49" status: 200 len: 1740 microversion: 2.1 time: 0.254461 Aug 04 10:40:13.696463 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 356/699] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:40:13 2022] GET /compute/v2.1/servers/a5fe2c05-1417-4bc2-855e-52c9d7457a49 => generated 1740 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:40:14.718762 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-b0675b60-9b29-4239-920f-d1d6efd2af6e tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:40:14.719459 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-b0675b60-9b29-4239-920f-d1d6efd2af6e tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] [instance: a5fe2c05-1417-4bc2-855e-52c9d7457a49] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:40:14.729326 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-b0675b60-9b29-4239-920f-d1d6efd2af6e tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:40:14.729760 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-b0675b60-9b29-4239-920f-d1d6efd2af6e tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:40:14.730573 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-b0675b60-9b29-4239-920f-d1d6efd2af6e tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:40:14.731026 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-b0675b60-9b29-4239-920f-d1d6efd2af6e tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:40:14.878762 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-b0675b60-9b29-4239-920f-d1d6efd2af6e tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3170dc3323f54512bc8819c8efa86b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7121bd118a2549c39332cfdb7edaa92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:40:14.891825 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-b0675b60-9b29-4239-920f-d1d6efd2af6e tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] 10.222.0.121 "GET /compute/v2.1/servers/a5fe2c05-1417-4bc2-855e-52c9d7457a49" status: 200 len: 1740 microversion: 2.1 time: 0.177289 Aug 04 10:40:14.892565 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 344/700] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:40:14 2022] GET /compute/v2.1/servers/a5fe2c05-1417-4bc2-855e-52c9d7457a49 => generated 1740 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:40:15.916258 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-2aa946a7-e278-4612-8010-a034b3f91fd1 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:40:15.916909 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-2aa946a7-e278-4612-8010-a034b3f91fd1 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] [instance: a5fe2c05-1417-4bc2-855e-52c9d7457a49] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:40:15.924171 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-2aa946a7-e278-4612-8010-a034b3f91fd1 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:40:15.924628 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-2aa946a7-e278-4612-8010-a034b3f91fd1 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:40:15.925396 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-2aa946a7-e278-4612-8010-a034b3f91fd1 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:40:15.925830 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-2aa946a7-e278-4612-8010-a034b3f91fd1 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:40:16.078182 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-2aa946a7-e278-4612-8010-a034b3f91fd1 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3170dc3323f54512bc8819c8efa86b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7121bd118a2549c39332cfdb7edaa92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:40:16.086789 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-2aa946a7-e278-4612-8010-a034b3f91fd1 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] 10.222.0.121 "GET /compute/v2.1/servers/a5fe2c05-1417-4bc2-855e-52c9d7457a49" status: 200 len: 1740 microversion: 2.1 time: 0.175331 Aug 04 10:40:16.087395 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 357/701] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:40:15 2022] GET /compute/v2.1/servers/a5fe2c05-1417-4bc2-855e-52c9d7457a49 => generated 1740 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:40:17.113932 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-79089ebd-fd73-41f4-ad69-eaa8a45c7459 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:40:17.114766 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-79089ebd-fd73-41f4-ad69-eaa8a45c7459 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] [instance: a5fe2c05-1417-4bc2-855e-52c9d7457a49] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:40:17.125043 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-79089ebd-fd73-41f4-ad69-eaa8a45c7459 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:40:17.125522 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-79089ebd-fd73-41f4-ad69-eaa8a45c7459 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:40:17.126317 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-79089ebd-fd73-41f4-ad69-eaa8a45c7459 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:40:17.126760 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-79089ebd-fd73-41f4-ad69-eaa8a45c7459 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:40:17.278033 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-79089ebd-fd73-41f4-ad69-eaa8a45c7459 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3170dc3323f54512bc8819c8efa86b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7121bd118a2549c39332cfdb7edaa92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:40:17.286733 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-79089ebd-fd73-41f4-ad69-eaa8a45c7459 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] 10.222.0.121 "GET /compute/v2.1/servers/a5fe2c05-1417-4bc2-855e-52c9d7457a49" status: 200 len: 1740 microversion: 2.1 time: 0.179563 Aug 04 10:40:17.287313 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 345/702] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:40:17 2022] GET /compute/v2.1/servers/a5fe2c05-1417-4bc2-855e-52c9d7457a49 => generated 1740 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:40:18.311916 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-3c3431ff-d3dd-4861-837d-52764999563b tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:40:18.312580 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-3c3431ff-d3dd-4861-837d-52764999563b tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] [instance: a5fe2c05-1417-4bc2-855e-52c9d7457a49] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:40:18.319800 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-3c3431ff-d3dd-4861-837d-52764999563b tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:40:18.320301 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-3c3431ff-d3dd-4861-837d-52764999563b tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:40:18.321077 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-3c3431ff-d3dd-4861-837d-52764999563b tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:40:18.321577 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-3c3431ff-d3dd-4861-837d-52764999563b tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:40:18.470970 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-3c3431ff-d3dd-4861-837d-52764999563b tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3170dc3323f54512bc8819c8efa86b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7121bd118a2549c39332cfdb7edaa92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:40:18.479628 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-3c3431ff-d3dd-4861-837d-52764999563b tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] 10.222.0.121 "GET /compute/v2.1/servers/a5fe2c05-1417-4bc2-855e-52c9d7457a49" status: 200 len: 1740 microversion: 2.1 time: 0.174389 Aug 04 10:40:18.480312 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 358/703] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:40:18 2022] GET /compute/v2.1/servers/a5fe2c05-1417-4bc2-855e-52c9d7457a49 => generated 1740 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:40:19.502086 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-72ec4d33-c094-4b5f-95ee-d9cd05af3167 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:40:19.502781 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-72ec4d33-c094-4b5f-95ee-d9cd05af3167 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] [instance: a5fe2c05-1417-4bc2-855e-52c9d7457a49] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:40:19.511800 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-72ec4d33-c094-4b5f-95ee-d9cd05af3167 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:40:19.512297 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-72ec4d33-c094-4b5f-95ee-d9cd05af3167 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:40:19.513495 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-72ec4d33-c094-4b5f-95ee-d9cd05af3167 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:40:19.514489 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-72ec4d33-c094-4b5f-95ee-d9cd05af3167 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:40:19.662325 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-72ec4d33-c094-4b5f-95ee-d9cd05af3167 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3170dc3323f54512bc8819c8efa86b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7121bd118a2549c39332cfdb7edaa92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:40:19.671748 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-72ec4d33-c094-4b5f-95ee-d9cd05af3167 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] 10.222.0.121 "GET /compute/v2.1/servers/a5fe2c05-1417-4bc2-855e-52c9d7457a49" status: 200 len: 1740 microversion: 2.1 time: 0.173740 Aug 04 10:40:19.672405 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 346/704] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:40:19 2022] GET /compute/v2.1/servers/a5fe2c05-1417-4bc2-855e-52c9d7457a49 => generated 1740 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:40:20.040612 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-73dbcc61-6bdd-4168-b046-9621c067e8a7 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:40:20.041299 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-73dbcc61-6bdd-4168-b046-9621c067e8a7 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] [instance: 81259012-5f3b-44f6-b979-39119f14929b] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:40:20.048485 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-73dbcc61-6bdd-4168-b046-9621c067e8a7 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:40:20.048944 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-73dbcc61-6bdd-4168-b046-9621c067e8a7 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:40:20.049738 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-73dbcc61-6bdd-4168-b046-9621c067e8a7 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:40:20.050183 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-73dbcc61-6bdd-4168-b046-9621c067e8a7 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:40:20.143136 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.objects.instance [None req-73dbcc61-6bdd-4168-b046-9621c067e8a7 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lazy-loading 'services' on Instance uuid 81259012-5f3b-44f6-b979-39119f14929b {{(pid=124457) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 10:40:20.227479 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-73dbcc61-6bdd-4168-b046-9621c067e8a7 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] 10.222.0.121 "DELETE /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b/os-volume_attachments/1970f3b7-e967-4458-a0a9-cae2fcbf7e93" status: 202 len: 0 microversion: 2.1 time: 0.190712 Aug 04 10:40:20.228644 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 359/705] 10.222.0.121 () {58 vars in 1421 bytes} [Thu Aug 4 10:40:20 2022] DELETE /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b/os-volume_attachments/1970f3b7-e967-4458-a0a9-cae2fcbf7e93 => generated 0 bytes in 193 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 10:40:20.696829 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-1039ef5e-2b9f-40f4-a721-20c8b247d462 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:40:20.697534 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-1039ef5e-2b9f-40f4-a721-20c8b247d462 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] [instance: a5fe2c05-1417-4bc2-855e-52c9d7457a49] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:40:20.707519 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-1039ef5e-2b9f-40f4-a721-20c8b247d462 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:40:20.707981 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-1039ef5e-2b9f-40f4-a721-20c8b247d462 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:40:20.708761 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-1039ef5e-2b9f-40f4-a721-20c8b247d462 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:40:20.709197 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-1039ef5e-2b9f-40f4-a721-20c8b247d462 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:40:20.863769 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-1039ef5e-2b9f-40f4-a721-20c8b247d462 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3170dc3323f54512bc8819c8efa86b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7121bd118a2549c39332cfdb7edaa92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:40:20.872887 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-1039ef5e-2b9f-40f4-a721-20c8b247d462 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] 10.222.0.121 "GET /compute/v2.1/servers/a5fe2c05-1417-4bc2-855e-52c9d7457a49" status: 200 len: 1740 microversion: 2.1 time: 0.181863 Aug 04 10:40:20.873486 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 347/706] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:40:20 2022] GET /compute/v2.1/servers/a5fe2c05-1417-4bc2-855e-52c9d7457a49 => generated 1740 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:40:21.372933 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-a9107465-db6b-411a-aa0b-36ccfda9f96c tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:40:21.380746 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-a9107465-db6b-411a-aa0b-36ccfda9f96c tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:40:21.381216 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-a9107465-db6b-411a-aa0b-36ccfda9f96c tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:40:21.404948 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-a9107465-db6b-411a-aa0b-36ccfda9f96c tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] [instance: 81259012-5f3b-44f6-b979-39119f14929b] Going to try to stop instance {{(pid=124457) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 04 10:40:21.458503 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-a9107465-db6b-411a-aa0b-36ccfda9f96c tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] 10.222.0.121 "POST /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b/action" status: 202 len: 0 microversion: 2.1 time: 0.089607 Aug 04 10:40:21.459297 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 360/707] 10.222.0.121 () {60 vars in 1283 bytes} [Thu Aug 4 10:40:21 2022] POST /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b/action => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 10:40:21.471059 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-2f4a3d35-177c-4f0b-8d05-39e3d5fde48e tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:40:21.471680 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-2f4a3d35-177c-4f0b-8d05-39e3d5fde48e tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] [instance: 81259012-5f3b-44f6-b979-39119f14929b] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:40:21.478637 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-2f4a3d35-177c-4f0b-8d05-39e3d5fde48e tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:40:21.479124 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-2f4a3d35-177c-4f0b-8d05-39e3d5fde48e tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:40:21.479915 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-2f4a3d35-177c-4f0b-8d05-39e3d5fde48e tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:40:21.480576 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-2f4a3d35-177c-4f0b-8d05-39e3d5fde48e tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:40:21.870164 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-2f4a3d35-177c-4f0b-8d05-39e3d5fde48e tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa2e2a5a6ed4c5c9db91269266dd30b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f46ab11dd0b428486c673afc14b5b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:40:21.878511 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-2f4a3d35-177c-4f0b-8d05-39e3d5fde48e tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] 10.222.0.121 "GET /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b" status: 200 len: 1678 microversion: 2.1 time: 0.412966 Aug 04 10:40:21.879100 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 348/708] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:40:21 2022] GET /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b => generated 1678 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:40:21.896862 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-08d142b1-53e9-4106-b4d5-e95034979da3 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:40:21.897597 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-08d142b1-53e9-4106-b4d5-e95034979da3 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] [instance: a5fe2c05-1417-4bc2-855e-52c9d7457a49] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:40:21.904992 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-08d142b1-53e9-4106-b4d5-e95034979da3 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:40:21.905453 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-08d142b1-53e9-4106-b4d5-e95034979da3 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:40:21.906246 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-08d142b1-53e9-4106-b4d5-e95034979da3 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:40:21.906721 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-08d142b1-53e9-4106-b4d5-e95034979da3 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:40:22.072003 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-08d142b1-53e9-4106-b4d5-e95034979da3 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3170dc3323f54512bc8819c8efa86b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7121bd118a2549c39332cfdb7edaa92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:40:22.084955 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-08d142b1-53e9-4106-b4d5-e95034979da3 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] 10.222.0.121 "GET /compute/v2.1/servers/a5fe2c05-1417-4bc2-855e-52c9d7457a49" status: 200 len: 1740 microversion: 2.1 time: 0.192357 Aug 04 10:40:22.086050 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 361/709] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:40:21 2022] GET /compute/v2.1/servers/a5fe2c05-1417-4bc2-855e-52c9d7457a49 => generated 1740 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:40:22.901645 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-1b759faa-766d-406f-8639-c82165e02f8a tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:40:22.902366 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-1b759faa-766d-406f-8639-c82165e02f8a tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] [instance: 81259012-5f3b-44f6-b979-39119f14929b] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:40:22.909772 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-1b759faa-766d-406f-8639-c82165e02f8a tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:40:22.910196 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-1b759faa-766d-406f-8639-c82165e02f8a tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:40:22.911075 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-1b759faa-766d-406f-8639-c82165e02f8a tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:40:22.911581 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-1b759faa-766d-406f-8639-c82165e02f8a tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:40:23.063674 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-1b759faa-766d-406f-8639-c82165e02f8a tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa2e2a5a6ed4c5c9db91269266dd30b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f46ab11dd0b428486c673afc14b5b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:40:23.071899 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-1b759faa-766d-406f-8639-c82165e02f8a tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] 10.222.0.121 "GET /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b" status: 200 len: 1678 microversion: 2.1 time: 0.175259 Aug 04 10:40:23.072666 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 349/710] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:40:22 2022] GET /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b => generated 1678 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:40:23.110705 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-b132c33d-89c2-4356-8af5-667f2c03b278 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:40:23.111358 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-b132c33d-89c2-4356-8af5-667f2c03b278 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] [instance: a5fe2c05-1417-4bc2-855e-52c9d7457a49] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:40:23.118559 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-b132c33d-89c2-4356-8af5-667f2c03b278 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:40:23.119020 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-b132c33d-89c2-4356-8af5-667f2c03b278 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:40:23.119844 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-b132c33d-89c2-4356-8af5-667f2c03b278 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:40:23.120336 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-b132c33d-89c2-4356-8af5-667f2c03b278 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:40:23.275859 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-b132c33d-89c2-4356-8af5-667f2c03b278 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3170dc3323f54512bc8819c8efa86b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7121bd118a2549c39332cfdb7edaa92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:40:23.285050 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-b132c33d-89c2-4356-8af5-667f2c03b278 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] 10.222.0.121 "GET /compute/v2.1/servers/a5fe2c05-1417-4bc2-855e-52c9d7457a49" status: 200 len: 1740 microversion: 2.1 time: 0.178511 Aug 04 10:40:23.285741 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 362/711] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:40:23 2022] GET /compute/v2.1/servers/a5fe2c05-1417-4bc2-855e-52c9d7457a49 => generated 1740 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:40:24.094335 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-de1bdf9c-7851-4789-b037-bd3bb1d88cea tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:40:24.095021 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-de1bdf9c-7851-4789-b037-bd3bb1d88cea tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] [instance: 81259012-5f3b-44f6-b979-39119f14929b] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:40:24.105097 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-de1bdf9c-7851-4789-b037-bd3bb1d88cea tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:40:24.105724 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-de1bdf9c-7851-4789-b037-bd3bb1d88cea tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:40:24.106635 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-de1bdf9c-7851-4789-b037-bd3bb1d88cea tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:40:24.107305 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-de1bdf9c-7851-4789-b037-bd3bb1d88cea tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:40:24.262313 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-de1bdf9c-7851-4789-b037-bd3bb1d88cea tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa2e2a5a6ed4c5c9db91269266dd30b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f46ab11dd0b428486c673afc14b5b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:40:24.270513 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-de1bdf9c-7851-4789-b037-bd3bb1d88cea tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] 10.222.0.121 "GET /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b" status: 200 len: 1678 microversion: 2.1 time: 0.180678 Aug 04 10:40:24.271194 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 350/712] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:40:24 2022] GET /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b => generated 1678 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:40:24.307832 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-559dd08b-6aea-4302-be8b-d718075539d3 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:40:24.308521 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-559dd08b-6aea-4302-be8b-d718075539d3 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] [instance: a5fe2c05-1417-4bc2-855e-52c9d7457a49] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:40:24.315714 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-559dd08b-6aea-4302-be8b-d718075539d3 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:40:24.316214 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-559dd08b-6aea-4302-be8b-d718075539d3 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:40:24.317010 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-559dd08b-6aea-4302-be8b-d718075539d3 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:40:24.317455 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-559dd08b-6aea-4302-be8b-d718075539d3 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:40:24.466120 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-559dd08b-6aea-4302-be8b-d718075539d3 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3170dc3323f54512bc8819c8efa86b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7121bd118a2549c39332cfdb7edaa92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:40:24.474938 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-559dd08b-6aea-4302-be8b-d718075539d3 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] 10.222.0.121 "GET /compute/v2.1/servers/a5fe2c05-1417-4bc2-855e-52c9d7457a49" status: 200 len: 1740 microversion: 2.1 time: 0.171149 Aug 04 10:40:24.475897 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 363/713] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:40:24 2022] GET /compute/v2.1/servers/a5fe2c05-1417-4bc2-855e-52c9d7457a49 => generated 1740 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:40:25.294616 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-eec5ea24-0453-494e-96db-2c311c3431a5 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:40:25.295332 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-eec5ea24-0453-494e-96db-2c311c3431a5 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] [instance: 81259012-5f3b-44f6-b979-39119f14929b] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:40:25.302852 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-eec5ea24-0453-494e-96db-2c311c3431a5 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:40:25.303294 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-eec5ea24-0453-494e-96db-2c311c3431a5 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:40:25.304126 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-eec5ea24-0453-494e-96db-2c311c3431a5 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:40:25.304553 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-eec5ea24-0453-494e-96db-2c311c3431a5 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:40:25.460364 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-eec5ea24-0453-494e-96db-2c311c3431a5 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa2e2a5a6ed4c5c9db91269266dd30b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f46ab11dd0b428486c673afc14b5b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:40:25.468686 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-eec5ea24-0453-494e-96db-2c311c3431a5 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] 10.222.0.121 "GET /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b" status: 200 len: 1678 microversion: 2.1 time: 0.178233 Aug 04 10:40:25.469272 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 351/714] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:40:25 2022] GET /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b => generated 1678 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:40:25.505130 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-c2ae0f75-73ac-4e22-9065-2d8d0cb7792d tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:40:25.505787 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-c2ae0f75-73ac-4e22-9065-2d8d0cb7792d tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] [instance: a5fe2c05-1417-4bc2-855e-52c9d7457a49] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:40:25.512938 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-c2ae0f75-73ac-4e22-9065-2d8d0cb7792d tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:40:25.513402 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-c2ae0f75-73ac-4e22-9065-2d8d0cb7792d tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:40:25.514202 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-c2ae0f75-73ac-4e22-9065-2d8d0cb7792d tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:40:25.514650 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-c2ae0f75-73ac-4e22-9065-2d8d0cb7792d tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:40:25.665896 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-c2ae0f75-73ac-4e22-9065-2d8d0cb7792d tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3170dc3323f54512bc8819c8efa86b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7121bd118a2549c39332cfdb7edaa92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:40:25.675375 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-c2ae0f75-73ac-4e22-9065-2d8d0cb7792d tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] 10.222.0.121 "GET /compute/v2.1/servers/a5fe2c05-1417-4bc2-855e-52c9d7457a49" status: 200 len: 1740 microversion: 2.1 time: 0.174300 Aug 04 10:40:25.676011 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 364/715] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:40:25 2022] GET /compute/v2.1/servers/a5fe2c05-1417-4bc2-855e-52c9d7457a49 => generated 1740 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:40:26.491449 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-89189a09-a1af-4912-8159-c936678752c9 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:40:26.492695 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-89189a09-a1af-4912-8159-c936678752c9 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] [instance: 81259012-5f3b-44f6-b979-39119f14929b] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:40:26.501121 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-89189a09-a1af-4912-8159-c936678752c9 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:40:26.501629 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-89189a09-a1af-4912-8159-c936678752c9 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:40:26.502416 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-89189a09-a1af-4912-8159-c936678752c9 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:40:26.502858 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-89189a09-a1af-4912-8159-c936678752c9 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:40:26.664114 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-89189a09-a1af-4912-8159-c936678752c9 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa2e2a5a6ed4c5c9db91269266dd30b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f46ab11dd0b428486c673afc14b5b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:40:26.672470 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-89189a09-a1af-4912-8159-c936678752c9 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] 10.222.0.121 "GET /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b" status: 200 len: 1678 microversion: 2.1 time: 0.185251 Aug 04 10:40:26.673035 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 352/716] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:40:26 2022] GET /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b => generated 1678 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:40:26.698262 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-1f424467-011d-4a2f-8a19-7c8c272e1293 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:40:26.699098 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-1f424467-011d-4a2f-8a19-7c8c272e1293 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] [instance: a5fe2c05-1417-4bc2-855e-52c9d7457a49] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:40:26.706698 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-1f424467-011d-4a2f-8a19-7c8c272e1293 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:40:26.707167 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-1f424467-011d-4a2f-8a19-7c8c272e1293 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:40:26.707983 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-1f424467-011d-4a2f-8a19-7c8c272e1293 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:40:26.708529 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-1f424467-011d-4a2f-8a19-7c8c272e1293 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:40:26.886421 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-1f424467-011d-4a2f-8a19-7c8c272e1293 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3170dc3323f54512bc8819c8efa86b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7121bd118a2549c39332cfdb7edaa92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:40:26.898421 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-1f424467-011d-4a2f-8a19-7c8c272e1293 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] 10.222.0.121 "GET /compute/v2.1/servers/a5fe2c05-1417-4bc2-855e-52c9d7457a49" status: 200 len: 1740 microversion: 2.1 time: 0.204341 Aug 04 10:40:26.899408 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 365/717] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:40:26 2022] GET /compute/v2.1/servers/a5fe2c05-1417-4bc2-855e-52c9d7457a49 => generated 1740 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:40:27.695488 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-9be2e15b-f89b-4dbb-bf03-41feb4d2142c tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:40:27.696282 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-9be2e15b-f89b-4dbb-bf03-41feb4d2142c tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] [instance: 81259012-5f3b-44f6-b979-39119f14929b] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:40:27.703260 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-9be2e15b-f89b-4dbb-bf03-41feb4d2142c tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:40:27.703717 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-9be2e15b-f89b-4dbb-bf03-41feb4d2142c tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:40:27.704685 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-9be2e15b-f89b-4dbb-bf03-41feb4d2142c tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:40:27.705131 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-9be2e15b-f89b-4dbb-bf03-41feb4d2142c tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:40:27.849537 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-9be2e15b-f89b-4dbb-bf03-41feb4d2142c tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa2e2a5a6ed4c5c9db91269266dd30b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f46ab11dd0b428486c673afc14b5b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:40:27.857752 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-9be2e15b-f89b-4dbb-bf03-41feb4d2142c tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] 10.222.0.121 "GET /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b" status: 200 len: 1678 microversion: 2.1 time: 0.166439 Aug 04 10:40:27.858341 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 353/718] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:40:27 2022] GET /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b => generated 1678 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:40:27.930067 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-fd98a46b-d70b-42bb-86b7-78af1f6d9bfd tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:40:27.930754 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-fd98a46b-d70b-42bb-86b7-78af1f6d9bfd tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] [instance: a5fe2c05-1417-4bc2-855e-52c9d7457a49] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:40:27.937786 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-fd98a46b-d70b-42bb-86b7-78af1f6d9bfd tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:40:27.938571 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-fd98a46b-d70b-42bb-86b7-78af1f6d9bfd tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:40:27.939351 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-fd98a46b-d70b-42bb-86b7-78af1f6d9bfd tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:40:27.939786 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-fd98a46b-d70b-42bb-86b7-78af1f6d9bfd tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:40:28.079690 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-fd98a46b-d70b-42bb-86b7-78af1f6d9bfd tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3170dc3323f54512bc8819c8efa86b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7121bd118a2549c39332cfdb7edaa92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:40:28.088372 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-fd98a46b-d70b-42bb-86b7-78af1f6d9bfd tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] 10.222.0.121 "GET /compute/v2.1/servers/a5fe2c05-1417-4bc2-855e-52c9d7457a49" status: 200 len: 1740 microversion: 2.1 time: 0.162797 Aug 04 10:40:28.088965 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 366/719] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:40:27 2022] GET /compute/v2.1/servers/a5fe2c05-1417-4bc2-855e-52c9d7457a49 => generated 1740 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:40:28.879358 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-f6b470b6-58fb-48fa-8946-583c53ebb002 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:40:28.880191 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-f6b470b6-58fb-48fa-8946-583c53ebb002 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] [instance: 81259012-5f3b-44f6-b979-39119f14929b] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:40:28.888320 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-f6b470b6-58fb-48fa-8946-583c53ebb002 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:40:28.888797 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-f6b470b6-58fb-48fa-8946-583c53ebb002 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:40:28.889709 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-f6b470b6-58fb-48fa-8946-583c53ebb002 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:40:28.890209 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-f6b470b6-58fb-48fa-8946-583c53ebb002 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:40:29.038293 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-f6b470b6-58fb-48fa-8946-583c53ebb002 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa2e2a5a6ed4c5c9db91269266dd30b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f46ab11dd0b428486c673afc14b5b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:40:29.046243 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-f6b470b6-58fb-48fa-8946-583c53ebb002 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] 10.222.0.121 "GET /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b" status: 200 len: 1678 microversion: 2.1 time: 0.170979 Aug 04 10:40:29.046816 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 354/720] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:40:28 2022] GET /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b => generated 1678 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:40:29.111475 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-45cb30fb-a7a5-4ef8-b69e-90a9943e825d tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:40:29.112249 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-45cb30fb-a7a5-4ef8-b69e-90a9943e825d tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] [instance: a5fe2c05-1417-4bc2-855e-52c9d7457a49] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:40:29.119982 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-45cb30fb-a7a5-4ef8-b69e-90a9943e825d tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:40:29.120441 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-45cb30fb-a7a5-4ef8-b69e-90a9943e825d tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:40:29.121221 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-45cb30fb-a7a5-4ef8-b69e-90a9943e825d tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:40:29.121660 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-45cb30fb-a7a5-4ef8-b69e-90a9943e825d tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:40:29.266380 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-45cb30fb-a7a5-4ef8-b69e-90a9943e825d tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3170dc3323f54512bc8819c8efa86b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7121bd118a2549c39332cfdb7edaa92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:40:29.275343 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-45cb30fb-a7a5-4ef8-b69e-90a9943e825d tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] 10.222.0.121 "GET /compute/v2.1/servers/a5fe2c05-1417-4bc2-855e-52c9d7457a49" status: 200 len: 1720 microversion: 2.1 time: 0.168001 Aug 04 10:40:29.275978 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 367/721] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:40:29 2022] GET /compute/v2.1/servers/a5fe2c05-1417-4bc2-855e-52c9d7457a49 => generated 1720 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:40:29.343660 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-0809b454-4bee-4ce1-84c7-ce0055a386dd tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:40:29.344495 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-0809b454-4bee-4ce1-84c7-ce0055a386dd tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] [instance: a5fe2c05-1417-4bc2-855e-52c9d7457a49] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:40:29.354305 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-0809b454-4bee-4ce1-84c7-ce0055a386dd tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:40:29.354988 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-0809b454-4bee-4ce1-84c7-ce0055a386dd tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:40:29.356210 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-0809b454-4bee-4ce1-84c7-ce0055a386dd tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:40:29.356885 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-0809b454-4bee-4ce1-84c7-ce0055a386dd tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:40:29.506902 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.wsgi [None req-0809b454-4bee-4ce1-84c7-ce0055a386dd tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] HTTP exception thrown: Cannot 'detach_volume' instance a5fe2c05-1417-4bc2-855e-52c9d7457a49 while it is in vm_state rescued Aug 04 10:40:29.508973 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-0809b454-4bee-4ce1-84c7-ce0055a386dd tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Request method failure captured: Aug 04 10:40:29.508973 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: request: DELETE /compute/v2.1/servers/a5fe2c05-1417-4bc2-855e-52c9d7457a49/os-volume_attachments/7f8727a2-14a3-4554-8cd9-3a24eda1ba1d HTTP/1.1 Aug 04 10:40:29.508973 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: Accept: application/json Aug 04 10:40:29.508973 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: Accept-Encoding: identity Aug 04 10:40:29.508973 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: Connection: close Aug 04 10:40:29.508973 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: Content-Length: 0 Aug 04 10:40:29.508973 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: Content-Type: application/json Aug 04 10:40:29.508973 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: Host: 10.222.0.121 Aug 04 10:40:29.508973 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: Openstack-System-Scope: None Aug 04 10:40:29.508973 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: User-Agent: python-urllib3/1.26.11 Aug 04 10:40:29.508973 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Auth-Token: gAAAAABi66Bc3v4QS1FtUMzLABOQnByGgDiNvJ-JvGmdBDVbq6x7lQW47g6_YVrbEeRME3TfDfNZZQZzvek1irFXoT0OrvdtDRcHao-WSK1U1LXxlYJ7lzEubI7Szk80hERaW5e12YVPeHwUKRft5YXP3uZ6ZxfgU3B2fGKT8Q_qAH4d7HdL2nw Aug 04 10:40:29.508973 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Domain-Id: None Aug 04 10:40:29.508973 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Domain-Name: None Aug 04 10:40:29.508973 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Identity-Status: Confirmed Aug 04 10:40:29.508973 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Is-Admin-Project: True Aug 04 10:40:29.508973 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Project-Domain-Id: default Aug 04 10:40:29.508973 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Project-Domain-Name: Default Aug 04 10:40:29.508973 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Project-Id: 7121bd118a2549c39332cfdb7edaa92f Aug 04 10:40:29.508973 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-47221404 Aug 04 10:40:29.508973 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Role: reader,member Aug 04 10:40:29.508973 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Roles: reader,member Aug 04 10:40:29.511138 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/7121bd118a2549c39332cfdb7edaa92f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/7121bd118a2549c39332cfdb7edaa92f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.121:8080", "publicURL": "http://10.222.0.121:8080/v1/AUTH_7121bd118a2549c39332cfdb7edaa92f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2/7121bd118a2549c39332cfdb7edaa92f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:9696/networking"}]}] Aug 04 10:40:29.511138 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Tenant: tempest-ServerRescueNegativeTestJSON-47221404 Aug 04 10:40:29.511138 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Tenant-Id: 7121bd118a2549c39332cfdb7edaa92f Aug 04 10:40:29.511138 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-47221404 Aug 04 10:40:29.511138 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-User: tempest-ServerRescueNegativeTestJSON-47221404-project Aug 04 10:40:29.511138 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-User-Domain-Id: default Aug 04 10:40:29.511138 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-User-Domain-Name: Default Aug 04 10:40:29.511138 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-User-Id: 3170dc3323f54512bc8819c8efa86b0f Aug 04 10:40:29.511138 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-User-Name: tempest-ServerRescueNegativeTestJSON-47221404-project Aug 04 10:40:29.511138 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: method: > Aug 04 10:40:29.511138 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: exception: Cannot 'detach_volume' instance a5fe2c05-1417-4bc2-855e-52c9d7457a49 while it is in vm_state rescued Aug 04 10:40:29.512818 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: action_args: {'server_id': 'a5fe2c05-1417-4bc2-855e-52c9d7457a49', 'id': '7f8727a2-14a3-4554-8cd9-3a24eda1ba1d'} Aug 04 10:40:29.512818 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 10:40:29.512818 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:40:29.512818 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 04 10:40:29.512818 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 04 10:40:29.512818 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 04 10:40:29.512818 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 04 10:40:29.512818 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 04 10:40:29.512818 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 04 10:40:29.512818 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance a5fe2c05-1417-4bc2-855e-52c9d7457a49 in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 04 10:40:29.512818 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi Aug 04 10:40:29.512818 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:40:29.512818 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi Aug 04 10:40:29.512818 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:40:29.512818 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:40:29.512818 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:40:29.512818 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 10:40:29.512818 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 10:40:29.512818 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 10:40:29.512818 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 10:40:29.515564 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 04 10:40:29.515564 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 04 10:40:29.515564 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 04 10:40:29.515564 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 04 10:40:29.515564 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance a5fe2c05-1417-4bc2-855e-52c9d7457a49 while it is in vm_state rescued Aug 04 10:40:29.515564 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi Aug 04 10:40:29.515564 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:40:29.515564 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi Aug 04 10:40:29.515564 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:40:29.515564 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:40:29.515564 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:40:29.515564 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 10:40:29.515564 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 10:40:29.515564 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance a5fe2c05-1417-4bc2-855e-52c9d7457a49 while it is in vm_state rescued Aug 04 10:40:29.515564 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi Aug 04 10:40:29.515564 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-0809b454-4bee-4ce1-84c7-ce0055a386dd tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Returning 409 to user: Cannot 'detach_volume' instance a5fe2c05-1417-4bc2-855e-52c9d7457a49 while it is in vm_state rescued {{(pid=124456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 10:40:29.517993 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-0809b454-4bee-4ce1-84c7-ce0055a386dd tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] 10.222.0.121 "DELETE /compute/v2.1/servers/a5fe2c05-1417-4bc2-855e-52c9d7457a49/os-volume_attachments/7f8727a2-14a3-4554-8cd9-3a24eda1ba1d" status: 409 len: 152 microversion: 2.1 time: 0.174242 Aug 04 10:40:29.517993 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 355/722] 10.222.0.121 () {58 vars in 1421 bytes} [Thu Aug 4 10:40:29 2022] DELETE /compute/v2.1/servers/a5fe2c05-1417-4bc2-855e-52c9d7457a49/os-volume_attachments/7f8727a2-14a3-4554-8cd9-3a24eda1ba1d => generated 152 bytes in 176 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 04 10:40:29.521762 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-66da4b98-a712-4d2b-9fad-267d5f53813c tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:40:29.522315 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-66da4b98-a712-4d2b-9fad-267d5f53813c tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] [instance: a5fe2c05-1417-4bc2-855e-52c9d7457a49] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:40:29.529319 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-66da4b98-a712-4d2b-9fad-267d5f53813c tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:40:29.529779 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-66da4b98-a712-4d2b-9fad-267d5f53813c tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:40:29.530568 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-66da4b98-a712-4d2b-9fad-267d5f53813c tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:40:29.531015 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-66da4b98-a712-4d2b-9fad-267d5f53813c tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:40:29.550736 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG dbcounter [-] [124457] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=124457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:40:29.612898 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-66da4b98-a712-4d2b-9fad-267d5f53813c tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] 10.222.0.121 "POST /compute/v2.1/servers/a5fe2c05-1417-4bc2-855e-52c9d7457a49/action" status: 202 len: 0 microversion: 2.1 time: 0.096019 Aug 04 10:40:29.614436 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 368/723] 10.222.0.121 () {60 vars in 1283 bytes} [Thu Aug 4 10:40:29 2022] POST /compute/v2.1/servers/a5fe2c05-1417-4bc2-855e-52c9d7457a49/action => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 10:40:29.624814 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-e45a7f22-6ddf-47c4-861f-0723d64f5e8e tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:40:29.625797 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-e45a7f22-6ddf-47c4-861f-0723d64f5e8e tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] [instance: a5fe2c05-1417-4bc2-855e-52c9d7457a49] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:40:29.634137 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-e45a7f22-6ddf-47c4-861f-0723d64f5e8e tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:40:29.634598 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-e45a7f22-6ddf-47c4-861f-0723d64f5e8e tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:40:29.635407 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-e45a7f22-6ddf-47c4-861f-0723d64f5e8e tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:40:29.636113 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-e45a7f22-6ddf-47c4-861f-0723d64f5e8e tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:40:29.877392 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-e45a7f22-6ddf-47c4-861f-0723d64f5e8e tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3170dc3323f54512bc8819c8efa86b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7121bd118a2549c39332cfdb7edaa92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:40:29.887363 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-e45a7f22-6ddf-47c4-861f-0723d64f5e8e tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] 10.222.0.121 "GET /compute/v2.1/servers/a5fe2c05-1417-4bc2-855e-52c9d7457a49" status: 200 len: 1728 microversion: 2.1 time: 0.266876 Aug 04 10:40:29.892586 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 356/724] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:40:29 2022] GET /compute/v2.1/servers/a5fe2c05-1417-4bc2-855e-52c9d7457a49 => generated 1728 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:40:30.069990 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-8c96826f-bf70-4b4a-9802-42734f4a9a29 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:40:30.070801 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-8c96826f-bf70-4b4a-9802-42734f4a9a29 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] [instance: 81259012-5f3b-44f6-b979-39119f14929b] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:40:30.079150 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-8c96826f-bf70-4b4a-9802-42734f4a9a29 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:40:30.079623 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-8c96826f-bf70-4b4a-9802-42734f4a9a29 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:40:30.080594 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-8c96826f-bf70-4b4a-9802-42734f4a9a29 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:40:30.080892 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-8c96826f-bf70-4b4a-9802-42734f4a9a29 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:40:30.335149 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-8c96826f-bf70-4b4a-9802-42734f4a9a29 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa2e2a5a6ed4c5c9db91269266dd30b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f46ab11dd0b428486c673afc14b5b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:40:30.345994 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-8c96826f-bf70-4b4a-9802-42734f4a9a29 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] 10.222.0.121 "GET /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b" status: 200 len: 1678 microversion: 2.1 time: 0.280330 Aug 04 10:40:30.359979 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 369/725] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:40:30 2022] GET /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b => generated 1678 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:40:30.914169 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-bd7f34cf-fc99-4843-ab1c-95df4f7aab99 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:40:30.914821 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-bd7f34cf-fc99-4843-ab1c-95df4f7aab99 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] [instance: a5fe2c05-1417-4bc2-855e-52c9d7457a49] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:40:30.921875 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-bd7f34cf-fc99-4843-ab1c-95df4f7aab99 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:40:30.922301 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-bd7f34cf-fc99-4843-ab1c-95df4f7aab99 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:40:30.923078 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-bd7f34cf-fc99-4843-ab1c-95df4f7aab99 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:40:30.923515 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-bd7f34cf-fc99-4843-ab1c-95df4f7aab99 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:40:30.943023 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG dbcounter [-] [124456] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:40:31.066934 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-bd7f34cf-fc99-4843-ab1c-95df4f7aab99 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3170dc3323f54512bc8819c8efa86b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7121bd118a2549c39332cfdb7edaa92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:40:31.076201 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-bd7f34cf-fc99-4843-ab1c-95df4f7aab99 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] 10.222.0.121 "GET /compute/v2.1/servers/a5fe2c05-1417-4bc2-855e-52c9d7457a49" status: 200 len: 1728 microversion: 2.1 time: 0.166222 Aug 04 10:40:31.076795 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 357/726] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:40:30 2022] GET /compute/v2.1/servers/a5fe2c05-1417-4bc2-855e-52c9d7457a49 => generated 1728 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:40:31.368838 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-7ccf7316-a4c9-44a8-8ddb-417f4516e8f9 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:40:31.369485 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-7ccf7316-a4c9-44a8-8ddb-417f4516e8f9 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] [instance: 81259012-5f3b-44f6-b979-39119f14929b] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:40:31.376659 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-7ccf7316-a4c9-44a8-8ddb-417f4516e8f9 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:40:31.377111 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-7ccf7316-a4c9-44a8-8ddb-417f4516e8f9 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:40:31.377898 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-7ccf7316-a4c9-44a8-8ddb-417f4516e8f9 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:40:31.378347 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-7ccf7316-a4c9-44a8-8ddb-417f4516e8f9 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:40:31.516896 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-7ccf7316-a4c9-44a8-8ddb-417f4516e8f9 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa2e2a5a6ed4c5c9db91269266dd30b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f46ab11dd0b428486c673afc14b5b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:40:31.525505 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-7ccf7316-a4c9-44a8-8ddb-417f4516e8f9 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] 10.222.0.121 "GET /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b" status: 200 len: 1678 microversion: 2.1 time: 0.160853 Aug 04 10:40:31.526160 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 370/727] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:40:31 2022] GET /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b => generated 1678 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:40:32.098271 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-5a90a678-acb0-412e-bafb-2a6c57f2d058 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:40:32.098977 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-5a90a678-acb0-412e-bafb-2a6c57f2d058 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] [instance: a5fe2c05-1417-4bc2-855e-52c9d7457a49] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:40:32.106481 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-5a90a678-acb0-412e-bafb-2a6c57f2d058 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:40:32.106941 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-5a90a678-acb0-412e-bafb-2a6c57f2d058 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:40:32.107752 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-5a90a678-acb0-412e-bafb-2a6c57f2d058 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:40:32.108239 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-5a90a678-acb0-412e-bafb-2a6c57f2d058 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:40:32.247108 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-5a90a678-acb0-412e-bafb-2a6c57f2d058 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3170dc3323f54512bc8819c8efa86b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7121bd118a2549c39332cfdb7edaa92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:40:32.256520 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-5a90a678-acb0-412e-bafb-2a6c57f2d058 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] 10.222.0.121 "GET /compute/v2.1/servers/a5fe2c05-1417-4bc2-855e-52c9d7457a49" status: 200 len: 1728 microversion: 2.1 time: 0.162155 Aug 04 10:40:32.257114 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 358/728] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:40:32 2022] GET /compute/v2.1/servers/a5fe2c05-1417-4bc2-855e-52c9d7457a49 => generated 1728 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:40:32.547904 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-26a39c62-7e09-4cf0-a375-f762081c6ab5 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:40:32.548576 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-26a39c62-7e09-4cf0-a375-f762081c6ab5 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] [instance: 81259012-5f3b-44f6-b979-39119f14929b] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:40:32.557780 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-26a39c62-7e09-4cf0-a375-f762081c6ab5 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:40:32.558461 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-26a39c62-7e09-4cf0-a375-f762081c6ab5 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:40:32.559715 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-26a39c62-7e09-4cf0-a375-f762081c6ab5 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:40:32.560430 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-26a39c62-7e09-4cf0-a375-f762081c6ab5 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:40:32.709358 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-26a39c62-7e09-4cf0-a375-f762081c6ab5 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa2e2a5a6ed4c5c9db91269266dd30b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f46ab11dd0b428486c673afc14b5b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:40:32.717435 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-26a39c62-7e09-4cf0-a375-f762081c6ab5 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] 10.222.0.121 "GET /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b" status: 200 len: 1678 microversion: 2.1 time: 0.173982 Aug 04 10:40:32.718026 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 371/729] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:40:32 2022] GET /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b => generated 1678 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:40:33.281156 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-ce1e231d-055f-43ed-87d0-0798f88e151c tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:40:33.282183 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-ce1e231d-055f-43ed-87d0-0798f88e151c tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] [instance: a5fe2c05-1417-4bc2-855e-52c9d7457a49] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:40:33.291330 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-ce1e231d-055f-43ed-87d0-0798f88e151c tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:40:33.292066 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-ce1e231d-055f-43ed-87d0-0798f88e151c tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:40:33.293285 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-ce1e231d-055f-43ed-87d0-0798f88e151c tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:40:33.293870 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-ce1e231d-055f-43ed-87d0-0798f88e151c tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:40:33.479253 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-ce1e231d-055f-43ed-87d0-0798f88e151c tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3170dc3323f54512bc8819c8efa86b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7121bd118a2549c39332cfdb7edaa92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:40:33.487872 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-ce1e231d-055f-43ed-87d0-0798f88e151c tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] 10.222.0.121 "GET /compute/v2.1/servers/a5fe2c05-1417-4bc2-855e-52c9d7457a49" status: 200 len: 1734 microversion: 2.1 time: 0.211764 Aug 04 10:40:33.488496 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 359/730] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:40:33 2022] GET /compute/v2.1/servers/a5fe2c05-1417-4bc2-855e-52c9d7457a49 => generated 1734 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:40:33.509226 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-d34088f0-b188-452c-9af5-bd728be9c33d tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:40:33.509750 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-d34088f0-b188-452c-9af5-bd728be9c33d tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] [instance: a5fe2c05-1417-4bc2-855e-52c9d7457a49] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:40:33.517032 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-d34088f0-b188-452c-9af5-bd728be9c33d tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:40:33.517482 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-d34088f0-b188-452c-9af5-bd728be9c33d tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:40:33.518252 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-d34088f0-b188-452c-9af5-bd728be9c33d tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:40:33.518683 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-d34088f0-b188-452c-9af5-bd728be9c33d tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:40:33.603103 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-d34088f0-b188-452c-9af5-bd728be9c33d tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] 10.222.0.121 "GET /compute/v2.1/servers/a5fe2c05-1417-4bc2-855e-52c9d7457a49/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.097975 Aug 04 10:40:33.603790 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 372/731] 10.222.0.121 () {58 vars in 1280 bytes} [Thu Aug 4 10:40:33 2022] GET /compute/v2.1/servers/a5fe2c05-1417-4bc2-855e-52c9d7457a49/os-interface => generated 285 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:40:33.740963 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-bae9b633-d7e8-431b-8b1f-d1e9d6d5ecfc tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:40:33.741749 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-bae9b633-d7e8-431b-8b1f-d1e9d6d5ecfc tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] [instance: 81259012-5f3b-44f6-b979-39119f14929b] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:40:33.749530 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-bae9b633-d7e8-431b-8b1f-d1e9d6d5ecfc tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:40:33.750231 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-bae9b633-d7e8-431b-8b1f-d1e9d6d5ecfc tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:40:33.751257 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-bae9b633-d7e8-431b-8b1f-d1e9d6d5ecfc tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:40:33.751801 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-bae9b633-d7e8-431b-8b1f-d1e9d6d5ecfc tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:40:33.992270 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-bae9b633-d7e8-431b-8b1f-d1e9d6d5ecfc tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa2e2a5a6ed4c5c9db91269266dd30b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f46ab11dd0b428486c673afc14b5b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:40:34.000817 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-bae9b633-d7e8-431b-8b1f-d1e9d6d5ecfc tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] 10.222.0.121 "GET /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b" status: 200 len: 1655 microversion: 2.1 time: 0.264782 Aug 04 10:40:34.002075 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 360/732] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:40:33 2022] GET /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b => generated 1655 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:40:34.024002 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-2960ce94-edc0-462a-b692-4994132d0b4d tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:40:34.030703 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-2960ce94-edc0-462a-b692-4994132d0b4d tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:40:34.031155 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-2960ce94-edc0-462a-b692-4994132d0b4d tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:40:34.057469 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-2960ce94-edc0-462a-b692-4994132d0b4d tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] [instance: 81259012-5f3b-44f6-b979-39119f14929b] Going to try to start instance {{(pid=124457) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 04 10:40:34.108307 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-2960ce94-edc0-462a-b692-4994132d0b4d tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] 10.222.0.121 "POST /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b/action" status: 202 len: 0 microversion: 2.1 time: 0.088484 Aug 04 10:40:34.108999 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 373/733] 10.222.0.121 () {60 vars in 1283 bytes} [Thu Aug 4 10:40:34 2022] POST /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b/action => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 10:40:34.119446 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-98749e51-564c-4eda-ac74-f2c806567321 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:40:34.120716 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-98749e51-564c-4eda-ac74-f2c806567321 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] [instance: 81259012-5f3b-44f6-b979-39119f14929b] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:40:34.128598 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-98749e51-564c-4eda-ac74-f2c806567321 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:40:34.130235 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-98749e51-564c-4eda-ac74-f2c806567321 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:40:34.131136 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-98749e51-564c-4eda-ac74-f2c806567321 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:40:34.131802 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-98749e51-564c-4eda-ac74-f2c806567321 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:40:34.576624 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-98749e51-564c-4eda-ac74-f2c806567321 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa2e2a5a6ed4c5c9db91269266dd30b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f46ab11dd0b428486c673afc14b5b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:40:34.592058 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-98749e51-564c-4eda-ac74-f2c806567321 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] 10.222.0.121 "GET /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b" status: 200 len: 1664 microversion: 2.1 time: 0.476963 Aug 04 10:40:34.592912 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 361/734] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:40:34 2022] GET /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b => generated 1664 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:40:35.566602 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [req-cfe2c9f6-4314-4705-8b98-085387c37459 req-c7fe6a9d-9889-4945-955d-fb0467bd94a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a5fe2c05-1417-4bc2-855e-52c9d7457a49", "tag": "145415de-6cf5-4375-a71d-43735b21c5b4"}]} {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:40:35.576530 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG dbcounter [-] [124457] Writing DB stats nova_api:SELECT=39 {{(pid=124457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:40:35.583619 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [req-cfe2c9f6-4314-4705-8b98-085387c37459 req-c7fe6a9d-9889-4945-955d-fb0467bd94a5 service nova] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:40:35.583985 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [req-cfe2c9f6-4314-4705-8b98-085387c37459 req-c7fe6a9d-9889-4945-955d-fb0467bd94a5 service nova] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:40:35.601877 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.compute.server_external_events [req-cfe2c9f6-4314-4705-8b98-085387c37459 req-c7fe6a9d-9889-4945-955d-fb0467bd94a5 service nova] Creating event network-changed:145415de-6cf5-4375-a71d-43735b21c5b4 for instance a5fe2c05-1417-4bc2-855e-52c9d7457a49 on hv-cinder-85200 Aug 04 10:40:35.607583 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [req-cfe2c9f6-4314-4705-8b98-085387c37459 req-c7fe6a9d-9889-4945-955d-fb0467bd94a5 service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047993 Aug 04 10:40:35.609457 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 374/735] 10.222.0.121 () {64 vars in 1322 bytes} [Thu Aug 4 10:40:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:40:35.615136 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-cdf16fa6-7ef2-4266-a34d-225d4206435e tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:40:35.615855 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-cdf16fa6-7ef2-4266-a34d-225d4206435e tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] [instance: 81259012-5f3b-44f6-b979-39119f14929b] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:40:35.623360 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-cdf16fa6-7ef2-4266-a34d-225d4206435e tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:40:35.623822 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-cdf16fa6-7ef2-4266-a34d-225d4206435e tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:40:35.624665 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-cdf16fa6-7ef2-4266-a34d-225d4206435e tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:40:35.625118 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-cdf16fa6-7ef2-4266-a34d-225d4206435e tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:40:35.858601 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-cdf16fa6-7ef2-4266-a34d-225d4206435e tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa2e2a5a6ed4c5c9db91269266dd30b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f46ab11dd0b428486c673afc14b5b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:40:35.867546 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-cdf16fa6-7ef2-4266-a34d-225d4206435e tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] 10.222.0.121 "GET /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b" status: 200 len: 1664 microversion: 2.1 time: 0.256414 Aug 04 10:40:35.868559 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 362/736] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:40:35 2022] GET /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b => generated 1664 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:40:36.890622 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-5eba7824-1de3-4eb0-b99a-5cfc47e8d36c tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:40:36.891350 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-5eba7824-1de3-4eb0-b99a-5cfc47e8d36c tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] [instance: 81259012-5f3b-44f6-b979-39119f14929b] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:40:36.899112 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-5eba7824-1de3-4eb0-b99a-5cfc47e8d36c tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:40:36.899576 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-5eba7824-1de3-4eb0-b99a-5cfc47e8d36c tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:40:36.900462 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-5eba7824-1de3-4eb0-b99a-5cfc47e8d36c tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:40:36.900887 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-5eba7824-1de3-4eb0-b99a-5cfc47e8d36c tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:40:37.053007 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-5eba7824-1de3-4eb0-b99a-5cfc47e8d36c tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa2e2a5a6ed4c5c9db91269266dd30b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f46ab11dd0b428486c673afc14b5b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:40:37.065413 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-5eba7824-1de3-4eb0-b99a-5cfc47e8d36c tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] 10.222.0.121 "GET /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b" status: 200 len: 1668 microversion: 2.1 time: 0.178895 Aug 04 10:40:37.066125 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 375/737] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:40:36 2022] GET /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b => generated 1668 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:40:37.624059 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [req-c2896a37-1604-42c9-9cf9-a49e4873c7af req-320c2c98-4a03-43f0-9bcf-e4e45418f66a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a5fe2c05-1417-4bc2-855e-52c9d7457a49", "tag": "145415de-6cf5-4375-a71d-43735b21c5b4"}]} {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:40:37.635211 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [req-c2896a37-1604-42c9-9cf9-a49e4873c7af req-320c2c98-4a03-43f0-9bcf-e4e45418f66a service nova] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:40:37.635659 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [req-c2896a37-1604-42c9-9cf9-a49e4873c7af req-320c2c98-4a03-43f0-9bcf-e4e45418f66a service nova] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:40:37.647603 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.compute.server_external_events [req-c2896a37-1604-42c9-9cf9-a49e4873c7af req-320c2c98-4a03-43f0-9bcf-e4e45418f66a service nova] Creating event network-changed:145415de-6cf5-4375-a71d-43735b21c5b4 for instance a5fe2c05-1417-4bc2-855e-52c9d7457a49 on hv-cinder-85200 Aug 04 10:40:37.653340 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [req-c2896a37-1604-42c9-9cf9-a49e4873c7af req-320c2c98-4a03-43f0-9bcf-e4e45418f66a service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033133 Aug 04 10:40:37.654164 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 363/738] 10.222.0.121 () {64 vars in 1322 bytes} [Thu Aug 4 10:40:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:40:40.318930 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-7b4ac0c6-3260-449e-953b-9787db56b2fc tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:40:40.320366 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-7b4ac0c6-3260-449e-953b-9787db56b2fc tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] [instance: 8534737c-8a94-4755-ba3c-021132edace6] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:40:40.328409 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-7b4ac0c6-3260-449e-953b-9787db56b2fc tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:40:40.329026 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-7b4ac0c6-3260-449e-953b-9787db56b2fc tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:40:40.330326 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-7b4ac0c6-3260-449e-953b-9787db56b2fc tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:40:40.331083 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-7b4ac0c6-3260-449e-953b-9787db56b2fc tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:40:40.357651 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-7b4ac0c6-3260-449e-953b-9787db56b2fc tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] 10.222.0.121 "GET /compute/v2.1/servers/8534737c-8a94-4755-ba3c-021132edace6/ips" status: 200 len: 149 microversion: 2.1 time: 0.042819 Aug 04 10:40:40.358241 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 376/739] 10.222.0.121 () {58 vars in 1253 bytes} [Thu Aug 4 10:40:40 2022] GET /compute/v2.1/servers/8534737c-8a94-4755-ba3c-021132edace6/ips => generated 149 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:40:40.371913 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-5ffa7c78-6e3d-4526-a4e1-e0766fb90c24 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d30c562b-e963-4c2d-ad89-beeaf6a51747"}} {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:40:40.374487 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-5ffa7c78-6e3d-4526-a4e1-e0766fb90c24 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] [instance: 8534737c-8a94-4755-ba3c-021132edace6] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:40:40.381811 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-5ffa7c78-6e3d-4526-a4e1-e0766fb90c24 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:40:40.382332 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-5ffa7c78-6e3d-4526-a4e1-e0766fb90c24 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:40:40.383098 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-5ffa7c78-6e3d-4526-a4e1-e0766fb90c24 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:40:40.383577 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-5ffa7c78-6e3d-4526-a4e1-e0766fb90c24 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:40:40.485056 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.wsgi [None req-5ffa7c78-6e3d-4526-a4e1-e0766fb90c24 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] HTTP exception thrown: Invalid volume: volume d30c562b-e963-4c2d-ad89-beeaf6a51747 is already attached to instances: c6dec6e8-e2f9-4c57-8326-19fc989b5c6e Aug 04 10:40:40.487072 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-5ffa7c78-6e3d-4526-a4e1-e0766fb90c24 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Request method failure captured: Aug 04 10:40:40.487072 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: request: POST /compute/v2.1/servers/8534737c-8a94-4755-ba3c-021132edace6/os-volume_attachments HTTP/1.1 Aug 04 10:40:40.487072 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: Accept: application/json Aug 04 10:40:40.487072 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: Accept-Encoding: identity Aug 04 10:40:40.487072 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: Connection: close Aug 04 10:40:40.487072 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: Content-Length: 74 Aug 04 10:40:40.487072 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: Content-Type: application/json Aug 04 10:40:40.487072 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: Host: 10.222.0.121 Aug 04 10:40:40.487072 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: Openstack-System-Scope: None Aug 04 10:40:40.487072 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: User-Agent: python-urllib3/1.26.11 Aug 04 10:40:40.487072 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Auth-Token: gAAAAABi66BYmE2gBqIXhQG24OFFWzVprzGeGbZ6oWrpD9juFQnTdf9ST5LtrG_tq8UPT6UiMvXECGt7-Rb5xRfm_FUvpCA0aMeQcAwPVFfAZaKkKC5hs5ouvidzrTVo1nH2TD4SvjZYb98NZaHzipnkuU-vQFrG4wdkP89b_O5rLKaczIbRvag Aug 04 10:40:40.487072 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Domain-Id: None Aug 04 10:40:40.487072 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Domain-Name: None Aug 04 10:40:40.487072 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Identity-Status: Confirmed Aug 04 10:40:40.487072 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Is-Admin-Project: True Aug 04 10:40:40.487072 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Project-Domain-Id: default Aug 04 10:40:40.487072 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Project-Domain-Name: Default Aug 04 10:40:40.487072 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Project-Id: 051b6a3defca48d7b4f8bb6705f89f20 Aug 04 10:40:40.487072 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Project-Name: tempest-AttachVolumeNegativeTest-18806726 Aug 04 10:40:40.487072 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Role: reader,member Aug 04 10:40:40.487072 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Roles: reader,member Aug 04 10:40:40.488797 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/051b6a3defca48d7b4f8bb6705f89f20"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/051b6a3defca48d7b4f8bb6705f89f20"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.121:8080", "publicURL": "http://10.222.0.121:8080/v1/AUTH_051b6a3defca48d7b4f8bb6705f89f20"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2/051b6a3defca48d7b4f8bb6705f89f20"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:9696/networking"}]}] Aug 04 10:40:40.488797 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Tenant: tempest-AttachVolumeNegativeTest-18806726 Aug 04 10:40:40.488797 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Tenant-Id: 051b6a3defca48d7b4f8bb6705f89f20 Aug 04 10:40:40.488797 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-18806726 Aug 04 10:40:40.488797 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-User: tempest-AttachVolumeNegativeTest-18806726-project Aug 04 10:40:40.488797 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-User-Domain-Id: default Aug 04 10:40:40.488797 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-User-Domain-Name: Default Aug 04 10:40:40.488797 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-User-Id: 41a38b5af1654f44bc6cb5832c2e8e87 Aug 04 10:40:40.488797 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-User-Name: tempest-AttachVolumeNegativeTest-18806726-project Aug 04 10:40:40.488797 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: Aug 04 10:40:40.488797 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: {"volumeAttachment": {"volumeId": "d30c562b-e963-4c2d-ad89-beeaf6a51747"}} Aug 04 10:40:40.488797 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: method: > Aug 04 10:40:40.489745 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: exception: Invalid volume: volume d30c562b-e963-4c2d-ad89-beeaf6a51747 is already attached to instances: c6dec6e8-e2f9-4c57-8326-19fc989b5c6e Aug 04 10:40:40.489745 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: action_args: {'server_id': '8534737c-8a94-4755-ba3c-021132edace6', 'body': {'volumeAttachment': {'volumeId': 'd30c562b-e963-4c2d-ad89-beeaf6a51747'}}} Aug 04 10:40:40.489745 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 10:40:40.489745 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:40:40.489745 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 04 10:40:40.489745 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 04 10:40:40.489745 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 04 10:40:40.489745 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 04 10:40:40.489745 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 04 10:40:40.489745 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 04 10:40:40.489745 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5066, in attach_volume Aug 04 10:40:40.489745 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 04 10:40:40.489745 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4906, in _check_volume_already_attached Aug 04 10:40:40.489745 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 04 10:40:40.489745 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume d30c562b-e963-4c2d-ad89-beeaf6a51747 is already attached to instances: c6dec6e8-e2f9-4c57-8326-19fc989b5c6e Aug 04 10:40:40.489745 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi Aug 04 10:40:40.489745 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:40:40.489745 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi Aug 04 10:40:40.489745 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:40:40.491191 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:40:40.491191 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:40:40.491191 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 10:40:40.491191 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 10:40:40.491191 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 10:40:40.491191 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 10:40:40.491191 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 10:40:40.491191 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 10:40:40.491191 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 10:40:40.491191 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 10:40:40.491191 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 10:40:40.491191 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 10:40:40.491191 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 04 10:40:40.491191 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 04 10:40:40.491191 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume d30c562b-e963-4c2d-ad89-beeaf6a51747 is already attached to instances: c6dec6e8-e2f9-4c57-8326-19fc989b5c6e Aug 04 10:40:40.491191 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi Aug 04 10:40:40.491191 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:40:40.491191 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi Aug 04 10:40:40.491191 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:40:40.491191 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:40:40.492766 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:40:40.492766 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 10:40:40.492766 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 10:40:40.492766 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume d30c562b-e963-4c2d-ad89-beeaf6a51747 is already attached to instances: c6dec6e8-e2f9-4c57-8326-19fc989b5c6e Aug 04 10:40:40.492766 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi Aug 04 10:40:40.492766 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-5ffa7c78-6e3d-4526-a4e1-e0766fb90c24 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Returning 400 to user: Invalid volume: volume d30c562b-e963-4c2d-ad89-beeaf6a51747 is already attached to instances: c6dec6e8-e2f9-4c57-8326-19fc989b5c6e {{(pid=124456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 10:40:40.492766 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-5ffa7c78-6e3d-4526-a4e1-e0766fb90c24 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] 10.222.0.121 "POST /compute/v2.1/servers/8534737c-8a94-4755-ba3c-021132edace6/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.122116 Aug 04 10:40:40.492766 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 364/740] 10.222.0.121 () {60 vars in 1328 bytes} [Thu Aug 4 10:40:40 2022] POST /compute/v2.1/servers/8534737c-8a94-4755-ba3c-021132edace6/os-volume_attachments => generated 174 bytes in 123 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 04 10:40:40.500788 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-5ee5a107-0e62-4d3c-8b7e-d5a8bc64f418 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:40:40.501320 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-5ee5a107-0e62-4d3c-8b7e-d5a8bc64f418 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] [instance: 8534737c-8a94-4755-ba3c-021132edace6] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:40:40.507929 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-5ee5a107-0e62-4d3c-8b7e-d5a8bc64f418 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:40:40.508456 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-5ee5a107-0e62-4d3c-8b7e-d5a8bc64f418 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:40:40.509244 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-5ee5a107-0e62-4d3c-8b7e-d5a8bc64f418 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:40:40.509694 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-5ee5a107-0e62-4d3c-8b7e-d5a8bc64f418 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:40:40.535796 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-5ee5a107-0e62-4d3c-8b7e-d5a8bc64f418 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] [instance: 8534737c-8a94-4755-ba3c-021132edace6] Going to try to terminate instance {{(pid=124457) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 10:40:40.643196 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-5ee5a107-0e62-4d3c-8b7e-d5a8bc64f418 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] 10.222.0.121 "DELETE /compute/v2.1/servers/8534737c-8a94-4755-ba3c-021132edace6" status: 204 len: 0 microversion: 2.1 time: 0.145966 Aug 04 10:40:40.643915 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 377/741] 10.222.0.121 () {58 vars in 1244 bytes} [Thu Aug 4 10:40:40 2022] DELETE /compute/v2.1/servers/8534737c-8a94-4755-ba3c-021132edace6 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 10:40:40.652623 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-fd0ff17e-f89c-40a1-9092-f100f28a0520 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:40:40.653252 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-fd0ff17e-f89c-40a1-9092-f100f28a0520 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] [instance: 8534737c-8a94-4755-ba3c-021132edace6] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:40:40.660581 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-fd0ff17e-f89c-40a1-9092-f100f28a0520 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:40:40.661045 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-fd0ff17e-f89c-40a1-9092-f100f28a0520 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:40:40.661828 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-fd0ff17e-f89c-40a1-9092-f100f28a0520 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:40:40.662281 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-fd0ff17e-f89c-40a1-9092-f100f28a0520 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:40:40.808598 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-fd0ff17e-f89c-40a1-9092-f100f28a0520 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a38b5af1654f44bc6cb5832c2e8e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051b6a3defca48d7b4f8bb6705f89f20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:40:40.817098 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-fd0ff17e-f89c-40a1-9092-f100f28a0520 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] 10.222.0.121 "GET /compute/v2.1/servers/8534737c-8a94-4755-ba3c-021132edace6" status: 200 len: 1685 microversion: 2.1 time: 0.168458 Aug 04 10:40:40.817696 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 365/742] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:40:40 2022] GET /compute/v2.1/servers/8534737c-8a94-4755-ba3c-021132edace6 => generated 1685 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:40:41.839693 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-39c61642-ed93-4b3b-bbe8-64f436cdd0d7 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:40:41.840393 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-39c61642-ed93-4b3b-bbe8-64f436cdd0d7 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] [instance: 8534737c-8a94-4755-ba3c-021132edace6] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:40:41.847795 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-39c61642-ed93-4b3b-bbe8-64f436cdd0d7 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:40:41.848361 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-39c61642-ed93-4b3b-bbe8-64f436cdd0d7 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:40:41.849174 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-39c61642-ed93-4b3b-bbe8-64f436cdd0d7 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:40:41.849625 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-39c61642-ed93-4b3b-bbe8-64f436cdd0d7 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:40:41.993345 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-39c61642-ed93-4b3b-bbe8-64f436cdd0d7 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a38b5af1654f44bc6cb5832c2e8e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051b6a3defca48d7b4f8bb6705f89f20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:40:42.001415 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-39c61642-ed93-4b3b-bbe8-64f436cdd0d7 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] 10.222.0.121 "GET /compute/v2.1/servers/8534737c-8a94-4755-ba3c-021132edace6" status: 200 len: 1685 microversion: 2.1 time: 0.166615 Aug 04 10:40:42.002011 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 378/743] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:40:41 2022] GET /compute/v2.1/servers/8534737c-8a94-4755-ba3c-021132edace6 => generated 1685 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:40:43.024269 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-7f2b6c6b-232c-4457-98e5-bbb49f49ddfe tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:40:43.024966 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-7f2b6c6b-232c-4457-98e5-bbb49f49ddfe tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] [instance: 8534737c-8a94-4755-ba3c-021132edace6] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:40:43.032920 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-7f2b6c6b-232c-4457-98e5-bbb49f49ddfe tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:40:43.033381 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-7f2b6c6b-232c-4457-98e5-bbb49f49ddfe tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:40:43.034180 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-7f2b6c6b-232c-4457-98e5-bbb49f49ddfe tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:40:43.034690 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-7f2b6c6b-232c-4457-98e5-bbb49f49ddfe tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:40:43.260260 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-7f2b6c6b-232c-4457-98e5-bbb49f49ddfe tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a38b5af1654f44bc6cb5832c2e8e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051b6a3defca48d7b4f8bb6705f89f20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:40:43.268962 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-7f2b6c6b-232c-4457-98e5-bbb49f49ddfe tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] 10.222.0.121 "GET /compute/v2.1/servers/8534737c-8a94-4755-ba3c-021132edace6" status: 200 len: 1685 microversion: 2.1 time: 0.249363 Aug 04 10:40:43.269668 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 366/744] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:40:43 2022] GET /compute/v2.1/servers/8534737c-8a94-4755-ba3c-021132edace6 => generated 1685 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:40:44.003464 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [req-c4a6bdf7-1ba7-41e9-80aa-cd7c476b160c req-9fee326a-f0b3-41f2-98ea-16b806e23d8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8534737c-8a94-4755-ba3c-021132edace6", "name": "network-vif-deleted", "tag": "5e2a8967-749e-4b17-b392-9ccf6a550b05"}]} {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:40:44.014706 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [req-c4a6bdf7-1ba7-41e9-80aa-cd7c476b160c req-9fee326a-f0b3-41f2-98ea-16b806e23d8c service nova] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:40:44.015268 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [req-c4a6bdf7-1ba7-41e9-80aa-cd7c476b160c req-9fee326a-f0b3-41f2-98ea-16b806e23d8c service nova] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:40:44.027640 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.compute.server_external_events [req-c4a6bdf7-1ba7-41e9-80aa-cd7c476b160c req-9fee326a-f0b3-41f2-98ea-16b806e23d8c service nova] Creating event network-vif-deleted:5e2a8967-749e-4b17-b392-9ccf6a550b05 for instance 8534737c-8a94-4755-ba3c-021132edace6 on hv-cinder-85200 Aug 04 10:40:44.033878 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [req-c4a6bdf7-1ba7-41e9-80aa-cd7c476b160c req-9fee326a-f0b3-41f2-98ea-16b806e23d8c service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036181 Aug 04 10:40:44.035096 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 379/745] 10.222.0.121 () {64 vars in 1322 bytes} [Thu Aug 4 10:40:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:40:44.291444 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-97b50db3-ae06-4c2b-9bf6-ee689575dad7 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:40:44.292233 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-97b50db3-ae06-4c2b-9bf6-ee689575dad7 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] [instance: 8534737c-8a94-4755-ba3c-021132edace6] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:40:44.295164 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG dbcounter [-] [124456] Writing DB stats nova_api:SELECT=49 {{(pid=124456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:40:44.301784 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-97b50db3-ae06-4c2b-9bf6-ee689575dad7 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:40:44.302316 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-97b50db3-ae06-4c2b-9bf6-ee689575dad7 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:40:44.303207 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-97b50db3-ae06-4c2b-9bf6-ee689575dad7 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:40:44.303729 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-97b50db3-ae06-4c2b-9bf6-ee689575dad7 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:40:44.340819 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-97b50db3-ae06-4c2b-9bf6-ee689575dad7 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:40:44.341278 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-97b50db3-ae06-4c2b-9bf6-ee689575dad7 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:40:44.341723 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.objects.instance [None req-97b50db3-ae06-4c2b-9bf6-ee689575dad7 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lazy-loading 'fault' on Instance uuid 8534737c-8a94-4755-ba3c-021132edace6 {{(pid=124456) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 10:40:44.388020 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-97b50db3-ae06-4c2b-9bf6-ee689575dad7 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a38b5af1654f44bc6cb5832c2e8e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051b6a3defca48d7b4f8bb6705f89f20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:40:44.396974 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-97b50db3-ae06-4c2b-9bf6-ee689575dad7 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] 10.222.0.121 "GET /compute/v2.1/servers/8534737c-8a94-4755-ba3c-021132edace6" status: 200 len: 1335 microversion: 2.1 time: 0.109613 Aug 04 10:40:44.413401 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 367/746] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:40:44 2022] GET /compute/v2.1/servers/8534737c-8a94-4755-ba3c-021132edace6 => generated 1335 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:40:45.426856 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-03a11e29-dc56-415e-a190-c815629fe038 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:40:45.427551 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-03a11e29-dc56-415e-a190-c815629fe038 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] [instance: 8534737c-8a94-4755-ba3c-021132edace6] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:40:45.437733 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-03a11e29-dc56-415e-a190-c815629fe038 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:40:45.438284 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-03a11e29-dc56-415e-a190-c815629fe038 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:40:45.439443 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-03a11e29-dc56-415e-a190-c815629fe038 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:40:45.439982 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-03a11e29-dc56-415e-a190-c815629fe038 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:40:45.455759 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.wsgi [None req-03a11e29-dc56-415e-a190-c815629fe038 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] HTTP exception thrown: Instance 8534737c-8a94-4755-ba3c-021132edace6 could not be found. Aug 04 10:40:45.457509 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-03a11e29-dc56-415e-a190-c815629fe038 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Request method failure captured: Aug 04 10:40:45.457509 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: request: GET /compute/v2.1/servers/8534737c-8a94-4755-ba3c-021132edace6 HTTP/1.1 Aug 04 10:40:45.457509 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: Accept: application/json Aug 04 10:40:45.457509 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: Accept-Encoding: identity Aug 04 10:40:45.457509 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: Connection: close Aug 04 10:40:45.457509 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: Content-Length: 0 Aug 04 10:40:45.457509 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: Content-Type: application/json Aug 04 10:40:45.457509 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: Host: 10.222.0.121 Aug 04 10:40:45.457509 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: Openstack-System-Scope: None Aug 04 10:40:45.457509 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: User-Agent: python-urllib3/1.26.11 Aug 04 10:40:45.457509 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Auth-Token: gAAAAABi66BYmE2gBqIXhQG24OFFWzVprzGeGbZ6oWrpD9juFQnTdf9ST5LtrG_tq8UPT6UiMvXECGt7-Rb5xRfm_FUvpCA0aMeQcAwPVFfAZaKkKC5hs5ouvidzrTVo1nH2TD4SvjZYb98NZaHzipnkuU-vQFrG4wdkP89b_O5rLKaczIbRvag Aug 04 10:40:45.457509 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Domain-Id: None Aug 04 10:40:45.457509 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Domain-Name: None Aug 04 10:40:45.457509 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Identity-Status: Confirmed Aug 04 10:40:45.457509 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Is-Admin-Project: True Aug 04 10:40:45.457509 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Project-Domain-Id: default Aug 04 10:40:45.457509 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Project-Domain-Name: Default Aug 04 10:40:45.457509 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Project-Id: 051b6a3defca48d7b4f8bb6705f89f20 Aug 04 10:40:45.457509 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Project-Name: tempest-AttachVolumeNegativeTest-18806726 Aug 04 10:40:45.457509 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Role: reader,member Aug 04 10:40:45.457509 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Roles: reader,member Aug 04 10:40:45.459113 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/051b6a3defca48d7b4f8bb6705f89f20"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/051b6a3defca48d7b4f8bb6705f89f20"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.121:8080", "publicURL": "http://10.222.0.121:8080/v1/AUTH_051b6a3defca48d7b4f8bb6705f89f20"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2/051b6a3defca48d7b4f8bb6705f89f20"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:9696/networking"}]}] Aug 04 10:40:45.459113 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Tenant: tempest-AttachVolumeNegativeTest-18806726 Aug 04 10:40:45.459113 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Tenant-Id: 051b6a3defca48d7b4f8bb6705f89f20 Aug 04 10:40:45.459113 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-18806726 Aug 04 10:40:45.459113 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-User: tempest-AttachVolumeNegativeTest-18806726-project Aug 04 10:40:45.459113 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-User-Domain-Id: default Aug 04 10:40:45.459113 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-User-Domain-Name: Default Aug 04 10:40:45.459113 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-User-Id: 41a38b5af1654f44bc6cb5832c2e8e87 Aug 04 10:40:45.459113 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-User-Name: tempest-AttachVolumeNegativeTest-18806726-project Aug 04 10:40:45.459113 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: method: > Aug 04 10:40:45.459113 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: exception: Instance 8534737c-8a94-4755-ba3c-021132edace6 could not be found. Aug 04 10:40:45.459113 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: action_args: {'id': '8534737c-8a94-4755-ba3c-021132edace6'} Aug 04 10:40:45.460083 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 10:40:45.460083 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:40:45.460083 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 10:40:45.460083 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 10:40:45.460083 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 10:40:45.460083 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 10:40:45.460083 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 10:40:45.460083 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 10:40:45.460083 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 10:40:45.460083 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 10:40:45.460083 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8534737c-8a94-4755-ba3c-021132edace6 could not be found. Aug 04 10:40:45.460083 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Aug 04 10:40:45.460083 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:40:45.460083 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Aug 04 10:40:45.460083 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:40:45.460083 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:40:45.460083 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:40:45.460083 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 10:40:45.460083 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 10:40:45.460083 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 10:40:45.461734 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 10:40:45.461734 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 10:40:45.461734 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 10:40:45.461734 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 10:40:45.461734 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 10:40:45.461734 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 10:40:45.461734 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 10:40:45.461734 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8534737c-8a94-4755-ba3c-021132edace6 could not be found. Aug 04 10:40:45.461734 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Aug 04 10:40:45.461734 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:40:45.461734 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Aug 04 10:40:45.461734 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:40:45.461734 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:40:45.461734 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:40:45.461734 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 10:40:45.461734 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 10:40:45.461734 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8534737c-8a94-4755-ba3c-021132edace6 could not be found. Aug 04 10:40:45.461734 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Aug 04 10:40:45.463074 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-03a11e29-dc56-415e-a190-c815629fe038 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Returning 404 to user: Instance 8534737c-8a94-4755-ba3c-021132edace6 could not be found. {{(pid=124457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 10:40:45.463074 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-03a11e29-dc56-415e-a190-c815629fe038 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] 10.222.0.121 "GET /compute/v2.1/servers/8534737c-8a94-4755-ba3c-021132edace6" status: 404 len: 111 microversion: 2.1 time: 0.040189 Aug 04 10:40:45.463074 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 380/747] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:40:45 2022] GET /compute/v2.1/servers/8534737c-8a94-4755-ba3c-021132edace6 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 10:40:45.468764 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-a9dff902-0ead-4234-85c1-91cd915a51c1 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Calling method '.version_select at 0x7f6754f83c10>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:40:45.492751 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-a9dff902-0ead-4234-85c1-91cd915a51c1 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] 10.222.0.121 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1621578010" status: 202 len: 0 microversion: 2.1 time: 0.027930 Aug 04 10:40:45.493339 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 368/748] 10.222.0.121 () {58 vars in 1226 bytes} [Thu Aug 4 10:40:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1621578010 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 10:40:46.237813 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-f60beb94-0724-433a-a9a8-1e1192f0ccd2 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:40:46.238317 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-f60beb94-0724-433a-a9a8-1e1192f0ccd2 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] [instance: c6dec6e8-e2f9-4c57-8326-19fc989b5c6e] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:40:46.245493 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-f60beb94-0724-433a-a9a8-1e1192f0ccd2 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:40:46.245950 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-f60beb94-0724-433a-a9a8-1e1192f0ccd2 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:40:46.246734 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-f60beb94-0724-433a-a9a8-1e1192f0ccd2 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:40:46.247176 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-f60beb94-0724-433a-a9a8-1e1192f0ccd2 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:40:46.331165 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.objects.instance [None req-f60beb94-0724-433a-a9a8-1e1192f0ccd2 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lazy-loading 'services' on Instance uuid c6dec6e8-e2f9-4c57-8326-19fc989b5c6e {{(pid=124457) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 10:40:46.425802 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-f60beb94-0724-433a-a9a8-1e1192f0ccd2 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] 10.222.0.121 "DELETE /compute/v2.1/servers/c6dec6e8-e2f9-4c57-8326-19fc989b5c6e/os-volume_attachments/d30c562b-e963-4c2d-ad89-beeaf6a51747" status: 202 len: 0 microversion: 2.1 time: 0.191900 Aug 04 10:40:46.426489 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 381/749] 10.222.0.121 () {58 vars in 1421 bytes} [Thu Aug 4 10:40:46 2022] DELETE /compute/v2.1/servers/c6dec6e8-e2f9-4c57-8326-19fc989b5c6e/os-volume_attachments/d30c562b-e963-4c2d-ad89-beeaf6a51747 => generated 0 bytes in 193 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 10:40:46.435622 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-a0f43f95-dadc-4080-b559-12106a059f9a tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:40:46.437847 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-a0f43f95-dadc-4080-b559-12106a059f9a tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] [instance: c6dec6e8-e2f9-4c57-8326-19fc989b5c6e] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:40:46.445214 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-a0f43f95-dadc-4080-b559-12106a059f9a tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:40:46.446234 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-a0f43f95-dadc-4080-b559-12106a059f9a tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:40:46.447070 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-a0f43f95-dadc-4080-b559-12106a059f9a tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:40:46.447481 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-a0f43f95-dadc-4080-b559-12106a059f9a tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:40:46.480411 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-a0f43f95-dadc-4080-b559-12106a059f9a tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] 10.222.0.121 "GET /compute/v2.1/servers/c6dec6e8-e2f9-4c57-8326-19fc989b5c6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048981 Aug 04 10:40:46.481797 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 369/750] 10.222.0.121 () {58 vars in 1307 bytes} [Thu Aug 4 10:40:46 2022] GET /compute/v2.1/servers/c6dec6e8-e2f9-4c57-8326-19fc989b5c6e/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:40:47.493913 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-2a612b75-2f3d-4c54-a738-622ae50ab014 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:40:47.496468 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-2a612b75-2f3d-4c54-a738-622ae50ab014 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] [instance: c6dec6e8-e2f9-4c57-8326-19fc989b5c6e] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:40:47.505255 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-2a612b75-2f3d-4c54-a738-622ae50ab014 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:40:47.505702 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-2a612b75-2f3d-4c54-a738-622ae50ab014 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:40:47.506485 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-2a612b75-2f3d-4c54-a738-622ae50ab014 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:40:47.506994 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-2a612b75-2f3d-4c54-a738-622ae50ab014 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:40:47.539369 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-2a612b75-2f3d-4c54-a738-622ae50ab014 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] 10.222.0.121 "GET /compute/v2.1/servers/c6dec6e8-e2f9-4c57-8326-19fc989b5c6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050180 Aug 04 10:40:47.540126 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 382/751] 10.222.0.121 () {58 vars in 1307 bytes} [Thu Aug 4 10:40:47 2022] GET /compute/v2.1/servers/c6dec6e8-e2f9-4c57-8326-19fc989b5c6e/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:40:48.553095 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-690c6511-b8b3-4132-9b09-91e531c4f631 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:40:48.555349 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-690c6511-b8b3-4132-9b09-91e531c4f631 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] [instance: c6dec6e8-e2f9-4c57-8326-19fc989b5c6e] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:40:48.564909 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-690c6511-b8b3-4132-9b09-91e531c4f631 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:40:48.565358 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-690c6511-b8b3-4132-9b09-91e531c4f631 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:40:48.566151 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-690c6511-b8b3-4132-9b09-91e531c4f631 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:40:48.566591 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-690c6511-b8b3-4132-9b09-91e531c4f631 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:40:48.599058 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-690c6511-b8b3-4132-9b09-91e531c4f631 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] 10.222.0.121 "GET /compute/v2.1/servers/c6dec6e8-e2f9-4c57-8326-19fc989b5c6e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050102 Aug 04 10:40:48.599635 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 370/752] 10.222.0.121 () {58 vars in 1307 bytes} [Thu Aug 4 10:40:48 2022] GET /compute/v2.1/servers/c6dec6e8-e2f9-4c57-8326-19fc989b5c6e/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 10:40:48.673012 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-216f59f2-75cc-416f-bad1-70e0eff33968 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:40:48.673612 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-216f59f2-75cc-416f-bad1-70e0eff33968 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] [instance: c6dec6e8-e2f9-4c57-8326-19fc989b5c6e] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:40:48.680587 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-216f59f2-75cc-416f-bad1-70e0eff33968 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:40:48.681050 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-216f59f2-75cc-416f-bad1-70e0eff33968 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:40:48.681839 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-216f59f2-75cc-416f-bad1-70e0eff33968 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:40:48.682291 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-216f59f2-75cc-416f-bad1-70e0eff33968 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:40:48.702723 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG dbcounter [-] [124457] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=3,nova_cell1:INSERT=4 {{(pid=124457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:40:48.710688 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-216f59f2-75cc-416f-bad1-70e0eff33968 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] [instance: c6dec6e8-e2f9-4c57-8326-19fc989b5c6e] Going to try to terminate instance {{(pid=124457) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 10:40:48.796289 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-216f59f2-75cc-416f-bad1-70e0eff33968 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] 10.222.0.121 "DELETE /compute/v2.1/servers/c6dec6e8-e2f9-4c57-8326-19fc989b5c6e" status: 204 len: 0 microversion: 2.1 time: 0.126870 Aug 04 10:40:48.796924 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 383/753] 10.222.0.121 () {58 vars in 1244 bytes} [Thu Aug 4 10:40:48 2022] DELETE /compute/v2.1/servers/c6dec6e8-e2f9-4c57-8326-19fc989b5c6e => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 10:40:48.806533 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-f50ee1ab-8aab-4852-a347-f451895a93b3 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:40:48.807083 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-f50ee1ab-8aab-4852-a347-f451895a93b3 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] [instance: c6dec6e8-e2f9-4c57-8326-19fc989b5c6e] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:40:48.813656 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-f50ee1ab-8aab-4852-a347-f451895a93b3 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:40:48.814102 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-f50ee1ab-8aab-4852-a347-f451895a93b3 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:40:48.815096 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-f50ee1ab-8aab-4852-a347-f451895a93b3 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:40:48.815873 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-f50ee1ab-8aab-4852-a347-f451895a93b3 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:40:48.973947 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-f50ee1ab-8aab-4852-a347-f451895a93b3 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a38b5af1654f44bc6cb5832c2e8e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051b6a3defca48d7b4f8bb6705f89f20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:40:48.982669 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-f50ee1ab-8aab-4852-a347-f451895a93b3 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] 10.222.0.121 "GET /compute/v2.1/servers/c6dec6e8-e2f9-4c57-8326-19fc989b5c6e" status: 200 len: 1684 microversion: 2.1 time: 0.180407 Aug 04 10:40:48.983270 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 371/754] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:40:48 2022] GET /compute/v2.1/servers/c6dec6e8-e2f9-4c57-8326-19fc989b5c6e => generated 1684 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:40:50.008397 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-ab92a088-3d85-48ac-b00c-d13271da7951 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:40:50.009035 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-ab92a088-3d85-48ac-b00c-d13271da7951 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] [instance: c6dec6e8-e2f9-4c57-8326-19fc989b5c6e] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:40:50.016349 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-ab92a088-3d85-48ac-b00c-d13271da7951 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:40:50.016808 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-ab92a088-3d85-48ac-b00c-d13271da7951 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:40:50.017610 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-ab92a088-3d85-48ac-b00c-d13271da7951 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:40:50.018055 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-ab92a088-3d85-48ac-b00c-d13271da7951 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:40:50.268917 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-ab92a088-3d85-48ac-b00c-d13271da7951 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a38b5af1654f44bc6cb5832c2e8e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051b6a3defca48d7b4f8bb6705f89f20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:40:50.277279 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-ab92a088-3d85-48ac-b00c-d13271da7951 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] 10.222.0.121 "GET /compute/v2.1/servers/c6dec6e8-e2f9-4c57-8326-19fc989b5c6e" status: 200 len: 1684 microversion: 2.1 time: 0.275746 Aug 04 10:40:50.277866 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 384/755] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:40:49 2022] GET /compute/v2.1/servers/c6dec6e8-e2f9-4c57-8326-19fc989b5c6e => generated 1684 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:40:50.995296 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [req-5989707d-a137-48f7-b629-adbb5b1b13b0 req-fbda58a5-5cdf-4b83-b2dd-17fe2c0fb693 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6dec6e8-e2f9-4c57-8326-19fc989b5c6e", "name": "network-vif-deleted", "tag": "03bbc55a-5c71-4f8b-8a66-c3b18135d94a"}]} {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:40:51.005963 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [req-5989707d-a137-48f7-b629-adbb5b1b13b0 req-fbda58a5-5cdf-4b83-b2dd-17fe2c0fb693 service nova] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:40:51.006418 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [req-5989707d-a137-48f7-b629-adbb5b1b13b0 req-fbda58a5-5cdf-4b83-b2dd-17fe2c0fb693 service nova] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:40:51.018834 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.compute.server_external_events [req-5989707d-a137-48f7-b629-adbb5b1b13b0 req-fbda58a5-5cdf-4b83-b2dd-17fe2c0fb693 service nova] Creating event network-vif-deleted:03bbc55a-5c71-4f8b-8a66-c3b18135d94a for instance c6dec6e8-e2f9-4c57-8326-19fc989b5c6e on hv-cinder-85200 Aug 04 10:40:51.024087 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [req-5989707d-a137-48f7-b629-adbb5b1b13b0 req-fbda58a5-5cdf-4b83-b2dd-17fe2c0fb693 service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032630 Aug 04 10:40:51.027872 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 372/756] 10.222.0.121 () {64 vars in 1322 bytes} [Thu Aug 4 10:40:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:40:51.301144 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-e353dec0-97e7-463a-89f1-ae04b93f3741 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:40:51.301793 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-e353dec0-97e7-463a-89f1-ae04b93f3741 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] [instance: c6dec6e8-e2f9-4c57-8326-19fc989b5c6e] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:40:51.308409 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-e353dec0-97e7-463a-89f1-ae04b93f3741 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:40:51.308877 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-e353dec0-97e7-463a-89f1-ae04b93f3741 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:40:51.309670 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-e353dec0-97e7-463a-89f1-ae04b93f3741 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:40:51.310120 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-e353dec0-97e7-463a-89f1-ae04b93f3741 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:40:51.344074 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-e353dec0-97e7-463a-89f1-ae04b93f3741 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:40:51.344498 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-e353dec0-97e7-463a-89f1-ae04b93f3741 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:40:51.344892 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.objects.instance [None req-e353dec0-97e7-463a-89f1-ae04b93f3741 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lazy-loading 'fault' on Instance uuid c6dec6e8-e2f9-4c57-8326-19fc989b5c6e {{(pid=124457) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 10:40:51.394952 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-e353dec0-97e7-463a-89f1-ae04b93f3741 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a38b5af1654f44bc6cb5832c2e8e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051b6a3defca48d7b4f8bb6705f89f20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:40:51.404252 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-e353dec0-97e7-463a-89f1-ae04b93f3741 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] 10.222.0.121 "GET /compute/v2.1/servers/c6dec6e8-e2f9-4c57-8326-19fc989b5c6e" status: 200 len: 1336 microversion: 2.1 time: 0.107020 Aug 04 10:40:51.405192 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 385/757] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:40:51 2022] GET /compute/v2.1/servers/c6dec6e8-e2f9-4c57-8326-19fc989b5c6e => generated 1336 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:40:52.427999 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-c9d692c2-185c-4714-a635-259c1c84ad6d tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:40:52.428642 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-c9d692c2-185c-4714-a635-259c1c84ad6d tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] [instance: c6dec6e8-e2f9-4c57-8326-19fc989b5c6e] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:40:52.435912 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-c9d692c2-185c-4714-a635-259c1c84ad6d tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:40:52.436402 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-c9d692c2-185c-4714-a635-259c1c84ad6d tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:40:52.437218 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-c9d692c2-185c-4714-a635-259c1c84ad6d tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:40:52.437634 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-c9d692c2-185c-4714-a635-259c1c84ad6d tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:40:52.451439 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.wsgi [None req-c9d692c2-185c-4714-a635-259c1c84ad6d tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] HTTP exception thrown: Instance c6dec6e8-e2f9-4c57-8326-19fc989b5c6e could not be found. Aug 04 10:40:52.453120 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-c9d692c2-185c-4714-a635-259c1c84ad6d tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Request method failure captured: Aug 04 10:40:52.453120 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: request: GET /compute/v2.1/servers/c6dec6e8-e2f9-4c57-8326-19fc989b5c6e HTTP/1.1 Aug 04 10:40:52.453120 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: Accept: application/json Aug 04 10:40:52.453120 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: Accept-Encoding: identity Aug 04 10:40:52.453120 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: Connection: close Aug 04 10:40:52.453120 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: Content-Length: 0 Aug 04 10:40:52.453120 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: Content-Type: application/json Aug 04 10:40:52.453120 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: Host: 10.222.0.121 Aug 04 10:40:52.453120 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: Openstack-System-Scope: None Aug 04 10:40:52.453120 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: User-Agent: python-urllib3/1.26.11 Aug 04 10:40:52.453120 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Auth-Token: gAAAAABi66BYmE2gBqIXhQG24OFFWzVprzGeGbZ6oWrpD9juFQnTdf9ST5LtrG_tq8UPT6UiMvXECGt7-Rb5xRfm_FUvpCA0aMeQcAwPVFfAZaKkKC5hs5ouvidzrTVo1nH2TD4SvjZYb98NZaHzipnkuU-vQFrG4wdkP89b_O5rLKaczIbRvag Aug 04 10:40:52.453120 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Domain-Id: None Aug 04 10:40:52.453120 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Domain-Name: None Aug 04 10:40:52.453120 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Identity-Status: Confirmed Aug 04 10:40:52.453120 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Is-Admin-Project: True Aug 04 10:40:52.453120 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Project-Domain-Id: default Aug 04 10:40:52.453120 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Project-Domain-Name: Default Aug 04 10:40:52.453120 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Project-Id: 051b6a3defca48d7b4f8bb6705f89f20 Aug 04 10:40:52.453120 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Project-Name: tempest-AttachVolumeNegativeTest-18806726 Aug 04 10:40:52.453120 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Role: reader,member Aug 04 10:40:52.453120 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Roles: reader,member Aug 04 10:40:52.455386 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/051b6a3defca48d7b4f8bb6705f89f20"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/051b6a3defca48d7b4f8bb6705f89f20"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.121:8080", "publicURL": "http://10.222.0.121:8080/v1/AUTH_051b6a3defca48d7b4f8bb6705f89f20"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2/051b6a3defca48d7b4f8bb6705f89f20"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:9696/networking"}]}] Aug 04 10:40:52.455386 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Tenant: tempest-AttachVolumeNegativeTest-18806726 Aug 04 10:40:52.455386 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Tenant-Id: 051b6a3defca48d7b4f8bb6705f89f20 Aug 04 10:40:52.455386 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-18806726 Aug 04 10:40:52.455386 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-User: tempest-AttachVolumeNegativeTest-18806726-project Aug 04 10:40:52.455386 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-User-Domain-Id: default Aug 04 10:40:52.455386 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-User-Domain-Name: Default Aug 04 10:40:52.455386 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-User-Id: 41a38b5af1654f44bc6cb5832c2e8e87 Aug 04 10:40:52.455386 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-User-Name: tempest-AttachVolumeNegativeTest-18806726-project Aug 04 10:40:52.455386 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: method: > Aug 04 10:40:52.455386 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: exception: Instance c6dec6e8-e2f9-4c57-8326-19fc989b5c6e could not be found. Aug 04 10:40:52.455386 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: action_args: {'id': 'c6dec6e8-e2f9-4c57-8326-19fc989b5c6e'} Aug 04 10:40:52.456909 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 10:40:52.456909 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:40:52.456909 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 10:40:52.456909 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 10:40:52.456909 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 10:40:52.456909 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 10:40:52.456909 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 10:40:52.456909 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 10:40:52.456909 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 10:40:52.456909 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 10:40:52.456909 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c6dec6e8-e2f9-4c57-8326-19fc989b5c6e could not be found. Aug 04 10:40:52.456909 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi Aug 04 10:40:52.456909 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:40:52.456909 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi Aug 04 10:40:52.456909 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:40:52.456909 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:40:52.456909 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:40:52.456909 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 10:40:52.456909 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 10:40:52.456909 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 10:40:52.459111 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 10:40:52.459111 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 10:40:52.459111 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 10:40:52.459111 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 10:40:52.459111 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 10:40:52.459111 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 10:40:52.459111 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 10:40:52.459111 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c6dec6e8-e2f9-4c57-8326-19fc989b5c6e could not be found. Aug 04 10:40:52.459111 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi Aug 04 10:40:52.459111 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:40:52.459111 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi Aug 04 10:40:52.459111 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:40:52.459111 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:40:52.459111 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:40:52.459111 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 10:40:52.459111 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 10:40:52.459111 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c6dec6e8-e2f9-4c57-8326-19fc989b5c6e could not be found. Aug 04 10:40:52.459111 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi Aug 04 10:40:52.460622 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-c9d692c2-185c-4714-a635-259c1c84ad6d tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Returning 404 to user: Instance c6dec6e8-e2f9-4c57-8326-19fc989b5c6e could not be found. {{(pid=124456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 10:40:52.460622 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-c9d692c2-185c-4714-a635-259c1c84ad6d tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] 10.222.0.121 "GET /compute/v2.1/servers/c6dec6e8-e2f9-4c57-8326-19fc989b5c6e" status: 404 len: 111 microversion: 2.1 time: 0.031740 Aug 04 10:40:52.460622 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 373/758] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:40:52 2022] GET /compute/v2.1/servers/c6dec6e8-e2f9-4c57-8326-19fc989b5c6e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 10:40:52.464264 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-13a56b88-6f62-4a1b-af2b-2507a7146b50 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Calling method '.version_select at 0x7f6754d69f70>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:40:52.468950 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR oslo.messaging._drivers.impl_rabbit [None req-13a56b88-6f62-4a1b-af2b-2507a7146b50 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] [37612313-4543-4697-baeb-7c6c7eb7add5] AMQP server on 10.222.0.121:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 04 10:40:53.478346 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO oslo.messaging._drivers.impl_rabbit [None req-13a56b88-6f62-4a1b-af2b-2507a7146b50 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] [37612313-4543-4697-baeb-7c6c7eb7add5] Reconnected to AMQP server on 10.222.0.121:5672 via [amqp] client with port 36880. Aug 04 10:40:53.504734 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-13a56b88-6f62-4a1b-af2b-2507a7146b50 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] 10.222.0.121 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1939723963" status: 202 len: 0 microversion: 2.1 time: 1.044181 Aug 04 10:40:53.505483 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 386/759] 10.222.0.121 () {58 vars in 1226 bytes} [Thu Aug 4 10:40:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1939723963 => generated 0 bytes in 1046 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 10:40:54.216981 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-320698f9-febc-447a-be6a-277a2c63b291 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Action: 'create', calling method: .version_select at 0x7f6755023820>, body: {"keypair": {"name": "tempest-keypair-2129296901", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM34tYrBoU7cIz8eDvRBL68nhFvnGS8elXXQiDV8o0jXX81nHSM00jY0NSSzr2iTsw1k1PNeHMN49X0NoQI4nkNY8nvQZFdGCl8Wv0xEHnzYSv4grBI0dvt0aj/4Oh++Bg=="}} {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:40:54.235740 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.quota [None req-320698f9-febc-447a-be6a-277a2c63b291 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Getting quotas for project 051b6a3defca48d7b4f8bb6705f89f20. Resources: {'key_pairs'} {{(pid=124456) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 10:40:54.240212 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.quota [None req-320698f9-febc-447a-be6a-277a2c63b291 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Getting quotas for user 41a38b5af1654f44bc6cb5832c2e8e87 and project 051b6a3defca48d7b4f8bb6705f89f20. Resources: {'key_pairs'} {{(pid=124456) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 10:40:54.266497 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-320698f9-febc-447a-be6a-277a2c63b291 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] 10.222.0.121 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.053432 Aug 04 10:40:54.267187 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 374/760] 10.222.0.121 () {60 vars in 1164 bytes} [Thu Aug 4 10:40:54 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:40:55.774544 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-5923f9df-8d1c-477f-89ff-6f4e56db6647 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1786066252", "imageRef": "46724bb5-955f-4f3f-bd6a-b561fdde55e3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ddbd5a12-fb68-4b76-a245-c2162d57f8f9"}], "security_groups": [{"name": "tempest-securitygroup--577548468"}], "key_name": "tempest-keypair-2129296901", "user_data": "}} {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:40:55.905922 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.network.neutron [None req-5923f9df-8d1c-477f-89ff-6f4e56db6647 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] validate_networks() for [('ddbd5a12-fb68-4b76-a245-c2162d57f8f9', None, None, None, None, None)] {{(pid=124457) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 10:40:56.308827 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.virt.hardware [None req-5923f9df-8d1c-477f-89ff-6f4e56db6647 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Flavor limits 0:0:0 {{(pid=124457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 10:40:56.309287 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.virt.hardware [None req-5923f9df-8d1c-477f-89ff-6f4e56db6647 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Image limits 0:0:0 {{(pid=124457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 10:40:56.310033 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.virt.hardware [None req-5923f9df-8d1c-477f-89ff-6f4e56db6647 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Flavor pref 0:0:0 {{(pid=124457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 10:40:56.310615 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.virt.hardware [None req-5923f9df-8d1c-477f-89ff-6f4e56db6647 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Image pref 0:0:0 {{(pid=124457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 10:40:56.311217 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.virt.hardware [None req-5923f9df-8d1c-477f-89ff-6f4e56db6647 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 10:40:56.325682 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-5923f9df-8d1c-477f-89ff-6f4e56db6647 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:40:56.326200 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-5923f9df-8d1c-477f-89ff-6f4e56db6647 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:40:56.326980 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-5923f9df-8d1c-477f-89ff-6f4e56db6647 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:40:56.327430 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-5923f9df-8d1c-477f-89ff-6f4e56db6647 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:40:56.346299 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.quota [None req-5923f9df-8d1c-477f-89ff-6f4e56db6647 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Getting quotas for project 051b6a3defca48d7b4f8bb6705f89f20. Resources: {'ram', 'instances', 'cores'} {{(pid=124457) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 10:40:56.351362 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.quota [None req-5923f9df-8d1c-477f-89ff-6f4e56db6647 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Getting quotas for user 41a38b5af1654f44bc6cb5832c2e8e87 and project 051b6a3defca48d7b4f8bb6705f89f20. Resources: {'ram', 'instances', 'cores'} {{(pid=124457) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 10:40:56.363567 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-5923f9df-8d1c-477f-89ff-6f4e56db6647 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Going to run 1 instances... {{(pid=124457) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 10:40:56.365970 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-5923f9df-8d1c-477f-89ff-6f4e56db6647 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] [instance: aca71cfb-26a8-4881-af52-7a1c370fee28] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='46724bb5-955f-4f3f-bd6a-b561fdde55e3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124457) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 10:40:56.421911 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-5923f9df-8d1c-477f-89ff-6f4e56db6647 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] 10.222.0.121 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.652472 Aug 04 10:40:56.422935 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 387/761] 10.222.0.121 () {60 vars in 1152 bytes} [Thu Aug 4 10:40:55 2022] POST /compute/v2.1/servers => generated 403 bytes in 654 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 04 10:40:56.435213 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-b045493e-5c20-402c-854c-a76aee020a6d tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:40:56.435900 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-b045493e-5c20-402c-854c-a76aee020a6d tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] [instance: aca71cfb-26a8-4881-af52-7a1c370fee28] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:40:56.495103 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-b045493e-5c20-402c-854c-a76aee020a6d tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a38b5af1654f44bc6cb5832c2e8e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051b6a3defca48d7b4f8bb6705f89f20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:40:56.502391 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-b045493e-5c20-402c-854c-a76aee020a6d tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] 10.222.0.121 "GET /compute/v2.1/servers/aca71cfb-26a8-4881-af52-7a1c370fee28" status: 200 len: 1246 microversion: 2.1 time: 0.071906 Aug 04 10:40:56.502966 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 375/762] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:40:56 2022] GET /compute/v2.1/servers/aca71cfb-26a8-4881-af52-7a1c370fee28 => generated 1246 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:40:57.525046 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-20779a14-1bd4-41e1-8451-10e804fe0dd8 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:40:57.526049 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-20779a14-1bd4-41e1-8451-10e804fe0dd8 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] [instance: aca71cfb-26a8-4881-af52-7a1c370fee28] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:40:57.533330 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-20779a14-1bd4-41e1-8451-10e804fe0dd8 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:40:57.533795 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-20779a14-1bd4-41e1-8451-10e804fe0dd8 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:40:57.534588 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-20779a14-1bd4-41e1-8451-10e804fe0dd8 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:40:57.535042 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-20779a14-1bd4-41e1-8451-10e804fe0dd8 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:40:57.660457 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-20779a14-1bd4-41e1-8451-10e804fe0dd8 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a38b5af1654f44bc6cb5832c2e8e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051b6a3defca48d7b4f8bb6705f89f20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:40:57.675833 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-20779a14-1bd4-41e1-8451-10e804fe0dd8 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] 10.222.0.121 "GET /compute/v2.1/servers/aca71cfb-26a8-4881-af52-7a1c370fee28" status: 200 len: 1306 microversion: 2.1 time: 0.155327 Aug 04 10:40:57.677631 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 388/763] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:40:57 2022] GET /compute/v2.1/servers/aca71cfb-26a8-4881-af52-7a1c370fee28 => generated 1306 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:40:58.702162 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-fadb144f-da91-4a9b-826e-c9bedd159188 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:40:58.702754 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-fadb144f-da91-4a9b-826e-c9bedd159188 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] [instance: aca71cfb-26a8-4881-af52-7a1c370fee28] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:40:58.709297 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-fadb144f-da91-4a9b-826e-c9bedd159188 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:40:58.709746 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-fadb144f-da91-4a9b-826e-c9bedd159188 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:40:58.710521 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-fadb144f-da91-4a9b-826e-c9bedd159188 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:40:58.710955 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-fadb144f-da91-4a9b-826e-c9bedd159188 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:40:58.951799 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-fadb144f-da91-4a9b-826e-c9bedd159188 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a38b5af1654f44bc6cb5832c2e8e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051b6a3defca48d7b4f8bb6705f89f20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:40:58.961243 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-fadb144f-da91-4a9b-826e-c9bedd159188 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] 10.222.0.121 "GET /compute/v2.1/servers/aca71cfb-26a8-4881-af52-7a1c370fee28" status: 200 len: 1371 microversion: 2.1 time: 0.264471 Aug 04 10:40:58.961959 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 376/764] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:40:58 2022] GET /compute/v2.1/servers/aca71cfb-26a8-4881-af52-7a1c370fee28 => generated 1371 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:40:59.575679 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [req-dc34983b-3cb8-4239-9113-d7ed38f5649f req-ea900e4e-9796-4762-8bc0-9fba798461ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aca71cfb-26a8-4881-af52-7a1c370fee28", "tag": "cacda5a6-f10e-4545-9afd-a4d6723e126b"}]} {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:40:59.592211 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [req-dc34983b-3cb8-4239-9113-d7ed38f5649f req-ea900e4e-9796-4762-8bc0-9fba798461ab service nova] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:40:59.592651 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [req-dc34983b-3cb8-4239-9113-d7ed38f5649f req-ea900e4e-9796-4762-8bc0-9fba798461ab service nova] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:40:59.607303 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.compute.server_external_events [req-dc34983b-3cb8-4239-9113-d7ed38f5649f req-ea900e4e-9796-4762-8bc0-9fba798461ab service nova] Creating event network-changed:cacda5a6-f10e-4545-9afd-a4d6723e126b for instance aca71cfb-26a8-4881-af52-7a1c370fee28 on hv-cinder-85200 Aug 04 10:40:59.612872 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [req-dc34983b-3cb8-4239-9113-d7ed38f5649f req-ea900e4e-9796-4762-8bc0-9fba798461ab service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041261 Aug 04 10:40:59.613755 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 389/765] 10.222.0.121 () {64 vars in 1322 bytes} [Thu Aug 4 10:40:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:40:59.983479 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-d50ff7a6-b906-4105-986d-370dc7e61988 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:40:59.984534 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-d50ff7a6-b906-4105-986d-370dc7e61988 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] [instance: aca71cfb-26a8-4881-af52-7a1c370fee28] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:40:59.995230 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-d50ff7a6-b906-4105-986d-370dc7e61988 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:40:59.995767 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-d50ff7a6-b906-4105-986d-370dc7e61988 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:40:59.996692 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-d50ff7a6-b906-4105-986d-370dc7e61988 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:40:59.997244 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-d50ff7a6-b906-4105-986d-370dc7e61988 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:41:00.166304 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-d50ff7a6-b906-4105-986d-370dc7e61988 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a38b5af1654f44bc6cb5832c2e8e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051b6a3defca48d7b4f8bb6705f89f20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:41:00.174555 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-d50ff7a6-b906-4105-986d-370dc7e61988 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] 10.222.0.121 "GET /compute/v2.1/servers/aca71cfb-26a8-4881-af52-7a1c370fee28" status: 200 len: 1371 microversion: 2.1 time: 0.195157 Aug 04 10:41:00.175164 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 377/766] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:40:59 2022] GET /compute/v2.1/servers/aca71cfb-26a8-4881-af52-7a1c370fee28 => generated 1371 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:41:01.198196 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-258b59c8-e4bc-42ff-bbe0-3231e01934ed tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:41:01.199215 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-258b59c8-e4bc-42ff-bbe0-3231e01934ed tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] [instance: aca71cfb-26a8-4881-af52-7a1c370fee28] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:41:01.206375 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-258b59c8-e4bc-42ff-bbe0-3231e01934ed tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:41:01.206829 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-258b59c8-e4bc-42ff-bbe0-3231e01934ed tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:41:01.207613 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-258b59c8-e4bc-42ff-bbe0-3231e01934ed tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:41:01.208094 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-258b59c8-e4bc-42ff-bbe0-3231e01934ed tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:41:01.368637 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-258b59c8-e4bc-42ff-bbe0-3231e01934ed tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a38b5af1654f44bc6cb5832c2e8e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051b6a3defca48d7b4f8bb6705f89f20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:41:01.381346 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-258b59c8-e4bc-42ff-bbe0-3231e01934ed tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] 10.222.0.121 "GET /compute/v2.1/servers/aca71cfb-26a8-4881-af52-7a1c370fee28" status: 200 len: 1371 microversion: 2.1 time: 0.188046 Aug 04 10:41:01.382124 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 390/767] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:41:01 2022] GET /compute/v2.1/servers/aca71cfb-26a8-4881-af52-7a1c370fee28 => generated 1371 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:41:02.407781 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-436608a5-75fd-4788-bcd5-7225db81ae6f tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:41:02.408544 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-436608a5-75fd-4788-bcd5-7225db81ae6f tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] [instance: aca71cfb-26a8-4881-af52-7a1c370fee28] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:41:02.415691 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-436608a5-75fd-4788-bcd5-7225db81ae6f tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:41:02.416186 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-436608a5-75fd-4788-bcd5-7225db81ae6f tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:41:02.416955 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-436608a5-75fd-4788-bcd5-7225db81ae6f tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:41:02.417396 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-436608a5-75fd-4788-bcd5-7225db81ae6f tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:41:02.420122 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG dbcounter [-] [124456] Writing DB stats nova_cell1:SELECT=95 {{(pid=124456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:41:02.557963 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-436608a5-75fd-4788-bcd5-7225db81ae6f tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a38b5af1654f44bc6cb5832c2e8e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051b6a3defca48d7b4f8bb6705f89f20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:41:02.570731 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-436608a5-75fd-4788-bcd5-7225db81ae6f tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] 10.222.0.121 "GET /compute/v2.1/servers/aca71cfb-26a8-4881-af52-7a1c370fee28" status: 200 len: 1371 microversion: 2.1 time: 0.167859 Aug 04 10:41:02.571512 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 378/768] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:41:02 2022] GET /compute/v2.1/servers/aca71cfb-26a8-4881-af52-7a1c370fee28 => generated 1371 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:41:03.591744 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-f16dc47d-d162-4920-9051-d91c9aaff152 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:41:03.592474 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-f16dc47d-d162-4920-9051-d91c9aaff152 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] [instance: aca71cfb-26a8-4881-af52-7a1c370fee28] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:41:03.599420 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-f16dc47d-d162-4920-9051-d91c9aaff152 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:41:03.600272 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-f16dc47d-d162-4920-9051-d91c9aaff152 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:41:03.601066 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-f16dc47d-d162-4920-9051-d91c9aaff152 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:41:03.601509 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-f16dc47d-d162-4920-9051-d91c9aaff152 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:41:03.803646 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-f16dc47d-d162-4920-9051-d91c9aaff152 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a38b5af1654f44bc6cb5832c2e8e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051b6a3defca48d7b4f8bb6705f89f20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:41:03.812407 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-f16dc47d-d162-4920-9051-d91c9aaff152 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] 10.222.0.121 "GET /compute/v2.1/servers/aca71cfb-26a8-4881-af52-7a1c370fee28" status: 200 len: 1371 microversion: 2.1 time: 0.224542 Aug 04 10:41:03.813528 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 391/769] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:41:03 2022] GET /compute/v2.1/servers/aca71cfb-26a8-4881-af52-7a1c370fee28 => generated 1371 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:41:04.834131 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-5acdb2b0-7e8a-44a2-b6ad-a233c385363a tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:41:04.834851 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-5acdb2b0-7e8a-44a2-b6ad-a233c385363a tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] [instance: aca71cfb-26a8-4881-af52-7a1c370fee28] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:41:04.842644 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-5acdb2b0-7e8a-44a2-b6ad-a233c385363a tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:41:04.843186 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-5acdb2b0-7e8a-44a2-b6ad-a233c385363a tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:41:04.844083 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-5acdb2b0-7e8a-44a2-b6ad-a233c385363a tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:41:04.844527 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-5acdb2b0-7e8a-44a2-b6ad-a233c385363a tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:41:05.030664 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-5acdb2b0-7e8a-44a2-b6ad-a233c385363a tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a38b5af1654f44bc6cb5832c2e8e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051b6a3defca48d7b4f8bb6705f89f20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:41:05.039353 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-5acdb2b0-7e8a-44a2-b6ad-a233c385363a tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] 10.222.0.121 "GET /compute/v2.1/servers/aca71cfb-26a8-4881-af52-7a1c370fee28" status: 200 len: 1371 microversion: 2.1 time: 0.209467 Aug 04 10:41:05.040079 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 379/770] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:41:04 2022] GET /compute/v2.1/servers/aca71cfb-26a8-4881-af52-7a1c370fee28 => generated 1371 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:41:06.070893 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [req-fef70fa9-f50d-4653-8a3b-a023768381db req-e073792f-822c-490c-aee7-f451d5491089 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aca71cfb-26a8-4881-af52-7a1c370fee28", "name": "network-vif-plugged", "status": "completed", "tag": "cacda5a6-f10e-4545-9afd-a4d6723e126b"}]} {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:41:06.073260 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-c7f37544-a70f-486a-8fdb-43620a9553e1 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:41:06.074943 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-c7f37544-a70f-486a-8fdb-43620a9553e1 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] [instance: aca71cfb-26a8-4881-af52-7a1c370fee28] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:41:06.080355 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG dbcounter [-] [124457] Writing DB stats nova_api:SELECT=62,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=124457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:41:06.081817 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [req-fef70fa9-f50d-4653-8a3b-a023768381db req-e073792f-822c-490c-aee7-f451d5491089 service nova] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:41:06.082752 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [req-fef70fa9-f50d-4653-8a3b-a023768381db req-e073792f-822c-490c-aee7-f451d5491089 service nova] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:41:06.092320 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-c7f37544-a70f-486a-8fdb-43620a9553e1 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:41:06.093043 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-c7f37544-a70f-486a-8fdb-43620a9553e1 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:41:06.094297 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-c7f37544-a70f-486a-8fdb-43620a9553e1 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:41:06.095476 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-c7f37544-a70f-486a-8fdb-43620a9553e1 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:41:06.095878 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.compute.server_external_events [req-fef70fa9-f50d-4653-8a3b-a023768381db req-e073792f-822c-490c-aee7-f451d5491089 service nova] Creating event network-vif-plugged:cacda5a6-f10e-4545-9afd-a4d6723e126b for instance aca71cfb-26a8-4881-af52-7a1c370fee28 on hv-cinder-85200 Aug 04 10:41:06.102967 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [req-fef70fa9-f50d-4653-8a3b-a023768381db req-e073792f-822c-490c-aee7-f451d5491089 service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035947 Aug 04 10:41:06.103635 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 380/771] 10.222.0.121 () {64 vars in 1322 bytes} [Thu Aug 4 10:41:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 10:41:06.272177 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-c7f37544-a70f-486a-8fdb-43620a9553e1 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a38b5af1654f44bc6cb5832c2e8e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051b6a3defca48d7b4f8bb6705f89f20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:41:06.283824 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-c7f37544-a70f-486a-8fdb-43620a9553e1 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] 10.222.0.121 "GET /compute/v2.1/servers/aca71cfb-26a8-4881-af52-7a1c370fee28" status: 200 len: 1371 microversion: 2.1 time: 0.223095 Aug 04 10:41:06.284638 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 392/772] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:41:06 2022] GET /compute/v2.1/servers/aca71cfb-26a8-4881-af52-7a1c370fee28 => generated 1371 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:41:07.302830 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG dbcounter [-] [124456] Writing DB stats nova_cell0:SELECT=6 {{(pid=124456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:41:07.307760 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-f71d733a-28dc-4d93-a5ca-9cbc59a45153 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:41:07.308517 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-f71d733a-28dc-4d93-a5ca-9cbc59a45153 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] [instance: aca71cfb-26a8-4881-af52-7a1c370fee28] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:41:07.315500 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-f71d733a-28dc-4d93-a5ca-9cbc59a45153 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:41:07.315976 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-f71d733a-28dc-4d93-a5ca-9cbc59a45153 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:41:07.316758 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-f71d733a-28dc-4d93-a5ca-9cbc59a45153 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:41:07.317200 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-f71d733a-28dc-4d93-a5ca-9cbc59a45153 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:41:07.469512 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-f71d733a-28dc-4d93-a5ca-9cbc59a45153 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a38b5af1654f44bc6cb5832c2e8e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051b6a3defca48d7b4f8bb6705f89f20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:41:07.481977 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-f71d733a-28dc-4d93-a5ca-9cbc59a45153 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] 10.222.0.121 "GET /compute/v2.1/servers/aca71cfb-26a8-4881-af52-7a1c370fee28" status: 200 len: 1371 microversion: 2.1 time: 0.179989 Aug 04 10:41:07.482916 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 381/773] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:41:07 2022] GET /compute/v2.1/servers/aca71cfb-26a8-4881-af52-7a1c370fee28 => generated 1371 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:41:08.505619 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-2edcf3ed-6002-42ad-a1a7-6f3e966fc1bb tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:41:08.506585 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-2edcf3ed-6002-42ad-a1a7-6f3e966fc1bb tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] [instance: aca71cfb-26a8-4881-af52-7a1c370fee28] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:41:08.509936 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG dbcounter [-] [124457] Writing DB stats nova_cell0:SELECT=2 {{(pid=124457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:41:08.511080 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG dbcounter [-] [124457] Writing DB stats nova_cell0:SELECT=6 {{(pid=124457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:41:08.516794 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-2edcf3ed-6002-42ad-a1a7-6f3e966fc1bb tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:41:08.517216 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-2edcf3ed-6002-42ad-a1a7-6f3e966fc1bb tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:41:08.518262 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-2edcf3ed-6002-42ad-a1a7-6f3e966fc1bb tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:41:08.518657 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-2edcf3ed-6002-42ad-a1a7-6f3e966fc1bb tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:41:08.665571 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-2edcf3ed-6002-42ad-a1a7-6f3e966fc1bb tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a38b5af1654f44bc6cb5832c2e8e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051b6a3defca48d7b4f8bb6705f89f20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:41:08.677360 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-2edcf3ed-6002-42ad-a1a7-6f3e966fc1bb tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] 10.222.0.121 "GET /compute/v2.1/servers/aca71cfb-26a8-4881-af52-7a1c370fee28" status: 200 len: 1371 microversion: 2.1 time: 0.175744 Aug 04 10:41:08.678146 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 393/774] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:41:08 2022] GET /compute/v2.1/servers/aca71cfb-26a8-4881-af52-7a1c370fee28 => generated 1371 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:41:09.705421 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-2b2dcc65-4158-4f43-a486-03a570a12745 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:41:09.706140 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-2b2dcc65-4158-4f43-a486-03a570a12745 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] [instance: aca71cfb-26a8-4881-af52-7a1c370fee28] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:41:09.715028 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-2b2dcc65-4158-4f43-a486-03a570a12745 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:41:09.715700 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-2b2dcc65-4158-4f43-a486-03a570a12745 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:41:09.716889 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-2b2dcc65-4158-4f43-a486-03a570a12745 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:41:09.717435 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-2b2dcc65-4158-4f43-a486-03a570a12745 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:41:09.871166 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-2b2dcc65-4158-4f43-a486-03a570a12745 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a38b5af1654f44bc6cb5832c2e8e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051b6a3defca48d7b4f8bb6705f89f20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:41:09.879352 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-2b2dcc65-4158-4f43-a486-03a570a12745 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] 10.222.0.121 "GET /compute/v2.1/servers/aca71cfb-26a8-4881-af52-7a1c370fee28" status: 200 len: 1561 microversion: 2.1 time: 0.180001 Aug 04 10:41:09.879998 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 382/775] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:41:09 2022] GET /compute/v2.1/servers/aca71cfb-26a8-4881-af52-7a1c370fee28 => generated 1561 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:41:09.900314 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-95721cee-a803-41cc-8fdd-57a00878fc6e tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:41:09.900965 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-95721cee-a803-41cc-8fdd-57a00878fc6e tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] [instance: aca71cfb-26a8-4881-af52-7a1c370fee28] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:41:09.908691 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-95721cee-a803-41cc-8fdd-57a00878fc6e tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:41:09.909149 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-95721cee-a803-41cc-8fdd-57a00878fc6e tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:41:09.909955 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-95721cee-a803-41cc-8fdd-57a00878fc6e tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:41:09.910397 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-95721cee-a803-41cc-8fdd-57a00878fc6e tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:41:10.000923 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-95721cee-a803-41cc-8fdd-57a00878fc6e tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] 10.222.0.121 "GET /compute/v2.1/servers/aca71cfb-26a8-4881-af52-7a1c370fee28/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.104261 Aug 04 10:41:10.001793 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 394/776] 10.222.0.121 () {58 vars in 1280 bytes} [Thu Aug 4 10:41:09 2022] GET /compute/v2.1/servers/aca71cfb-26a8-4881-af52-7a1c370fee28/os-interface => generated 285 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:41:11.035674 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [req-f5c79b1d-1e3c-4645-bd33-e955125a56df req-4d059af8-d2b5-42bd-b920-3c089830d0a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aca71cfb-26a8-4881-af52-7a1c370fee28", "tag": "cacda5a6-f10e-4545-9afd-a4d6723e126b"}]} {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:41:11.046327 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [req-f5c79b1d-1e3c-4645-bd33-e955125a56df req-4d059af8-d2b5-42bd-b920-3c089830d0a3 service nova] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:41:11.046794 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [req-f5c79b1d-1e3c-4645-bd33-e955125a56df req-4d059af8-d2b5-42bd-b920-3c089830d0a3 service nova] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:41:11.059304 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.compute.server_external_events [req-f5c79b1d-1e3c-4645-bd33-e955125a56df req-4d059af8-d2b5-42bd-b920-3c089830d0a3 service nova] Creating event network-changed:cacda5a6-f10e-4545-9afd-a4d6723e126b for instance aca71cfb-26a8-4881-af52-7a1c370fee28 on hv-cinder-85200 Aug 04 10:41:11.064911 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [req-f5c79b1d-1e3c-4645-bd33-e955125a56df req-4d059af8-d2b5-42bd-b920-3c089830d0a3 service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033132 Aug 04 10:41:11.065557 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 383/777] 10.222.0.121 () {64 vars in 1322 bytes} [Thu Aug 4 10:41:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:41:42.133940 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG dbcounter [-] [124457] Writing DB stats nova_api:SELECT=5 {{(pid=124457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:41:42.134735 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG dbcounter [-] [124457] Writing DB stats nova_cell1:SELECT=62,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:41:42.139260 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-d05a572d-d80c-4534-bfe5-d0968225d7ed tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:41:42.139809 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-d05a572d-d80c-4534-bfe5-d0968225d7ed tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] [instance: ec14be1f-7e78-45e3-a70a-587a47b2d1c9] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:41:42.148481 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-d05a572d-d80c-4534-bfe5-d0968225d7ed tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:41:42.148942 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-d05a572d-d80c-4534-bfe5-d0968225d7ed tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:41:42.149855 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-d05a572d-d80c-4534-bfe5-d0968225d7ed tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:41:42.150307 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-d05a572d-d80c-4534-bfe5-d0968225d7ed tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:41:42.178478 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.objects.instance [None req-d05a572d-d80c-4534-bfe5-d0968225d7ed tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lazy-loading 'flavor' on Instance uuid ec14be1f-7e78-45e3-a70a-587a47b2d1c9 {{(pid=124457) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 10:41:42.260273 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-d05a572d-d80c-4534-bfe5-d0968225d7ed tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] 10.222.0.121 "POST /compute/v2.1/servers/ec14be1f-7e78-45e3-a70a-587a47b2d1c9/action" status: 202 len: 0 microversion: 2.1 time: 0.127635 Aug 04 10:41:42.260889 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 395/778] 10.222.0.121 () {60 vars in 1283 bytes} [Thu Aug 4 10:41:42 2022] POST /compute/v2.1/servers/ec14be1f-7e78-45e3-a70a-587a47b2d1c9/action => generated 0 bytes in 129 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 10:41:42.271489 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-21cebb23-cf85-4aa2-ac78-94ebcee4e3cf tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:41:42.272250 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-21cebb23-cf85-4aa2-ac78-94ebcee4e3cf tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] [instance: ec14be1f-7e78-45e3-a70a-587a47b2d1c9] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:41:42.276134 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG dbcounter [-] [124456] Writing DB stats nova_api:SELECT=47,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=124456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:41:42.276816 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG dbcounter [-] [124456] Writing DB stats nova_cell1:SELECT=27 {{(pid=124456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:41:42.284406 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-21cebb23-cf85-4aa2-ac78-94ebcee4e3cf tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:41:42.285195 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-21cebb23-cf85-4aa2-ac78-94ebcee4e3cf tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:41:42.286071 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-21cebb23-cf85-4aa2-ac78-94ebcee4e3cf tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:41:42.286717 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-21cebb23-cf85-4aa2-ac78-94ebcee4e3cf tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:41:42.430101 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-21cebb23-cf85-4aa2-ac78-94ebcee4e3cf tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6921033062424e14bc30f9b94bf911db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bee0d982e3ba4f7dba65f51636856b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:41:42.438453 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-21cebb23-cf85-4aa2-ac78-94ebcee4e3cf tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] 10.222.0.121 "GET /compute/v2.1/servers/ec14be1f-7e78-45e3-a70a-587a47b2d1c9" status: 200 len: 1570 microversion: 2.1 time: 0.171673 Aug 04 10:41:42.439055 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 384/779] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:41:42 2022] GET /compute/v2.1/servers/ec14be1f-7e78-45e3-a70a-587a47b2d1c9 => generated 1570 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:41:43.461642 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-48e26857-3597-4ccb-aee2-3e09c3db8c34 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:41:43.462377 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-48e26857-3597-4ccb-aee2-3e09c3db8c34 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] [instance: ec14be1f-7e78-45e3-a70a-587a47b2d1c9] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:41:43.469373 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-48e26857-3597-4ccb-aee2-3e09c3db8c34 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:41:43.469837 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-48e26857-3597-4ccb-aee2-3e09c3db8c34 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:41:43.470703 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-48e26857-3597-4ccb-aee2-3e09c3db8c34 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:41:43.471146 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-48e26857-3597-4ccb-aee2-3e09c3db8c34 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:41:43.622436 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-48e26857-3597-4ccb-aee2-3e09c3db8c34 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6921033062424e14bc30f9b94bf911db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bee0d982e3ba4f7dba65f51636856b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:41:43.630818 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-48e26857-3597-4ccb-aee2-3e09c3db8c34 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] 10.222.0.121 "GET /compute/v2.1/servers/ec14be1f-7e78-45e3-a70a-587a47b2d1c9" status: 200 len: 1570 microversion: 2.1 time: 0.174274 Aug 04 10:41:43.631437 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 396/780] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:41:43 2022] GET /compute/v2.1/servers/ec14be1f-7e78-45e3-a70a-587a47b2d1c9 => generated 1570 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:41:44.653109 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-954236dd-e736-4210-87c6-edb9c70e6c3d tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:41:44.654045 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-954236dd-e736-4210-87c6-edb9c70e6c3d tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] [instance: ec14be1f-7e78-45e3-a70a-587a47b2d1c9] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:41:44.661271 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-954236dd-e736-4210-87c6-edb9c70e6c3d tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:41:44.661732 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-954236dd-e736-4210-87c6-edb9c70e6c3d tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:41:44.662532 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-954236dd-e736-4210-87c6-edb9c70e6c3d tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:41:44.662981 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-954236dd-e736-4210-87c6-edb9c70e6c3d tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:41:44.803904 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-954236dd-e736-4210-87c6-edb9c70e6c3d tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6921033062424e14bc30f9b94bf911db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bee0d982e3ba4f7dba65f51636856b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:41:44.811959 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-954236dd-e736-4210-87c6-edb9c70e6c3d tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] 10.222.0.121 "GET /compute/v2.1/servers/ec14be1f-7e78-45e3-a70a-587a47b2d1c9" status: 200 len: 1570 microversion: 2.1 time: 0.163123 Aug 04 10:41:44.812559 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 385/781] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:41:44 2022] GET /compute/v2.1/servers/ec14be1f-7e78-45e3-a70a-587a47b2d1c9 => generated 1570 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:41:45.833581 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-63e19e59-33b6-49ec-a7ae-69aa3d3a9e78 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:41:45.834319 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-63e19e59-33b6-49ec-a7ae-69aa3d3a9e78 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] [instance: ec14be1f-7e78-45e3-a70a-587a47b2d1c9] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:41:45.842023 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-63e19e59-33b6-49ec-a7ae-69aa3d3a9e78 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:41:45.842421 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-63e19e59-33b6-49ec-a7ae-69aa3d3a9e78 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:41:45.843223 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-63e19e59-33b6-49ec-a7ae-69aa3d3a9e78 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:41:45.843675 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-63e19e59-33b6-49ec-a7ae-69aa3d3a9e78 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:41:45.992549 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-63e19e59-33b6-49ec-a7ae-69aa3d3a9e78 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6921033062424e14bc30f9b94bf911db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bee0d982e3ba4f7dba65f51636856b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:41:46.002404 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-63e19e59-33b6-49ec-a7ae-69aa3d3a9e78 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] 10.222.0.121 "GET /compute/v2.1/servers/ec14be1f-7e78-45e3-a70a-587a47b2d1c9" status: 200 len: 1570 microversion: 2.1 time: 0.172930 Aug 04 10:41:46.003072 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 397/782] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:41:45 2022] GET /compute/v2.1/servers/ec14be1f-7e78-45e3-a70a-587a47b2d1c9 => generated 1570 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 10:41:47.027246 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-5a634a78-263c-4663-ba0d-d713eec8510f tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:41:47.027896 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-5a634a78-263c-4663-ba0d-d713eec8510f tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] [instance: ec14be1f-7e78-45e3-a70a-587a47b2d1c9] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:41:47.035016 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-5a634a78-263c-4663-ba0d-d713eec8510f tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:41:47.035476 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-5a634a78-263c-4663-ba0d-d713eec8510f tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:41:47.036297 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-5a634a78-263c-4663-ba0d-d713eec8510f tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:41:47.036741 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-5a634a78-263c-4663-ba0d-d713eec8510f tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:41:47.192386 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-5a634a78-263c-4663-ba0d-d713eec8510f tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6921033062424e14bc30f9b94bf911db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bee0d982e3ba4f7dba65f51636856b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:41:47.203146 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-5a634a78-263c-4663-ba0d-d713eec8510f tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] 10.222.0.121 "GET /compute/v2.1/servers/ec14be1f-7e78-45e3-a70a-587a47b2d1c9" status: 200 len: 1570 microversion: 2.1 time: 0.180308 Aug 04 10:41:47.203766 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 386/783] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:41:47 2022] GET /compute/v2.1/servers/ec14be1f-7e78-45e3-a70a-587a47b2d1c9 => generated 1570 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:41:48.225725 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-b945abec-5e3a-4626-9185-000eb4a901e7 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:41:48.226394 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-b945abec-5e3a-4626-9185-000eb4a901e7 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] [instance: ec14be1f-7e78-45e3-a70a-587a47b2d1c9] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:41:48.233606 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-b945abec-5e3a-4626-9185-000eb4a901e7 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:41:48.234061 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-b945abec-5e3a-4626-9185-000eb4a901e7 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:41:48.234852 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-b945abec-5e3a-4626-9185-000eb4a901e7 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:41:48.235351 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-b945abec-5e3a-4626-9185-000eb4a901e7 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:41:48.387814 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-b945abec-5e3a-4626-9185-000eb4a901e7 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6921033062424e14bc30f9b94bf911db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bee0d982e3ba4f7dba65f51636856b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:41:48.395967 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-b945abec-5e3a-4626-9185-000eb4a901e7 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] 10.222.0.121 "GET /compute/v2.1/servers/ec14be1f-7e78-45e3-a70a-587a47b2d1c9" status: 200 len: 1570 microversion: 2.1 time: 0.174763 Aug 04 10:41:48.396597 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 398/784] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:41:48 2022] GET /compute/v2.1/servers/ec14be1f-7e78-45e3-a70a-587a47b2d1c9 => generated 1570 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:41:49.418043 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-7ff9c9fa-3208-49de-adfb-8974027de1b5 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:41:49.418835 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-7ff9c9fa-3208-49de-adfb-8974027de1b5 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] [instance: ec14be1f-7e78-45e3-a70a-587a47b2d1c9] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:41:49.426263 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-7ff9c9fa-3208-49de-adfb-8974027de1b5 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:41:49.426690 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-7ff9c9fa-3208-49de-adfb-8974027de1b5 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:41:49.427531 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-7ff9c9fa-3208-49de-adfb-8974027de1b5 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:41:49.427919 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-7ff9c9fa-3208-49de-adfb-8974027de1b5 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:41:49.582040 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-7ff9c9fa-3208-49de-adfb-8974027de1b5 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6921033062424e14bc30f9b94bf911db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bee0d982e3ba4f7dba65f51636856b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:41:49.591613 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-7ff9c9fa-3208-49de-adfb-8974027de1b5 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] 10.222.0.121 "GET /compute/v2.1/servers/ec14be1f-7e78-45e3-a70a-587a47b2d1c9" status: 200 len: 1570 microversion: 2.1 time: 0.177625 Aug 04 10:41:49.592331 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 387/785] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:41:49 2022] GET /compute/v2.1/servers/ec14be1f-7e78-45e3-a70a-587a47b2d1c9 => generated 1570 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:41:50.616267 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-4612ef7e-f808-41b5-b820-df3533dc6247 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:41:50.617450 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-4612ef7e-f808-41b5-b820-df3533dc6247 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] [instance: ec14be1f-7e78-45e3-a70a-587a47b2d1c9] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:41:50.625731 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-4612ef7e-f808-41b5-b820-df3533dc6247 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:41:50.626251 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-4612ef7e-f808-41b5-b820-df3533dc6247 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:41:50.627148 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-4612ef7e-f808-41b5-b820-df3533dc6247 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:41:50.627629 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-4612ef7e-f808-41b5-b820-df3533dc6247 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:41:50.772263 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-4612ef7e-f808-41b5-b820-df3533dc6247 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6921033062424e14bc30f9b94bf911db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bee0d982e3ba4f7dba65f51636856b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:41:50.781148 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-4612ef7e-f808-41b5-b820-df3533dc6247 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] 10.222.0.121 "GET /compute/v2.1/servers/ec14be1f-7e78-45e3-a70a-587a47b2d1c9" status: 200 len: 1570 microversion: 2.1 time: 0.169556 Aug 04 10:41:50.781824 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 399/786] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:41:50 2022] GET /compute/v2.1/servers/ec14be1f-7e78-45e3-a70a-587a47b2d1c9 => generated 1570 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:41:51.578434 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-246a9d53-741a-4b4a-a631-29d2e488263a tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:41:51.581629 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-246a9d53-741a-4b4a-a631-29d2e488263a tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] [instance: a5fe2c05-1417-4bc2-855e-52c9d7457a49] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:41:51.590842 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-246a9d53-741a-4b4a-a631-29d2e488263a tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:41:51.591858 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-246a9d53-741a-4b4a-a631-29d2e488263a tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:41:51.592681 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-246a9d53-741a-4b4a-a631-29d2e488263a tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:41:51.593211 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-246a9d53-741a-4b4a-a631-29d2e488263a tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:41:51.691304 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.objects.instance [None req-246a9d53-741a-4b4a-a631-29d2e488263a tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lazy-loading 'services' on Instance uuid a5fe2c05-1417-4bc2-855e-52c9d7457a49 {{(pid=124456) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 10:41:51.808419 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-36671160-61a4-4c56-906b-d0026ca478a4 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:41:51.809068 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-36671160-61a4-4c56-906b-d0026ca478a4 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] [instance: ec14be1f-7e78-45e3-a70a-587a47b2d1c9] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:41:51.817071 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-36671160-61a4-4c56-906b-d0026ca478a4 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:41:51.817529 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-36671160-61a4-4c56-906b-d0026ca478a4 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:41:51.818519 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-36671160-61a4-4c56-906b-d0026ca478a4 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:41:51.819102 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-36671160-61a4-4c56-906b-d0026ca478a4 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:41:51.826636 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-246a9d53-741a-4b4a-a631-29d2e488263a tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] 10.222.0.121 "DELETE /compute/v2.1/servers/a5fe2c05-1417-4bc2-855e-52c9d7457a49/os-volume_attachments/7f8727a2-14a3-4554-8cd9-3a24eda1ba1d" status: 202 len: 0 microversion: 2.1 time: 0.250754 Aug 04 10:41:51.827748 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 388/787] 10.222.0.121 () {58 vars in 1421 bytes} [Thu Aug 4 10:41:51 2022] DELETE /compute/v2.1/servers/a5fe2c05-1417-4bc2-855e-52c9d7457a49/os-volume_attachments/7f8727a2-14a3-4554-8cd9-3a24eda1ba1d => generated 0 bytes in 254 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 10:41:51.837882 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-bb6ab76c-8208-47da-b10f-3b627a089892 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:41:51.839984 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-bb6ab76c-8208-47da-b10f-3b627a089892 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] [instance: a5fe2c05-1417-4bc2-855e-52c9d7457a49] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:41:51.846671 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-bb6ab76c-8208-47da-b10f-3b627a089892 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:41:51.847554 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-bb6ab76c-8208-47da-b10f-3b627a089892 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:41:51.848028 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-bb6ab76c-8208-47da-b10f-3b627a089892 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:41:51.848515 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-bb6ab76c-8208-47da-b10f-3b627a089892 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:41:51.888432 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-bb6ab76c-8208-47da-b10f-3b627a089892 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] 10.222.0.121 "GET /compute/v2.1/servers/a5fe2c05-1417-4bc2-855e-52c9d7457a49/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055788 Aug 04 10:41:51.889047 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 389/788] 10.222.0.121 () {58 vars in 1307 bytes} [Thu Aug 4 10:41:51 2022] GET /compute/v2.1/servers/a5fe2c05-1417-4bc2-855e-52c9d7457a49/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:41:52.048759 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-36671160-61a4-4c56-906b-d0026ca478a4 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6921033062424e14bc30f9b94bf911db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bee0d982e3ba4f7dba65f51636856b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:41:52.058556 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-36671160-61a4-4c56-906b-d0026ca478a4 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] 10.222.0.121 "GET /compute/v2.1/servers/ec14be1f-7e78-45e3-a70a-587a47b2d1c9" status: 200 len: 1570 microversion: 2.1 time: 0.256028 Aug 04 10:41:52.059262 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 400/789] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:41:51 2022] GET /compute/v2.1/servers/ec14be1f-7e78-45e3-a70a-587a47b2d1c9 => generated 1570 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:41:52.907521 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-b96ec241-215b-48f1-b376-78adc44d1167 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:41:52.910294 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-b96ec241-215b-48f1-b376-78adc44d1167 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] [instance: a5fe2c05-1417-4bc2-855e-52c9d7457a49] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:41:52.919401 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-b96ec241-215b-48f1-b376-78adc44d1167 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:41:52.920011 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-b96ec241-215b-48f1-b376-78adc44d1167 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:41:52.920994 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-b96ec241-215b-48f1-b376-78adc44d1167 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:41:52.921543 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-b96ec241-215b-48f1-b376-78adc44d1167 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:41:52.955838 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-b96ec241-215b-48f1-b376-78adc44d1167 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] 10.222.0.121 "GET /compute/v2.1/servers/a5fe2c05-1417-4bc2-855e-52c9d7457a49/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053398 Aug 04 10:41:52.956468 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 390/790] 10.222.0.121 () {58 vars in 1307 bytes} [Thu Aug 4 10:41:52 2022] GET /compute/v2.1/servers/a5fe2c05-1417-4bc2-855e-52c9d7457a49/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:41:53.080941 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-4dffbecc-6876-40ec-88d5-5865869049be tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:41:53.081552 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-4dffbecc-6876-40ec-88d5-5865869049be tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] [instance: ec14be1f-7e78-45e3-a70a-587a47b2d1c9] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:41:53.088922 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-4dffbecc-6876-40ec-88d5-5865869049be tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:41:53.089383 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-4dffbecc-6876-40ec-88d5-5865869049be tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:41:53.090168 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-4dffbecc-6876-40ec-88d5-5865869049be tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:41:53.090642 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-4dffbecc-6876-40ec-88d5-5865869049be tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:41:53.335047 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-4dffbecc-6876-40ec-88d5-5865869049be tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6921033062424e14bc30f9b94bf911db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bee0d982e3ba4f7dba65f51636856b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:41:53.345001 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-4dffbecc-6876-40ec-88d5-5865869049be tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] 10.222.0.121 "GET /compute/v2.1/servers/ec14be1f-7e78-45e3-a70a-587a47b2d1c9" status: 200 len: 1570 microversion: 2.1 time: 0.268105 Aug 04 10:41:53.345868 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 401/791] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:41:53 2022] GET /compute/v2.1/servers/ec14be1f-7e78-45e3-a70a-587a47b2d1c9 => generated 1570 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:41:53.969383 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-26e6b61e-6569-413e-a69b-bdb0cc777f8b tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:41:53.971706 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-26e6b61e-6569-413e-a69b-bdb0cc777f8b tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] [instance: a5fe2c05-1417-4bc2-855e-52c9d7457a49] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:41:53.979864 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-26e6b61e-6569-413e-a69b-bdb0cc777f8b tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:41:53.980368 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-26e6b61e-6569-413e-a69b-bdb0cc777f8b tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:41:53.981208 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-26e6b61e-6569-413e-a69b-bdb0cc777f8b tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:41:53.981704 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-26e6b61e-6569-413e-a69b-bdb0cc777f8b tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:41:54.018352 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-26e6b61e-6569-413e-a69b-bdb0cc777f8b tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] 10.222.0.121 "GET /compute/v2.1/servers/a5fe2c05-1417-4bc2-855e-52c9d7457a49/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053645 Aug 04 10:41:54.018956 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 391/792] 10.222.0.121 () {58 vars in 1307 bytes} [Thu Aug 4 10:41:53 2022] GET /compute/v2.1/servers/a5fe2c05-1417-4bc2-855e-52c9d7457a49/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 10:41:54.098502 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-2d5cb396-fd28-4109-895a-c264534213f8 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:41:54.099248 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-2d5cb396-fd28-4109-895a-c264534213f8 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] [instance: a5fe2c05-1417-4bc2-855e-52c9d7457a49] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:41:54.107006 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-2d5cb396-fd28-4109-895a-c264534213f8 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:41:54.107460 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-2d5cb396-fd28-4109-895a-c264534213f8 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:41:54.108285 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-2d5cb396-fd28-4109-895a-c264534213f8 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:41:54.108729 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-2d5cb396-fd28-4109-895a-c264534213f8 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:41:54.135591 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-2d5cb396-fd28-4109-895a-c264534213f8 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] [instance: a5fe2c05-1417-4bc2-855e-52c9d7457a49] Going to try to terminate instance {{(pid=124457) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 10:41:54.214439 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-2d5cb396-fd28-4109-895a-c264534213f8 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] 10.222.0.121 "DELETE /compute/v2.1/servers/a5fe2c05-1417-4bc2-855e-52c9d7457a49" status: 204 len: 0 microversion: 2.1 time: 0.119739 Aug 04 10:41:54.215129 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 402/793] 10.222.0.121 () {58 vars in 1244 bytes} [Thu Aug 4 10:41:54 2022] DELETE /compute/v2.1/servers/a5fe2c05-1417-4bc2-855e-52c9d7457a49 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 10:41:54.223891 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-f1a40dd7-99e3-4f41-9b58-adee09423a83 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:41:54.224826 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-f1a40dd7-99e3-4f41-9b58-adee09423a83 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] [instance: a5fe2c05-1417-4bc2-855e-52c9d7457a49] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:41:54.232309 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-f1a40dd7-99e3-4f41-9b58-adee09423a83 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:41:54.232770 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-f1a40dd7-99e3-4f41-9b58-adee09423a83 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:41:54.233602 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-f1a40dd7-99e3-4f41-9b58-adee09423a83 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:41:54.234044 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-f1a40dd7-99e3-4f41-9b58-adee09423a83 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:41:54.368825 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-ba5143bd-aaad-40e0-9419-9cbec4298172 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:41:54.369680 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-ba5143bd-aaad-40e0-9419-9cbec4298172 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] [instance: ec14be1f-7e78-45e3-a70a-587a47b2d1c9] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:41:54.377054 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-ba5143bd-aaad-40e0-9419-9cbec4298172 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:41:54.377745 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-ba5143bd-aaad-40e0-9419-9cbec4298172 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:41:54.378413 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-ba5143bd-aaad-40e0-9419-9cbec4298172 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:41:54.378917 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-ba5143bd-aaad-40e0-9419-9cbec4298172 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:41:54.391436 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-f1a40dd7-99e3-4f41-9b58-adee09423a83 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3170dc3323f54512bc8819c8efa86b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7121bd118a2549c39332cfdb7edaa92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:41:54.402839 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-f1a40dd7-99e3-4f41-9b58-adee09423a83 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] 10.222.0.121 "GET /compute/v2.1/servers/a5fe2c05-1417-4bc2-855e-52c9d7457a49" status: 200 len: 1694 microversion: 2.1 time: 0.182952 Aug 04 10:41:54.403442 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 392/794] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:41:54 2022] GET /compute/v2.1/servers/a5fe2c05-1417-4bc2-855e-52c9d7457a49 => generated 1694 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:41:54.417493 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-fcb74b31-76a0-4b69-a251-004745f701a2 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:41:54.420205 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-fcb74b31-76a0-4b69-a251-004745f701a2 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] [instance: 81259012-5f3b-44f6-b979-39119f14929b] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:41:54.427377 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-fcb74b31-76a0-4b69-a251-004745f701a2 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:41:54.427864 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-fcb74b31-76a0-4b69-a251-004745f701a2 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:41:54.428786 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-fcb74b31-76a0-4b69-a251-004745f701a2 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:41:54.429256 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-fcb74b31-76a0-4b69-a251-004745f701a2 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:41:54.460371 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-fcb74b31-76a0-4b69-a251-004745f701a2 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] 10.222.0.121 "GET /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047166 Aug 04 10:41:54.461072 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 393/795] 10.222.0.121 () {58 vars in 1307 bytes} [Thu Aug 4 10:41:54 2022] GET /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 04 10:41:54.529254 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-ba5143bd-aaad-40e0-9419-9cbec4298172 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6921033062424e14bc30f9b94bf911db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bee0d982e3ba4f7dba65f51636856b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:41:54.529965 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-25b34304-d39d-4d01-9bfb-57e22b039ccf tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:41:54.530555 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-25b34304-d39d-4d01-9bfb-57e22b039ccf tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] [instance: 81259012-5f3b-44f6-b979-39119f14929b] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:41:54.538150 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-25b34304-d39d-4d01-9bfb-57e22b039ccf tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:41:54.538603 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-ba5143bd-aaad-40e0-9419-9cbec4298172 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] 10.222.0.121 "GET /compute/v2.1/servers/ec14be1f-7e78-45e3-a70a-587a47b2d1c9" status: 200 len: 1570 microversion: 2.1 time: 0.174773 Aug 04 10:41:54.538729 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-25b34304-d39d-4d01-9bfb-57e22b039ccf tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:41:54.539018 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 403/796] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:41:54 2022] GET /compute/v2.1/servers/ec14be1f-7e78-45e3-a70a-587a47b2d1c9 => generated 1570 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 10:41:54.539726 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-25b34304-d39d-4d01-9bfb-57e22b039ccf tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:41:54.540356 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-25b34304-d39d-4d01-9bfb-57e22b039ccf tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:41:54.570624 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-25b34304-d39d-4d01-9bfb-57e22b039ccf tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] [instance: 81259012-5f3b-44f6-b979-39119f14929b] Going to try to terminate instance {{(pid=124456) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 10:41:54.661752 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-25b34304-d39d-4d01-9bfb-57e22b039ccf tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] 10.222.0.121 "DELETE /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b" status: 204 len: 0 microversion: 2.1 time: 0.137107 Aug 04 10:41:54.662447 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 394/797] 10.222.0.121 () {58 vars in 1244 bytes} [Thu Aug 4 10:41:54 2022] DELETE /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 04 10:41:54.672034 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-0739870c-3287-43a2-be42-f8e80be0e17f tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:41:54.672717 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-0739870c-3287-43a2-be42-f8e80be0e17f tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] [instance: 81259012-5f3b-44f6-b979-39119f14929b] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:41:54.679665 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-0739870c-3287-43a2-be42-f8e80be0e17f tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:41:54.680199 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-0739870c-3287-43a2-be42-f8e80be0e17f tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:41:54.681265 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-0739870c-3287-43a2-be42-f8e80be0e17f tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:41:54.681720 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-0739870c-3287-43a2-be42-f8e80be0e17f tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:41:54.838254 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-0739870c-3287-43a2-be42-f8e80be0e17f tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa2e2a5a6ed4c5c9db91269266dd30b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f46ab11dd0b428486c673afc14b5b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:41:54.846643 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-0739870c-3287-43a2-be42-f8e80be0e17f tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] 10.222.0.121 "GET /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b" status: 200 len: 1674 microversion: 2.1 time: 0.178918 Aug 04 10:41:54.847355 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 404/798] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:41:54 2022] GET /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b => generated 1674 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:41:55.427685 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-b457078d-4b3e-4e4e-9c8b-1ef2228a85b4 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:41:55.428538 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-b457078d-4b3e-4e4e-9c8b-1ef2228a85b4 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] [instance: a5fe2c05-1417-4bc2-855e-52c9d7457a49] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:41:55.436333 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-b457078d-4b3e-4e4e-9c8b-1ef2228a85b4 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:41:55.436911 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-b457078d-4b3e-4e4e-9c8b-1ef2228a85b4 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:41:55.437694 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-b457078d-4b3e-4e4e-9c8b-1ef2228a85b4 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:41:55.438199 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-b457078d-4b3e-4e4e-9c8b-1ef2228a85b4 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:41:55.562174 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-1aa80282-499c-4d8a-9222-ef2532916361 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:41:55.562839 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-1aa80282-499c-4d8a-9222-ef2532916361 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] [instance: ec14be1f-7e78-45e3-a70a-587a47b2d1c9] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:41:55.569662 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-1aa80282-499c-4d8a-9222-ef2532916361 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:41:55.570113 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-1aa80282-499c-4d8a-9222-ef2532916361 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:41:55.571059 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-1aa80282-499c-4d8a-9222-ef2532916361 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:41:55.571464 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-1aa80282-499c-4d8a-9222-ef2532916361 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:41:55.586714 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-b457078d-4b3e-4e4e-9c8b-1ef2228a85b4 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3170dc3323f54512bc8819c8efa86b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7121bd118a2549c39332cfdb7edaa92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:41:55.595309 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-b457078d-4b3e-4e4e-9c8b-1ef2228a85b4 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] 10.222.0.121 "GET /compute/v2.1/servers/a5fe2c05-1417-4bc2-855e-52c9d7457a49" status: 200 len: 1694 microversion: 2.1 time: 0.173975 Aug 04 10:41:55.595971 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 395/799] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:41:55 2022] GET /compute/v2.1/servers/a5fe2c05-1417-4bc2-855e-52c9d7457a49 => generated 1694 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:41:55.714425 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-1aa80282-499c-4d8a-9222-ef2532916361 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6921033062424e14bc30f9b94bf911db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bee0d982e3ba4f7dba65f51636856b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:41:55.723482 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-1aa80282-499c-4d8a-9222-ef2532916361 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] 10.222.0.121 "GET /compute/v2.1/servers/ec14be1f-7e78-45e3-a70a-587a47b2d1c9" status: 200 len: 1570 microversion: 2.1 time: 0.165475 Aug 04 10:41:55.724182 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 405/800] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:41:55 2022] GET /compute/v2.1/servers/ec14be1f-7e78-45e3-a70a-587a47b2d1c9 => generated 1570 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:41:55.870157 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-4c8c65a1-cb8a-4711-9b6c-de092b5f0223 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:41:55.870845 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-4c8c65a1-cb8a-4711-9b6c-de092b5f0223 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] [instance: 81259012-5f3b-44f6-b979-39119f14929b] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:41:55.878488 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-4c8c65a1-cb8a-4711-9b6c-de092b5f0223 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:41:55.879004 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-4c8c65a1-cb8a-4711-9b6c-de092b5f0223 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:41:55.879827 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-4c8c65a1-cb8a-4711-9b6c-de092b5f0223 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:41:55.880398 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-4c8c65a1-cb8a-4711-9b6c-de092b5f0223 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:41:56.032118 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-4c8c65a1-cb8a-4711-9b6c-de092b5f0223 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa2e2a5a6ed4c5c9db91269266dd30b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f46ab11dd0b428486c673afc14b5b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:41:56.040200 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-4c8c65a1-cb8a-4711-9b6c-de092b5f0223 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] 10.222.0.121 "GET /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b" status: 200 len: 1674 microversion: 2.1 time: 0.174806 Aug 04 10:41:56.040794 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 396/801] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:41:55 2022] GET /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b => generated 1674 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:41:56.617495 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-596ab08d-acfd-4aa8-b894-478938b48b11 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:41:56.618286 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-596ab08d-acfd-4aa8-b894-478938b48b11 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] [instance: a5fe2c05-1417-4bc2-855e-52c9d7457a49] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:41:56.625634 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-596ab08d-acfd-4aa8-b894-478938b48b11 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:41:56.626099 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-596ab08d-acfd-4aa8-b894-478938b48b11 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:41:56.626886 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-596ab08d-acfd-4aa8-b894-478938b48b11 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:41:56.627330 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-596ab08d-acfd-4aa8-b894-478938b48b11 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:41:56.746333 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-5e665817-3658-4764-bf0c-e3f99dcb74e0 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:41:56.747005 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-5e665817-3658-4764-bf0c-e3f99dcb74e0 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] [instance: ec14be1f-7e78-45e3-a70a-587a47b2d1c9] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:41:56.753818 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-5e665817-3658-4764-bf0c-e3f99dcb74e0 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:41:56.754270 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-5e665817-3658-4764-bf0c-e3f99dcb74e0 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:41:56.755057 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-5e665817-3658-4764-bf0c-e3f99dcb74e0 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:41:56.755501 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-5e665817-3658-4764-bf0c-e3f99dcb74e0 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:41:56.783248 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-596ab08d-acfd-4aa8-b894-478938b48b11 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3170dc3323f54512bc8819c8efa86b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7121bd118a2549c39332cfdb7edaa92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:41:56.792694 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-596ab08d-acfd-4aa8-b894-478938b48b11 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] 10.222.0.121 "GET /compute/v2.1/servers/a5fe2c05-1417-4bc2-855e-52c9d7457a49" status: 200 len: 1694 microversion: 2.1 time: 0.179232 Aug 04 10:41:56.793453 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 406/802] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:41:56 2022] GET /compute/v2.1/servers/a5fe2c05-1417-4bc2-855e-52c9d7457a49 => generated 1694 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:41:56.904425 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-5e665817-3658-4764-bf0c-e3f99dcb74e0 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6921033062424e14bc30f9b94bf911db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bee0d982e3ba4f7dba65f51636856b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:41:56.913328 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-5e665817-3658-4764-bf0c-e3f99dcb74e0 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] 10.222.0.121 "GET /compute/v2.1/servers/ec14be1f-7e78-45e3-a70a-587a47b2d1c9" status: 200 len: 1570 microversion: 2.1 time: 0.171044 Aug 04 10:41:56.913968 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 397/803] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:41:56 2022] GET /compute/v2.1/servers/ec14be1f-7e78-45e3-a70a-587a47b2d1c9 => generated 1570 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 10:41:57.063501 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-9eab3829-0f15-4655-a607-9d043ce3d67a tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:41:57.064335 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-9eab3829-0f15-4655-a607-9d043ce3d67a tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] [instance: 81259012-5f3b-44f6-b979-39119f14929b] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:41:57.071364 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-9eab3829-0f15-4655-a607-9d043ce3d67a tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:41:57.071853 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-9eab3829-0f15-4655-a607-9d043ce3d67a tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:41:57.072688 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-9eab3829-0f15-4655-a607-9d043ce3d67a tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:41:57.073143 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-9eab3829-0f15-4655-a607-9d043ce3d67a tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:41:57.213414 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-9eab3829-0f15-4655-a607-9d043ce3d67a tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa2e2a5a6ed4c5c9db91269266dd30b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f46ab11dd0b428486c673afc14b5b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:41:57.217149 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG dbcounter [-] [124457] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:41:57.222224 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-9eab3829-0f15-4655-a607-9d043ce3d67a tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] 10.222.0.121 "GET /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b" status: 200 len: 1674 microversion: 2.1 time: 0.162781 Aug 04 10:41:57.222833 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 407/804] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:41:57 2022] GET /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b => generated 1674 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:41:57.816758 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-08a5a589-45ab-418f-9249-4de108dc6ae0 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:41:57.818020 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-08a5a589-45ab-418f-9249-4de108dc6ae0 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] [instance: a5fe2c05-1417-4bc2-855e-52c9d7457a49] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:41:57.826844 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-08a5a589-45ab-418f-9249-4de108dc6ae0 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:41:57.827317 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-08a5a589-45ab-418f-9249-4de108dc6ae0 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:41:57.828196 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-08a5a589-45ab-418f-9249-4de108dc6ae0 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:41:57.828643 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-08a5a589-45ab-418f-9249-4de108dc6ae0 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:41:57.833206 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG dbcounter [-] [124456] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:41:57.940974 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-55df6d63-89eb-4ff1-b457-02a575541b87 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:41:57.943117 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-55df6d63-89eb-4ff1-b457-02a575541b87 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] [instance: ec14be1f-7e78-45e3-a70a-587a47b2d1c9] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:41:57.959473 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-55df6d63-89eb-4ff1-b457-02a575541b87 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:41:57.960109 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-55df6d63-89eb-4ff1-b457-02a575541b87 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:41:57.961128 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-55df6d63-89eb-4ff1-b457-02a575541b87 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:41:57.961765 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-55df6d63-89eb-4ff1-b457-02a575541b87 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:41:58.019082 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-08a5a589-45ab-418f-9249-4de108dc6ae0 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3170dc3323f54512bc8819c8efa86b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7121bd118a2549c39332cfdb7edaa92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:41:58.029320 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-08a5a589-45ab-418f-9249-4de108dc6ae0 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] 10.222.0.121 "GET /compute/v2.1/servers/a5fe2c05-1417-4bc2-855e-52c9d7457a49" status: 200 len: 1694 microversion: 2.1 time: 0.218010 Aug 04 10:41:58.030287 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 398/805] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:41:57 2022] GET /compute/v2.1/servers/a5fe2c05-1417-4bc2-855e-52c9d7457a49 => generated 1694 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:41:58.112313 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-55df6d63-89eb-4ff1-b457-02a575541b87 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6921033062424e14bc30f9b94bf911db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bee0d982e3ba4f7dba65f51636856b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:41:58.120825 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-55df6d63-89eb-4ff1-b457-02a575541b87 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] 10.222.0.121 "GET /compute/v2.1/servers/ec14be1f-7e78-45e3-a70a-587a47b2d1c9" status: 200 len: 1570 microversion: 2.1 time: 0.186189 Aug 04 10:41:58.121409 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 408/806] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:41:57 2022] GET /compute/v2.1/servers/ec14be1f-7e78-45e3-a70a-587a47b2d1c9 => generated 1570 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 10:41:58.245741 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-35cba715-0cc5-4e76-983d-f2f4cb93a4aa tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:41:58.246355 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-35cba715-0cc5-4e76-983d-f2f4cb93a4aa tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] [instance: 81259012-5f3b-44f6-b979-39119f14929b] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:41:58.253848 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-35cba715-0cc5-4e76-983d-f2f4cb93a4aa tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:41:58.254305 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-35cba715-0cc5-4e76-983d-f2f4cb93a4aa tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:41:58.255110 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-35cba715-0cc5-4e76-983d-f2f4cb93a4aa tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:41:58.255551 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-35cba715-0cc5-4e76-983d-f2f4cb93a4aa tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:41:58.350901 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [req-eecc79da-6967-43a4-a6cf-4ce18c5eedea req-eea280c9-6ad2-42dc-aea6-476ff9c07f35 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec14be1f-7e78-45e3-a70a-587a47b2d1c9", "name": "network-vif-unplugged", "status": "completed", "tag": "c3025d1c-cab8-4711-9bcc-0663813275c3"}]} {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:41:58.369027 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [req-eecc79da-6967-43a4-a6cf-4ce18c5eedea req-eea280c9-6ad2-42dc-aea6-476ff9c07f35 service nova] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:41:58.369823 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [req-eecc79da-6967-43a4-a6cf-4ce18c5eedea req-eea280c9-6ad2-42dc-aea6-476ff9c07f35 service nova] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:41:58.392611 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.compute.server_external_events [req-eecc79da-6967-43a4-a6cf-4ce18c5eedea req-eea280c9-6ad2-42dc-aea6-476ff9c07f35 service nova] Creating event network-vif-unplugged:c3025d1c-cab8-4711-9bcc-0663813275c3 for instance ec14be1f-7e78-45e3-a70a-587a47b2d1c9 on hv-cinder-85200 Aug 04 10:41:58.406825 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [req-eecc79da-6967-43a4-a6cf-4ce18c5eedea req-eea280c9-6ad2-42dc-aea6-476ff9c07f35 service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.063054 Aug 04 10:41:58.408312 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 409/807] 10.222.0.121 () {64 vars in 1322 bytes} [Thu Aug 4 10:41:58 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:41:58.459813 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-35cba715-0cc5-4e76-983d-f2f4cb93a4aa tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa2e2a5a6ed4c5c9db91269266dd30b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f46ab11dd0b428486c673afc14b5b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:41:58.468470 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-35cba715-0cc5-4e76-983d-f2f4cb93a4aa tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] 10.222.0.121 "GET /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b" status: 200 len: 1674 microversion: 2.1 time: 0.227382 Aug 04 10:41:58.469116 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 399/808] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:41:58 2022] GET /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b => generated 1674 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:41:59.058651 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-08469278-26c9-4a8e-8a6b-2409e02405b6 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:41:59.059494 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-08469278-26c9-4a8e-8a6b-2409e02405b6 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] [instance: a5fe2c05-1417-4bc2-855e-52c9d7457a49] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:41:59.068509 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-08469278-26c9-4a8e-8a6b-2409e02405b6 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:41:59.069140 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-08469278-26c9-4a8e-8a6b-2409e02405b6 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:41:59.070196 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-08469278-26c9-4a8e-8a6b-2409e02405b6 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:41:59.070776 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-08469278-26c9-4a8e-8a6b-2409e02405b6 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:41:59.143667 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-c46953ef-8d0a-4b7d-8493-fa38e3e98f03 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:41:59.144437 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-c46953ef-8d0a-4b7d-8493-fa38e3e98f03 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] [instance: ec14be1f-7e78-45e3-a70a-587a47b2d1c9] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:41:59.152238 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-c46953ef-8d0a-4b7d-8493-fa38e3e98f03 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:41:59.152920 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-c46953ef-8d0a-4b7d-8493-fa38e3e98f03 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:41:59.153887 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-c46953ef-8d0a-4b7d-8493-fa38e3e98f03 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:41:59.154440 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-c46953ef-8d0a-4b7d-8493-fa38e3e98f03 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:41:59.676612 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-08469278-26c9-4a8e-8a6b-2409e02405b6 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3170dc3323f54512bc8819c8efa86b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7121bd118a2549c39332cfdb7edaa92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:41:59.691197 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-08469278-26c9-4a8e-8a6b-2409e02405b6 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] 10.222.0.121 "GET /compute/v2.1/servers/a5fe2c05-1417-4bc2-855e-52c9d7457a49" status: 200 len: 1694 microversion: 2.1 time: 0.642749 Aug 04 10:41:59.692417 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 410/809] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:41:59 2022] GET /compute/v2.1/servers/a5fe2c05-1417-4bc2-855e-52c9d7457a49 => generated 1694 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:41:59.700998 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-3c7d52b1-4ac5-4237-9b1b-e9490e104d9c tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:41:59.702435 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-3c7d52b1-4ac5-4237-9b1b-e9490e104d9c tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] [instance: 81259012-5f3b-44f6-b979-39119f14929b] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:41:59.714800 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-c46953ef-8d0a-4b7d-8493-fa38e3e98f03 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6921033062424e14bc30f9b94bf911db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bee0d982e3ba4f7dba65f51636856b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:41:59.716809 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-3c7d52b1-4ac5-4237-9b1b-e9490e104d9c tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:41:59.717570 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-3c7d52b1-4ac5-4237-9b1b-e9490e104d9c tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:41:59.719553 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-3c7d52b1-4ac5-4237-9b1b-e9490e104d9c tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:41:59.720571 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-3c7d52b1-4ac5-4237-9b1b-e9490e104d9c tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:41:59.730705 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-c46953ef-8d0a-4b7d-8493-fa38e3e98f03 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] 10.222.0.121 "GET /compute/v2.1/servers/ec14be1f-7e78-45e3-a70a-587a47b2d1c9" status: 200 len: 1570 microversion: 2.1 time: 0.590868 Aug 04 10:41:59.731792 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 400/810] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:41:59 2022] GET /compute/v2.1/servers/ec14be1f-7e78-45e3-a70a-587a47b2d1c9 => generated 1570 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:42:00.334803 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-3c7d52b1-4ac5-4237-9b1b-e9490e104d9c tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa2e2a5a6ed4c5c9db91269266dd30b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f46ab11dd0b428486c673afc14b5b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:42:00.344988 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-3c7d52b1-4ac5-4237-9b1b-e9490e104d9c tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] 10.222.0.121 "GET /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b" status: 200 len: 1674 microversion: 2.1 time: 0.651044 Aug 04 10:42:00.346125 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 411/811] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:41:59 2022] GET /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b => generated 1674 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:42:00.728905 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-b572ba3a-5c03-4854-9499-76d6edd12fa3 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:42:00.729691 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-b572ba3a-5c03-4854-9499-76d6edd12fa3 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] [instance: a5fe2c05-1417-4bc2-855e-52c9d7457a49] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:42:00.737409 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-b572ba3a-5c03-4854-9499-76d6edd12fa3 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:42:00.738304 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-b572ba3a-5c03-4854-9499-76d6edd12fa3 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:42:00.739148 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-b572ba3a-5c03-4854-9499-76d6edd12fa3 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:42:00.739682 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-b572ba3a-5c03-4854-9499-76d6edd12fa3 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:42:00.771861 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-7cfdb6d5-ed66-48d5-aa71-f2e13067d764 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:42:00.773687 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-7cfdb6d5-ed66-48d5-aa71-f2e13067d764 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] [instance: ec14be1f-7e78-45e3-a70a-587a47b2d1c9] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:42:00.782900 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-7cfdb6d5-ed66-48d5-aa71-f2e13067d764 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:42:00.783355 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-7cfdb6d5-ed66-48d5-aa71-f2e13067d764 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:42:00.784212 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-7cfdb6d5-ed66-48d5-aa71-f2e13067d764 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:42:00.784659 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-7cfdb6d5-ed66-48d5-aa71-f2e13067d764 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:42:00.868633 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-b572ba3a-5c03-4854-9499-76d6edd12fa3 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3170dc3323f54512bc8819c8efa86b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7121bd118a2549c39332cfdb7edaa92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:42:00.881719 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-b572ba3a-5c03-4854-9499-76d6edd12fa3 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] 10.222.0.121 "GET /compute/v2.1/servers/a5fe2c05-1417-4bc2-855e-52c9d7457a49" status: 200 len: 1626 microversion: 2.1 time: 0.158140 Aug 04 10:42:00.882457 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 401/812] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:42:00 2022] GET /compute/v2.1/servers/a5fe2c05-1417-4bc2-855e-52c9d7457a49 => generated 1626 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:42:01.116681 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [req-04140354-8676-4890-a40e-a259ac76104c req-b6f026d8-afc1-41ad-918e-6c83bd8aff51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81259012-5f3b-44f6-b979-39119f14929b", "name": "network-vif-deleted", "tag": "79122914-2885-4d97-bea8-a589e38d68d8"}]} {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:42:01.144189 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [req-04140354-8676-4890-a40e-a259ac76104c req-b6f026d8-afc1-41ad-918e-6c83bd8aff51 service nova] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:42:01.145251 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [req-04140354-8676-4890-a40e-a259ac76104c req-b6f026d8-afc1-41ad-918e-6c83bd8aff51 service nova] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:42:01.159060 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.compute.server_external_events [req-04140354-8676-4890-a40e-a259ac76104c req-b6f026d8-afc1-41ad-918e-6c83bd8aff51 service nova] Creating event network-vif-deleted:79122914-2885-4d97-bea8-a589e38d68d8 for instance 81259012-5f3b-44f6-b979-39119f14929b on hv-cinder-85200 Aug 04 10:42:01.161174 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-7cfdb6d5-ed66-48d5-aa71-f2e13067d764 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6921033062424e14bc30f9b94bf911db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bee0d982e3ba4f7dba65f51636856b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:42:01.168516 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [req-04140354-8676-4890-a40e-a259ac76104c req-b6f026d8-afc1-41ad-918e-6c83bd8aff51 service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055458 Aug 04 10:42:01.169567 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 402/813] 10.222.0.121 () {64 vars in 1322 bytes} [Thu Aug 4 10:42:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 10:42:01.189386 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-7cfdb6d5-ed66-48d5-aa71-f2e13067d764 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] 10.222.0.121 "GET /compute/v2.1/servers/ec14be1f-7e78-45e3-a70a-587a47b2d1c9" status: 200 len: 1511 microversion: 2.1 time: 0.422813 Aug 04 10:42:01.192523 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 412/814] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:42:00 2022] GET /compute/v2.1/servers/ec14be1f-7e78-45e3-a70a-587a47b2d1c9 => generated 1511 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 10:42:01.215431 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-74281921-5127-4c3e-8427-9107d87545d6 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:42:01.215755 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-74281921-5127-4c3e-8427-9107d87545d6 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] [instance: ec14be1f-7e78-45e3-a70a-587a47b2d1c9] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:42:01.223599 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-74281921-5127-4c3e-8427-9107d87545d6 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:42:01.224151 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-74281921-5127-4c3e-8427-9107d87545d6 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:42:01.225637 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-74281921-5127-4c3e-8427-9107d87545d6 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:42:01.226181 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-74281921-5127-4c3e-8427-9107d87545d6 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:42:01.379555 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-e21045f1-3a5a-4433-b155-6666f71f14ae tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:42:01.380426 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-e21045f1-3a5a-4433-b155-6666f71f14ae tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] [instance: 81259012-5f3b-44f6-b979-39119f14929b] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:42:01.389017 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-e21045f1-3a5a-4433-b155-6666f71f14ae tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:42:01.390231 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-e21045f1-3a5a-4433-b155-6666f71f14ae tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:42:01.391551 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-e21045f1-3a5a-4433-b155-6666f71f14ae tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:42:01.392299 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-e21045f1-3a5a-4433-b155-6666f71f14ae tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:42:01.450289 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-e21045f1-3a5a-4433-b155-6666f71f14ae tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:42:01.451199 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-e21045f1-3a5a-4433-b155-6666f71f14ae tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:42:01.452219 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.objects.instance [None req-e21045f1-3a5a-4433-b155-6666f71f14ae tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lazy-loading 'fault' on Instance uuid 81259012-5f3b-44f6-b979-39119f14929b {{(pid=124457) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 10:42:01.541317 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-e21045f1-3a5a-4433-b155-6666f71f14ae tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa2e2a5a6ed4c5c9db91269266dd30b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f46ab11dd0b428486c673afc14b5b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:42:01.549956 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-e21045f1-3a5a-4433-b155-6666f71f14ae tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] 10.222.0.121 "GET /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b" status: 200 len: 1331 microversion: 2.1 time: 0.175364 Aug 04 10:42:01.553538 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-74281921-5127-4c3e-8427-9107d87545d6 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] [instance: ec14be1f-7e78-45e3-a70a-587a47b2d1c9] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=124456) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 04 10:42:01.569195 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 413/815] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:42:01 2022] GET /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b => generated 1331 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:42:01.665892 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-74281921-5127-4c3e-8427-9107d87545d6 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] 10.222.0.121 "POST /compute/v2.1/servers/ec14be1f-7e78-45e3-a70a-587a47b2d1c9/action" status: 202 len: 0 microversion: 2.1 time: 0.455499 Aug 04 10:42:01.667308 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 403/816] 10.222.0.121 () {60 vars in 1283 bytes} [Thu Aug 4 10:42:01 2022] POST /compute/v2.1/servers/ec14be1f-7e78-45e3-a70a-587a47b2d1c9/action => generated 0 bytes in 459 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 10:42:01.680616 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-1a8e6d25-d007-4e8c-b2d0-18bff6cf381a tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:42:01.682132 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-1a8e6d25-d007-4e8c-b2d0-18bff6cf381a tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] [instance: ec14be1f-7e78-45e3-a70a-587a47b2d1c9] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:42:01.691971 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-1a8e6d25-d007-4e8c-b2d0-18bff6cf381a tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:42:01.692482 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-1a8e6d25-d007-4e8c-b2d0-18bff6cf381a tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:42:01.693575 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-1a8e6d25-d007-4e8c-b2d0-18bff6cf381a tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:42:01.694246 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-1a8e6d25-d007-4e8c-b2d0-18bff6cf381a tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:42:01.899032 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-1a8e6d25-d007-4e8c-b2d0-18bff6cf381a tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6921033062424e14bc30f9b94bf911db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bee0d982e3ba4f7dba65f51636856b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:42:01.910784 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-1a8e6d25-d007-4e8c-b2d0-18bff6cf381a tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] 10.222.0.121 "GET /compute/v2.1/servers/ec14be1f-7e78-45e3-a70a-587a47b2d1c9" status: 200 len: 1519 microversion: 2.1 time: 0.236902 Aug 04 10:42:01.912909 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 414/817] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:42:01 2022] GET /compute/v2.1/servers/ec14be1f-7e78-45e3-a70a-587a47b2d1c9 => generated 1519 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:42:01.916236 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-383eea0e-c77d-4ecd-a22a-3112f48ef403 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:42:01.917175 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-383eea0e-c77d-4ecd-a22a-3112f48ef403 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] [instance: a5fe2c05-1417-4bc2-855e-52c9d7457a49] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:42:01.929934 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-383eea0e-c77d-4ecd-a22a-3112f48ef403 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:42:01.930323 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-383eea0e-c77d-4ecd-a22a-3112f48ef403 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:42:01.930973 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-383eea0e-c77d-4ecd-a22a-3112f48ef403 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:42:01.931414 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-383eea0e-c77d-4ecd-a22a-3112f48ef403 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:42:01.971386 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-383eea0e-c77d-4ecd-a22a-3112f48ef403 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:42:01.972189 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-383eea0e-c77d-4ecd-a22a-3112f48ef403 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:42:01.972953 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.objects.instance [None req-383eea0e-c77d-4ecd-a22a-3112f48ef403 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lazy-loading 'fault' on Instance uuid a5fe2c05-1417-4bc2-855e-52c9d7457a49 {{(pid=124456) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 10:42:02.053199 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-383eea0e-c77d-4ecd-a22a-3112f48ef403 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3170dc3323f54512bc8819c8efa86b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7121bd118a2549c39332cfdb7edaa92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:42:02.068286 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-383eea0e-c77d-4ecd-a22a-3112f48ef403 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] 10.222.0.121 "GET /compute/v2.1/servers/a5fe2c05-1417-4bc2-855e-52c9d7457a49" status: 200 len: 1339 microversion: 2.1 time: 0.155304 Aug 04 10:42:02.082403 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 404/818] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:42:01 2022] GET /compute/v2.1/servers/a5fe2c05-1417-4bc2-855e-52c9d7457a49 => generated 1339 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:42:02.580774 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-79f5800c-c429-4d5b-806a-24583b165552 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:42:02.581518 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-79f5800c-c429-4d5b-806a-24583b165552 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] [instance: 81259012-5f3b-44f6-b979-39119f14929b] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:42:02.605513 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-79f5800c-c429-4d5b-806a-24583b165552 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:42:02.606021 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-79f5800c-c429-4d5b-806a-24583b165552 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:42:02.607031 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-79f5800c-c429-4d5b-806a-24583b165552 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:42:02.607474 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-79f5800c-c429-4d5b-806a-24583b165552 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:42:02.624789 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.wsgi [None req-79f5800c-c429-4d5b-806a-24583b165552 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] HTTP exception thrown: Instance 81259012-5f3b-44f6-b979-39119f14929b could not be found. Aug 04 10:42:02.628322 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-79f5800c-c429-4d5b-806a-24583b165552 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Request method failure captured: Aug 04 10:42:02.628322 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: request: GET /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b HTTP/1.1 Aug 04 10:42:02.628322 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: Accept: application/json Aug 04 10:42:02.628322 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: Accept-Encoding: identity Aug 04 10:42:02.628322 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: Connection: close Aug 04 10:42:02.628322 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: Content-Length: 0 Aug 04 10:42:02.628322 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: Content-Type: application/json Aug 04 10:42:02.628322 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: Host: 10.222.0.121 Aug 04 10:42:02.628322 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: Openstack-System-Scope: None Aug 04 10:42:02.628322 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: User-Agent: python-urllib3/1.26.11 Aug 04 10:42:02.628322 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Auth-Token: gAAAAABi66BQBuXsA_bT4-GZmN0f9Ka0cXGSipTTL32Akj9bxqipP5mHnx7R7itsoDHiY84MpgYxkTlT5FxaU3F7CRJ_POrtGVAZgOMHqx0cewiPQAaDcRvYwNZJxzhdqH4CB9gMxgSnJA14aWhkIvo9iiaCYPhEs9PxEGNL2J8Ci5KYmHa-yAs Aug 04 10:42:02.628322 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Domain-Id: None Aug 04 10:42:02.628322 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Domain-Name: None Aug 04 10:42:02.628322 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Identity-Status: Confirmed Aug 04 10:42:02.628322 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Is-Admin-Project: True Aug 04 10:42:02.628322 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Project-Domain-Id: default Aug 04 10:42:02.628322 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Project-Domain-Name: Default Aug 04 10:42:02.628322 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Project-Id: 6f46ab11dd0b428486c673afc14b5b63 Aug 04 10:42:02.628322 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Project-Name: tempest-AttachVolumeTestJSON-870835423 Aug 04 10:42:02.628322 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Role: reader,member Aug 04 10:42:02.628322 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Roles: reader,member Aug 04 10:42:02.630059 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/6f46ab11dd0b428486c673afc14b5b63"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/6f46ab11dd0b428486c673afc14b5b63"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.121:8080", "publicURL": "http://10.222.0.121:8080/v1/AUTH_6f46ab11dd0b428486c673afc14b5b63"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2/6f46ab11dd0b428486c673afc14b5b63"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:9696/networking"}]}] Aug 04 10:42:02.630059 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Tenant: tempest-AttachVolumeTestJSON-870835423 Aug 04 10:42:02.630059 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Tenant-Id: 6f46ab11dd0b428486c673afc14b5b63 Aug 04 10:42:02.630059 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Tenant-Name: tempest-AttachVolumeTestJSON-870835423 Aug 04 10:42:02.630059 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-User: tempest-AttachVolumeTestJSON-870835423-project Aug 04 10:42:02.630059 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-User-Domain-Id: default Aug 04 10:42:02.630059 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-User-Domain-Name: Default Aug 04 10:42:02.630059 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-User-Id: 3aa2e2a5a6ed4c5c9db91269266dd30b Aug 04 10:42:02.630059 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-User-Name: tempest-AttachVolumeTestJSON-870835423-project Aug 04 10:42:02.630059 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: method: > Aug 04 10:42:02.630059 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: exception: Instance 81259012-5f3b-44f6-b979-39119f14929b could not be found. Aug 04 10:42:02.630059 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: action_args: {'id': '81259012-5f3b-44f6-b979-39119f14929b'} Aug 04 10:42:02.631073 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 10:42:02.631073 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:42:02.631073 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 10:42:02.631073 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 10:42:02.631073 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 10:42:02.631073 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 10:42:02.631073 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 10:42:02.631073 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 10:42:02.631073 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 10:42:02.631073 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 10:42:02.631073 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 81259012-5f3b-44f6-b979-39119f14929b could not be found. Aug 04 10:42:02.631073 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Aug 04 10:42:02.631073 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:42:02.631073 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Aug 04 10:42:02.631073 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:42:02.631073 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:42:02.631073 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:42:02.631073 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 10:42:02.631073 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 10:42:02.631073 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 10:42:02.632466 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 10:42:02.632466 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 10:42:02.632466 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 10:42:02.632466 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 10:42:02.632466 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 10:42:02.632466 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 10:42:02.632466 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 10:42:02.632466 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 81259012-5f3b-44f6-b979-39119f14929b could not be found. Aug 04 10:42:02.632466 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Aug 04 10:42:02.632466 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:42:02.632466 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Aug 04 10:42:02.632466 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:42:02.632466 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:42:02.632466 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:42:02.632466 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 10:42:02.632466 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 10:42:02.632466 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 81259012-5f3b-44f6-b979-39119f14929b could not be found. Aug 04 10:42:02.632466 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Aug 04 10:42:02.634958 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-79f5800c-c429-4d5b-806a-24583b165552 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Returning 404 to user: Instance 81259012-5f3b-44f6-b979-39119f14929b could not be found. {{(pid=124457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 10:42:02.636742 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-79f5800c-c429-4d5b-806a-24583b165552 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] 10.222.0.121 "GET /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b" status: 404 len: 111 microversion: 2.1 time: 0.066156 Aug 04 10:42:02.641361 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 415/819] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:42:02 2022] GET /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 10:42:02.646877 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-9e26cff4-d2af-4376-871b-a126ef6720e5 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Calling method '.version_select at 0x7f6754ff2280>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:42:02.689754 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-9e26cff4-d2af-4376-871b-a126ef6720e5 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] 10.222.0.121 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-597370449" status: 202 len: 0 microversion: 2.1 time: 0.046663 Aug 04 10:42:02.690559 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 405/820] 10.222.0.121 () {58 vars in 1223 bytes} [Thu Aug 4 10:42:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-597370449 => generated 0 bytes in 48 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 10:42:02.941500 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-22ecaa28-bcfe-426f-92bb-670bc0d58702 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:42:02.944804 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-22ecaa28-bcfe-426f-92bb-670bc0d58702 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] [instance: ec14be1f-7e78-45e3-a70a-587a47b2d1c9] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:42:02.954696 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-22ecaa28-bcfe-426f-92bb-670bc0d58702 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:42:02.955690 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-22ecaa28-bcfe-426f-92bb-670bc0d58702 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:42:02.958584 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-22ecaa28-bcfe-426f-92bb-670bc0d58702 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:42:02.960206 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-22ecaa28-bcfe-426f-92bb-670bc0d58702 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:42:03.098207 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-8942aba7-7877-4fa5-b0a2-1df82ca12f66 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:42:03.100927 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-8942aba7-7877-4fa5-b0a2-1df82ca12f66 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] [instance: a5fe2c05-1417-4bc2-855e-52c9d7457a49] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:42:03.119173 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-8942aba7-7877-4fa5-b0a2-1df82ca12f66 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:42:03.119689 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-8942aba7-7877-4fa5-b0a2-1df82ca12f66 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:42:03.120737 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-8942aba7-7877-4fa5-b0a2-1df82ca12f66 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:42:03.121504 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-8942aba7-7877-4fa5-b0a2-1df82ca12f66 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:42:03.142054 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.wsgi [None req-8942aba7-7877-4fa5-b0a2-1df82ca12f66 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] HTTP exception thrown: Instance a5fe2c05-1417-4bc2-855e-52c9d7457a49 could not be found. Aug 04 10:42:03.144243 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-8942aba7-7877-4fa5-b0a2-1df82ca12f66 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Request method failure captured: Aug 04 10:42:03.144243 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: request: GET /compute/v2.1/servers/a5fe2c05-1417-4bc2-855e-52c9d7457a49 HTTP/1.1 Aug 04 10:42:03.144243 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: Accept: application/json Aug 04 10:42:03.144243 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: Accept-Encoding: identity Aug 04 10:42:03.144243 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: Connection: close Aug 04 10:42:03.144243 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: Content-Length: 0 Aug 04 10:42:03.144243 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: Content-Type: application/json Aug 04 10:42:03.144243 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: Host: 10.222.0.121 Aug 04 10:42:03.144243 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: Openstack-System-Scope: None Aug 04 10:42:03.144243 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: User-Agent: python-urllib3/1.26.11 Aug 04 10:42:03.144243 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Auth-Token: gAAAAABi66Bc3v4QS1FtUMzLABOQnByGgDiNvJ-JvGmdBDVbq6x7lQW47g6_YVrbEeRME3TfDfNZZQZzvek1irFXoT0OrvdtDRcHao-WSK1U1LXxlYJ7lzEubI7Szk80hERaW5e12YVPeHwUKRft5YXP3uZ6ZxfgU3B2fGKT8Q_qAH4d7HdL2nw Aug 04 10:42:03.144243 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Domain-Id: None Aug 04 10:42:03.144243 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Domain-Name: None Aug 04 10:42:03.144243 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Identity-Status: Confirmed Aug 04 10:42:03.144243 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Is-Admin-Project: True Aug 04 10:42:03.144243 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Project-Domain-Id: default Aug 04 10:42:03.144243 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Project-Domain-Name: Default Aug 04 10:42:03.144243 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Project-Id: 7121bd118a2549c39332cfdb7edaa92f Aug 04 10:42:03.144243 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-47221404 Aug 04 10:42:03.144243 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Role: reader,member Aug 04 10:42:03.144243 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Roles: reader,member Aug 04 10:42:03.145736 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/7121bd118a2549c39332cfdb7edaa92f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/7121bd118a2549c39332cfdb7edaa92f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.121:8080", "publicURL": "http://10.222.0.121:8080/v1/AUTH_7121bd118a2549c39332cfdb7edaa92f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2/7121bd118a2549c39332cfdb7edaa92f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:9696/networking"}]}] Aug 04 10:42:03.145736 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Tenant: tempest-ServerRescueNegativeTestJSON-47221404 Aug 04 10:42:03.145736 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Tenant-Id: 7121bd118a2549c39332cfdb7edaa92f Aug 04 10:42:03.145736 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-47221404 Aug 04 10:42:03.145736 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-User: tempest-ServerRescueNegativeTestJSON-47221404-project Aug 04 10:42:03.145736 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-User-Domain-Id: default Aug 04 10:42:03.145736 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-User-Domain-Name: Default Aug 04 10:42:03.145736 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-User-Id: 3170dc3323f54512bc8819c8efa86b0f Aug 04 10:42:03.145736 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-User-Name: tempest-ServerRescueNegativeTestJSON-47221404-project Aug 04 10:42:03.145736 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: method: > Aug 04 10:42:03.145736 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: exception: Instance a5fe2c05-1417-4bc2-855e-52c9d7457a49 could not be found. Aug 04 10:42:03.145736 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: action_args: {'id': 'a5fe2c05-1417-4bc2-855e-52c9d7457a49'} Aug 04 10:42:03.146648 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 10:42:03.146648 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:42:03.146648 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 10:42:03.146648 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 10:42:03.146648 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 10:42:03.146648 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 10:42:03.146648 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 10:42:03.146648 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 10:42:03.146648 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 10:42:03.146648 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 10:42:03.146648 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a5fe2c05-1417-4bc2-855e-52c9d7457a49 could not be found. Aug 04 10:42:03.146648 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi Aug 04 10:42:03.146648 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:42:03.146648 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi Aug 04 10:42:03.146648 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:42:03.146648 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:42:03.146648 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:42:03.146648 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 10:42:03.146648 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 10:42:03.146648 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 10:42:03.147879 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 10:42:03.147879 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 10:42:03.147879 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 10:42:03.147879 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 10:42:03.147879 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 10:42:03.147879 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 10:42:03.147879 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 10:42:03.147879 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a5fe2c05-1417-4bc2-855e-52c9d7457a49 could not be found. Aug 04 10:42:03.147879 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi Aug 04 10:42:03.147879 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:42:03.147879 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi Aug 04 10:42:03.147879 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:42:03.147879 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:42:03.147879 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:42:03.147879 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 10:42:03.147879 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 10:42:03.147879 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a5fe2c05-1417-4bc2-855e-52c9d7457a49 could not be found. Aug 04 10:42:03.147879 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi Aug 04 10:42:03.149479 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-8942aba7-7877-4fa5-b0a2-1df82ca12f66 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Returning 404 to user: Instance a5fe2c05-1417-4bc2-855e-52c9d7457a49 could not be found. {{(pid=124456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 10:42:03.150328 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-8942aba7-7877-4fa5-b0a2-1df82ca12f66 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] 10.222.0.121 "GET /compute/v2.1/servers/a5fe2c05-1417-4bc2-855e-52c9d7457a49" status: 404 len: 111 microversion: 2.1 time: 0.062729 Aug 04 10:42:03.154836 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 406/821] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:42:03 2022] GET /compute/v2.1/servers/a5fe2c05-1417-4bc2-855e-52c9d7457a49 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 10:42:03.168788 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-0378a63c-863f-4f27-9b98-512504652062 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Calling method '.version_select at 0x7f6754ff2040>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:42:03.196157 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-0378a63c-863f-4f27-9b98-512504652062 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] 10.222.0.121 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-242295646" status: 202 len: 0 microversion: 2.1 time: 0.031787 Aug 04 10:42:03.197505 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 407/822] 10.222.0.121 () {58 vars in 1223 bytes} [Thu Aug 4 10:42:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-242295646 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 04 10:42:03.217184 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [req-233f7d5c-f9a4-402a-86ad-42a70a205cf2 req-a79dec78-38ea-47f7-add1-d1c439b0fac6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5fe2c05-1417-4bc2-855e-52c9d7457a49", "name": "network-vif-deleted", "tag": "145415de-6cf5-4375-a71d-43735b21c5b4"}]} {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:42:03.229986 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [req-233f7d5c-f9a4-402a-86ad-42a70a205cf2 req-a79dec78-38ea-47f7-add1-d1c439b0fac6 service nova] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:42:03.230758 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [req-233f7d5c-f9a4-402a-86ad-42a70a205cf2 req-a79dec78-38ea-47f7-add1-d1c439b0fac6 service nova] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:42:03.240024 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-22ecaa28-bcfe-426f-92bb-670bc0d58702 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6921033062424e14bc30f9b94bf911db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bee0d982e3ba4f7dba65f51636856b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:42:03.251009 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.compute.server_external_events [req-233f7d5c-f9a4-402a-86ad-42a70a205cf2 req-a79dec78-38ea-47f7-add1-d1c439b0fac6 service nova] Creating event network-vif-deleted:145415de-6cf5-4375-a71d-43735b21c5b4 for instance a5fe2c05-1417-4bc2-855e-52c9d7457a49 on hv-cinder-85200 Aug 04 10:42:03.251482 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-22ecaa28-bcfe-426f-92bb-670bc0d58702 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] 10.222.0.121 "GET /compute/v2.1/servers/ec14be1f-7e78-45e3-a70a-587a47b2d1c9" status: 200 len: 1521 microversion: 2.1 time: 0.320196 Aug 04 10:42:03.263986 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 416/823] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:42:02 2022] GET /compute/v2.1/servers/ec14be1f-7e78-45e3-a70a-587a47b2d1c9 => generated 1521 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:42:03.264248 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [req-233f7d5c-f9a4-402a-86ad-42a70a205cf2 req-a79dec78-38ea-47f7-add1-d1c439b0fac6 service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048131 Aug 04 10:42:03.266959 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 408/824] 10.222.0.121 () {64 vars in 1322 bytes} [Thu Aug 4 10:42:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:42:03.827068 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-0bb1da31-40da-4ac4-a01c-9f59678e21d9 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Action: 'create', calling method: .version_select at 0x7f6754d02670>, body: {"keypair": {"name": "tempest-keypair-2124904170", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ3TZSLcLiwObYtHLmx/D9j2nz2Ay+DFeczwF+cLqWjXbzXebdVHv1PnpNdX3R9Jzr33yPguGkrw08oUTdSl5RJqis3IwjAdQoHOFinr2umjnrljGXsiu5aCBPcZzuSwJQ=="}} {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:42:03.845779 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.quota [None req-0bb1da31-40da-4ac4-a01c-9f59678e21d9 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Getting quotas for project 6f46ab11dd0b428486c673afc14b5b63. Resources: {'key_pairs'} {{(pid=124457) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 10:42:03.850520 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.quota [None req-0bb1da31-40da-4ac4-a01c-9f59678e21d9 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Getting quotas for user 3aa2e2a5a6ed4c5c9db91269266dd30b and project 6f46ab11dd0b428486c673afc14b5b63. Resources: {'key_pairs'} {{(pid=124457) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 10:42:03.882591 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-0bb1da31-40da-4ac4-a01c-9f59678e21d9 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] 10.222.0.121 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.059610 Aug 04 10:42:03.883885 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 417/825] 10.222.0.121 () {60 vars in 1164 bytes} [Thu Aug 4 10:42:03 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:42:04.281476 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-2347fdba-e743-4da6-9232-d855f74ce67f tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:42:04.283082 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-2347fdba-e743-4da6-9232-d855f74ce67f tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] [instance: ec14be1f-7e78-45e3-a70a-587a47b2d1c9] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:42:04.298962 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-2347fdba-e743-4da6-9232-d855f74ce67f tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:42:04.299384 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-2347fdba-e743-4da6-9232-d855f74ce67f tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:42:04.300445 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-2347fdba-e743-4da6-9232-d855f74ce67f tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:42:04.301068 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-2347fdba-e743-4da6-9232-d855f74ce67f tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:42:04.595206 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-2347fdba-e743-4da6-9232-d855f74ce67f tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6921033062424e14bc30f9b94bf911db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bee0d982e3ba4f7dba65f51636856b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:42:04.610161 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-2347fdba-e743-4da6-9232-d855f74ce67f tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] 10.222.0.121 "GET /compute/v2.1/servers/ec14be1f-7e78-45e3-a70a-587a47b2d1c9" status: 200 len: 1577 microversion: 2.1 time: 0.337604 Aug 04 10:42:04.612353 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 409/826] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:42:04 2022] GET /compute/v2.1/servers/ec14be1f-7e78-45e3-a70a-587a47b2d1c9 => generated 1577 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:42:05.638832 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-241da790-4ef9-479d-80dd-2772e0046dc3 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:42:05.639796 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-241da790-4ef9-479d-80dd-2772e0046dc3 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] [instance: ec14be1f-7e78-45e3-a70a-587a47b2d1c9] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:42:05.651599 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-241da790-4ef9-479d-80dd-2772e0046dc3 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:42:05.652318 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-241da790-4ef9-479d-80dd-2772e0046dc3 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:42:05.653544 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-241da790-4ef9-479d-80dd-2772e0046dc3 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:42:05.654314 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-241da790-4ef9-479d-80dd-2772e0046dc3 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:42:05.830488 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-241da790-4ef9-479d-80dd-2772e0046dc3 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6921033062424e14bc30f9b94bf911db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bee0d982e3ba4f7dba65f51636856b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:42:05.842039 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-241da790-4ef9-479d-80dd-2772e0046dc3 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] 10.222.0.121 "GET /compute/v2.1/servers/ec14be1f-7e78-45e3-a70a-587a47b2d1c9" status: 200 len: 1577 microversion: 2.1 time: 0.207784 Aug 04 10:42:05.843260 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 418/827] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:42:05 2022] GET /compute/v2.1/servers/ec14be1f-7e78-45e3-a70a-587a47b2d1c9 => generated 1577 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:42:05.908682 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-6716d013-5e1c-44d7-b421-424801e1216c tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1214145591", "imageRef": "46724bb5-955f-4f3f-bd6a-b561fdde55e3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5c01f911-dc6f-48de-b8e0-5f0ee7d072b9"}], "security_groups": [{"name": "tempest-securitygroup--360380931"}], "key_name": "tempest-keypair-2124904170", "user_data": "}} {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:42:06.022592 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.network.neutron [None req-6716d013-5e1c-44d7-b421-424801e1216c tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] validate_networks() for [('5c01f911-dc6f-48de-b8e0-5f0ee7d072b9', None, None, None, None, None)] {{(pid=124456) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 10:42:06.429829 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.virt.hardware [None req-6716d013-5e1c-44d7-b421-424801e1216c tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Flavor limits 0:0:0 {{(pid=124456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 10:42:06.430359 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.virt.hardware [None req-6716d013-5e1c-44d7-b421-424801e1216c tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Image limits 0:0:0 {{(pid=124456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 10:42:06.430934 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.virt.hardware [None req-6716d013-5e1c-44d7-b421-424801e1216c tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Flavor pref 0:0:0 {{(pid=124456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 10:42:06.431393 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.virt.hardware [None req-6716d013-5e1c-44d7-b421-424801e1216c tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Image pref 0:0:0 {{(pid=124456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 10:42:06.431854 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.virt.hardware [None req-6716d013-5e1c-44d7-b421-424801e1216c tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 10:42:06.441438 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-6716d013-5e1c-44d7-b421-424801e1216c tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:42:06.441884 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-6716d013-5e1c-44d7-b421-424801e1216c tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:42:06.442721 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-6716d013-5e1c-44d7-b421-424801e1216c tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:42:06.443155 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-6716d013-5e1c-44d7-b421-424801e1216c tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:42:06.460777 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.quota [None req-6716d013-5e1c-44d7-b421-424801e1216c tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Getting quotas for project 6f46ab11dd0b428486c673afc14b5b63. Resources: {'ram', 'instances', 'cores'} {{(pid=124456) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 10:42:06.469058 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.quota [None req-6716d013-5e1c-44d7-b421-424801e1216c tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Getting quotas for user 3aa2e2a5a6ed4c5c9db91269266dd30b and project 6f46ab11dd0b428486c673afc14b5b63. Resources: {'ram', 'instances', 'cores'} {{(pid=124456) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 10:42:06.484210 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-6716d013-5e1c-44d7-b421-424801e1216c tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Going to run 1 instances... {{(pid=124456) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 10:42:06.487780 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-6716d013-5e1c-44d7-b421-424801e1216c tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] [instance: 1f24d364-de0b-4fc9-81d6-463fd637722c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='46724bb5-955f-4f3f-bd6a-b561fdde55e3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124456) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 10:42:06.543760 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-6716d013-5e1c-44d7-b421-424801e1216c tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] 10.222.0.121 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.639510 Aug 04 10:42:06.544728 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 410/828] 10.222.0.121 () {60 vars in 1152 bytes} [Thu Aug 4 10:42:05 2022] POST /compute/v2.1/servers => generated 403 bytes in 641 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 04 10:42:06.556547 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-e53a3f65-e315-439b-b41b-8370aeba584c tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:42:06.558058 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-e53a3f65-e315-439b-b41b-8370aeba584c tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] [instance: 2583b630-2f89-45ba-b781-c0b7c206d61e] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:42:06.559635 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-28d150ea-9cfd-4a16-bbd5-c7be39fae1c4 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:42:06.560423 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-28d150ea-9cfd-4a16-bbd5-c7be39fae1c4 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] [instance: 1f24d364-de0b-4fc9-81d6-463fd637722c] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:42:06.572346 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-e53a3f65-e315-439b-b41b-8370aeba584c tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:42:06.574720 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-e53a3f65-e315-439b-b41b-8370aeba584c tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:42:06.575867 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-e53a3f65-e315-439b-b41b-8370aeba584c tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:42:06.576611 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-e53a3f65-e315-439b-b41b-8370aeba584c tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:42:06.617576 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-e53a3f65-e315-439b-b41b-8370aeba584c tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] [instance: 2583b630-2f89-45ba-b781-c0b7c206d61e] Going to try to terminate instance {{(pid=124457) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 10:42:06.646516 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-28d150ea-9cfd-4a16-bbd5-c7be39fae1c4 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa2e2a5a6ed4c5c9db91269266dd30b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f46ab11dd0b428486c673afc14b5b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:42:06.655694 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-28d150ea-9cfd-4a16-bbd5-c7be39fae1c4 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] 10.222.0.121 "GET /compute/v2.1/servers/1f24d364-de0b-4fc9-81d6-463fd637722c" status: 200 len: 1242 microversion: 2.1 time: 0.101316 Aug 04 10:42:06.657030 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 411/829] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:42:06 2022] GET /compute/v2.1/servers/1f24d364-de0b-4fc9-81d6-463fd637722c => generated 1242 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:42:06.718636 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-e53a3f65-e315-439b-b41b-8370aeba584c tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] 10.222.0.121 "DELETE /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e" status: 204 len: 0 microversion: 2.1 time: 0.169249 Aug 04 10:42:06.720132 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 419/830] 10.222.0.121 () {58 vars in 1244 bytes} [Thu Aug 4 10:42:06 2022] DELETE /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e => generated 0 bytes in 173 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 10:42:06.731853 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-d64daece-f3b4-44bd-bc8b-395a2cfa1a34 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:42:06.732636 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-d64daece-f3b4-44bd-bc8b-395a2cfa1a34 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] [instance: 2583b630-2f89-45ba-b781-c0b7c206d61e] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:42:06.741673 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-d64daece-f3b4-44bd-bc8b-395a2cfa1a34 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:42:06.742353 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-d64daece-f3b4-44bd-bc8b-395a2cfa1a34 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:42:06.743361 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-d64daece-f3b4-44bd-bc8b-395a2cfa1a34 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:42:06.744481 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-d64daece-f3b4-44bd-bc8b-395a2cfa1a34 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:42:06.867400 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-cacd2883-9b2e-40ac-95e7-45f7649f2097 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:42:06.868249 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-cacd2883-9b2e-40ac-95e7-45f7649f2097 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] [instance: ec14be1f-7e78-45e3-a70a-587a47b2d1c9] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:42:06.875436 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-cacd2883-9b2e-40ac-95e7-45f7649f2097 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:42:06.876808 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-cacd2883-9b2e-40ac-95e7-45f7649f2097 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:42:06.877791 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-cacd2883-9b2e-40ac-95e7-45f7649f2097 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:42:06.878580 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-cacd2883-9b2e-40ac-95e7-45f7649f2097 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:42:06.923920 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-d64daece-f3b4-44bd-bc8b-395a2cfa1a34 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3170dc3323f54512bc8819c8efa86b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7121bd118a2549c39332cfdb7edaa92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:42:06.941699 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-d64daece-f3b4-44bd-bc8b-395a2cfa1a34 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] 10.222.0.121 "GET /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e" status: 200 len: 1511 microversion: 2.1 time: 0.213038 Aug 04 10:42:06.964234 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 412/831] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:42:06 2022] GET /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e => generated 1511 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:42:07.077392 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-cacd2883-9b2e-40ac-95e7-45f7649f2097 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6921033062424e14bc30f9b94bf911db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bee0d982e3ba4f7dba65f51636856b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:42:07.086119 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-cacd2883-9b2e-40ac-95e7-45f7649f2097 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] 10.222.0.121 "GET /compute/v2.1/servers/ec14be1f-7e78-45e3-a70a-587a47b2d1c9" status: 200 len: 1577 microversion: 2.1 time: 0.223454 Aug 04 10:42:07.086758 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 420/832] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:42:06 2022] GET /compute/v2.1/servers/ec14be1f-7e78-45e3-a70a-587a47b2d1c9 => generated 1577 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:42:07.693547 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-3e9417bf-945b-4b77-9e2c-1cb550057a6d tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:42:07.694250 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-3e9417bf-945b-4b77-9e2c-1cb550057a6d tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] [instance: 1f24d364-de0b-4fc9-81d6-463fd637722c] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:42:07.701372 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-3e9417bf-945b-4b77-9e2c-1cb550057a6d tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:42:07.701819 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-3e9417bf-945b-4b77-9e2c-1cb550057a6d tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:42:07.702624 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-3e9417bf-945b-4b77-9e2c-1cb550057a6d tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:42:07.703181 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-3e9417bf-945b-4b77-9e2c-1cb550057a6d tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:42:07.769993 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-3e9417bf-945b-4b77-9e2c-1cb550057a6d tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa2e2a5a6ed4c5c9db91269266dd30b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f46ab11dd0b428486c673afc14b5b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:42:07.778585 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-3e9417bf-945b-4b77-9e2c-1cb550057a6d tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] 10.222.0.121 "GET /compute/v2.1/servers/1f24d364-de0b-4fc9-81d6-463fd637722c" status: 200 len: 1294 microversion: 2.1 time: 0.089212 Aug 04 10:42:07.779162 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 413/833] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:42:07 2022] GET /compute/v2.1/servers/1f24d364-de0b-4fc9-81d6-463fd637722c => generated 1294 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:42:07.981045 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-6a5b19b7-7905-455b-8203-0acc5540b92f tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:42:07.982888 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-6a5b19b7-7905-455b-8203-0acc5540b92f tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] [instance: 2583b630-2f89-45ba-b781-c0b7c206d61e] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:42:07.994932 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-6a5b19b7-7905-455b-8203-0acc5540b92f tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:42:07.995764 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-6a5b19b7-7905-455b-8203-0acc5540b92f tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:42:07.997962 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-6a5b19b7-7905-455b-8203-0acc5540b92f tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:42:07.998488 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-6a5b19b7-7905-455b-8203-0acc5540b92f tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:42:08.116683 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-c8c2d9f5-3f1b-4cbe-8424-0631995f04ec tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:42:08.118972 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-c8c2d9f5-3f1b-4cbe-8424-0631995f04ec tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] [instance: ec14be1f-7e78-45e3-a70a-587a47b2d1c9] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:42:08.127836 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-c8c2d9f5-3f1b-4cbe-8424-0631995f04ec tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:42:08.128701 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-c8c2d9f5-3f1b-4cbe-8424-0631995f04ec tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:42:08.130250 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-c8c2d9f5-3f1b-4cbe-8424-0631995f04ec tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:42:08.131000 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-c8c2d9f5-3f1b-4cbe-8424-0631995f04ec tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:42:08.599561 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-c8c2d9f5-3f1b-4cbe-8424-0631995f04ec tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6921033062424e14bc30f9b94bf911db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bee0d982e3ba4f7dba65f51636856b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:42:08.609019 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-c8c2d9f5-3f1b-4cbe-8424-0631995f04ec tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] 10.222.0.121 "GET /compute/v2.1/servers/ec14be1f-7e78-45e3-a70a-587a47b2d1c9" status: 200 len: 1577 microversion: 2.1 time: 0.497872 Aug 04 10:42:08.612798 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-6a5b19b7-7905-455b-8203-0acc5540b92f tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3170dc3323f54512bc8819c8efa86b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7121bd118a2549c39332cfdb7edaa92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:42:08.618151 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 414/834] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:42:08 2022] GET /compute/v2.1/servers/ec14be1f-7e78-45e3-a70a-587a47b2d1c9 => generated 1577 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 10:42:08.630078 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-6a5b19b7-7905-455b-8203-0acc5540b92f tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] 10.222.0.121 "GET /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e" status: 200 len: 1511 microversion: 2.1 time: 0.648525 Aug 04 10:42:08.630078 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 421/835] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:42:07 2022] GET /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e => generated 1511 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:42:08.804258 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-0a19a218-40d6-4c04-816e-1da2714ee7d5 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:42:08.805470 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-0a19a218-40d6-4c04-816e-1da2714ee7d5 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] [instance: 1f24d364-de0b-4fc9-81d6-463fd637722c] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:42:08.814773 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-0a19a218-40d6-4c04-816e-1da2714ee7d5 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:42:08.815371 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-0a19a218-40d6-4c04-816e-1da2714ee7d5 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:42:08.816212 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-0a19a218-40d6-4c04-816e-1da2714ee7d5 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:42:08.817330 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-0a19a218-40d6-4c04-816e-1da2714ee7d5 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:42:08.918008 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-0a19a218-40d6-4c04-816e-1da2714ee7d5 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa2e2a5a6ed4c5c9db91269266dd30b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f46ab11dd0b428486c673afc14b5b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:42:08.930080 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-0a19a218-40d6-4c04-816e-1da2714ee7d5 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] 10.222.0.121 "GET /compute/v2.1/servers/1f24d364-de0b-4fc9-81d6-463fd637722c" status: 200 len: 1300 microversion: 2.1 time: 0.132274 Aug 04 10:42:08.931169 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 415/836] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:42:08 2022] GET /compute/v2.1/servers/1f24d364-de0b-4fc9-81d6-463fd637722c => generated 1300 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:42:09.107540 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [req-ae407571-2994-4165-8c8a-3c7267faf0c8 req-06be6823-0e61-4424-a658-fa04b2c4f55d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2583b630-2f89-45ba-b781-c0b7c206d61e", "name": "network-vif-deleted", "tag": "c85208ac-5355-452e-8834-f5f341168cc4"}]} {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:42:09.133590 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [req-ae407571-2994-4165-8c8a-3c7267faf0c8 req-06be6823-0e61-4424-a658-fa04b2c4f55d service nova] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:42:09.134043 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [req-ae407571-2994-4165-8c8a-3c7267faf0c8 req-06be6823-0e61-4424-a658-fa04b2c4f55d service nova] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:42:09.163713 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.compute.server_external_events [req-ae407571-2994-4165-8c8a-3c7267faf0c8 req-06be6823-0e61-4424-a658-fa04b2c4f55d service nova] Creating event network-vif-deleted:c85208ac-5355-452e-8834-f5f341168cc4 for instance 2583b630-2f89-45ba-b781-c0b7c206d61e on hv-cinder-85200 Aug 04 10:42:09.170953 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [req-ae407571-2994-4165-8c8a-3c7267faf0c8 req-06be6823-0e61-4424-a658-fa04b2c4f55d service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067026 Aug 04 10:42:09.171348 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 422/837] 10.222.0.121 () {64 vars in 1322 bytes} [Thu Aug 4 10:42:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:42:09.649588 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-3e217354-a40f-4107-ad56-1120242c0550 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:42:09.650599 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-3e217354-a40f-4107-ad56-1120242c0550 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] [instance: 2583b630-2f89-45ba-b781-c0b7c206d61e] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:42:09.652533 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-d05b1688-5321-4c13-9f0e-8b2c8dace938 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:42:09.653792 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-d05b1688-5321-4c13-9f0e-8b2c8dace938 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] [instance: ec14be1f-7e78-45e3-a70a-587a47b2d1c9] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:42:09.658826 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG dbcounter [-] [124456] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=2,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=124456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:42:09.661284 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-3e217354-a40f-4107-ad56-1120242c0550 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:42:09.662017 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-3e217354-a40f-4107-ad56-1120242c0550 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:42:09.663064 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-3e217354-a40f-4107-ad56-1120242c0550 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:42:09.663890 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-3e217354-a40f-4107-ad56-1120242c0550 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:42:09.692425 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-d05b1688-5321-4c13-9f0e-8b2c8dace938 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:42:09.693152 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-d05b1688-5321-4c13-9f0e-8b2c8dace938 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:42:09.694625 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-d05b1688-5321-4c13-9f0e-8b2c8dace938 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:42:09.695456 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-d05b1688-5321-4c13-9f0e-8b2c8dace938 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:42:09.711907 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-3e217354-a40f-4107-ad56-1120242c0550 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:42:09.712853 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-3e217354-a40f-4107-ad56-1120242c0550 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:42:09.713496 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.objects.instance [None req-3e217354-a40f-4107-ad56-1120242c0550 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lazy-loading 'fault' on Instance uuid 2583b630-2f89-45ba-b781-c0b7c206d61e {{(pid=124457) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 10:42:09.820967 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-3e217354-a40f-4107-ad56-1120242c0550 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3170dc3323f54512bc8819c8efa86b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7121bd118a2549c39332cfdb7edaa92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:42:09.834562 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-3e217354-a40f-4107-ad56-1120242c0550 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] 10.222.0.121 "GET /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e" status: 200 len: 1315 microversion: 2.1 time: 0.189380 Aug 04 10:42:09.836115 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 423/838] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:42:09 2022] GET /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e => generated 1315 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 10:42:09.956888 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-655044aa-f446-4c23-8f28-f13c819afb70 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:42:09.958219 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-655044aa-f446-4c23-8f28-f13c819afb70 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] [instance: 1f24d364-de0b-4fc9-81d6-463fd637722c] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:42:09.968557 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-655044aa-f446-4c23-8f28-f13c819afb70 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:42:09.969312 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-655044aa-f446-4c23-8f28-f13c819afb70 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:42:09.970725 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-655044aa-f446-4c23-8f28-f13c819afb70 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:42:09.971401 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-655044aa-f446-4c23-8f28-f13c819afb70 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:42:10.015093 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-d05b1688-5321-4c13-9f0e-8b2c8dace938 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6921033062424e14bc30f9b94bf911db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bee0d982e3ba4f7dba65f51636856b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:42:10.025089 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-d05b1688-5321-4c13-9f0e-8b2c8dace938 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] 10.222.0.121 "GET /compute/v2.1/servers/ec14be1f-7e78-45e3-a70a-587a47b2d1c9" status: 200 len: 1577 microversion: 2.1 time: 0.386759 Aug 04 10:42:10.025686 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 416/839] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:42:09 2022] GET /compute/v2.1/servers/ec14be1f-7e78-45e3-a70a-587a47b2d1c9 => generated 1577 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:42:10.257497 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-655044aa-f446-4c23-8f28-f13c819afb70 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa2e2a5a6ed4c5c9db91269266dd30b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f46ab11dd0b428486c673afc14b5b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:42:10.265991 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-655044aa-f446-4c23-8f28-f13c819afb70 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] 10.222.0.121 "GET /compute/v2.1/servers/1f24d364-de0b-4fc9-81d6-463fd637722c" status: 200 len: 1367 microversion: 2.1 time: 0.314829 Aug 04 10:42:10.266612 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 424/840] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:42:09 2022] GET /compute/v2.1/servers/1f24d364-de0b-4fc9-81d6-463fd637722c => generated 1367 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 10:42:10.858424 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-52b4ba3b-6092-4f70-91dc-84f8e0ac9425 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:42:10.860757 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-52b4ba3b-6092-4f70-91dc-84f8e0ac9425 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] [instance: 2583b630-2f89-45ba-b781-c0b7c206d61e] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:42:10.869423 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-52b4ba3b-6092-4f70-91dc-84f8e0ac9425 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:42:10.870060 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-52b4ba3b-6092-4f70-91dc-84f8e0ac9425 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:42:10.870952 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-52b4ba3b-6092-4f70-91dc-84f8e0ac9425 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:42:10.871403 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-52b4ba3b-6092-4f70-91dc-84f8e0ac9425 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:42:10.886744 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.wsgi [None req-52b4ba3b-6092-4f70-91dc-84f8e0ac9425 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] HTTP exception thrown: Instance 2583b630-2f89-45ba-b781-c0b7c206d61e could not be found. Aug 04 10:42:10.888537 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-52b4ba3b-6092-4f70-91dc-84f8e0ac9425 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Request method failure captured: Aug 04 10:42:10.888537 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: request: GET /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e HTTP/1.1 Aug 04 10:42:10.888537 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: Accept: application/json Aug 04 10:42:10.888537 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: Accept-Encoding: identity Aug 04 10:42:10.888537 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: Connection: close Aug 04 10:42:10.888537 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: Content-Length: 0 Aug 04 10:42:10.888537 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: Content-Type: application/json Aug 04 10:42:10.888537 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: Host: 10.222.0.121 Aug 04 10:42:10.888537 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: Openstack-System-Scope: None Aug 04 10:42:10.888537 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: User-Agent: python-urllib3/1.26.11 Aug 04 10:42:10.888537 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Auth-Token: gAAAAABi66Bc3v4QS1FtUMzLABOQnByGgDiNvJ-JvGmdBDVbq6x7lQW47g6_YVrbEeRME3TfDfNZZQZzvek1irFXoT0OrvdtDRcHao-WSK1U1LXxlYJ7lzEubI7Szk80hERaW5e12YVPeHwUKRft5YXP3uZ6ZxfgU3B2fGKT8Q_qAH4d7HdL2nw Aug 04 10:42:10.888537 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Domain-Id: None Aug 04 10:42:10.888537 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Domain-Name: None Aug 04 10:42:10.888537 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Identity-Status: Confirmed Aug 04 10:42:10.888537 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Is-Admin-Project: True Aug 04 10:42:10.888537 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Project-Domain-Id: default Aug 04 10:42:10.888537 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Project-Domain-Name: Default Aug 04 10:42:10.888537 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Project-Id: 7121bd118a2549c39332cfdb7edaa92f Aug 04 10:42:10.888537 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-47221404 Aug 04 10:42:10.888537 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Role: reader,member Aug 04 10:42:10.888537 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Roles: reader,member Aug 04 10:42:10.890923 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/7121bd118a2549c39332cfdb7edaa92f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/7121bd118a2549c39332cfdb7edaa92f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.121:8080", "publicURL": "http://10.222.0.121:8080/v1/AUTH_7121bd118a2549c39332cfdb7edaa92f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2/7121bd118a2549c39332cfdb7edaa92f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:9696/networking"}]}] Aug 04 10:42:10.890923 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Tenant: tempest-ServerRescueNegativeTestJSON-47221404 Aug 04 10:42:10.890923 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Tenant-Id: 7121bd118a2549c39332cfdb7edaa92f Aug 04 10:42:10.890923 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-47221404 Aug 04 10:42:10.890923 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-User: tempest-ServerRescueNegativeTestJSON-47221404-project Aug 04 10:42:10.890923 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-User-Domain-Id: default Aug 04 10:42:10.890923 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-User-Domain-Name: Default Aug 04 10:42:10.890923 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-User-Id: 3170dc3323f54512bc8819c8efa86b0f Aug 04 10:42:10.890923 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-User-Name: tempest-ServerRescueNegativeTestJSON-47221404-project Aug 04 10:42:10.890923 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: method: > Aug 04 10:42:10.890923 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: exception: Instance 2583b630-2f89-45ba-b781-c0b7c206d61e could not be found. Aug 04 10:42:10.890923 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: action_args: {'id': '2583b630-2f89-45ba-b781-c0b7c206d61e'} Aug 04 10:42:10.893120 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 10:42:10.893120 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:42:10.893120 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 10:42:10.893120 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 10:42:10.893120 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 10:42:10.893120 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 10:42:10.893120 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 10:42:10.893120 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 10:42:10.893120 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 10:42:10.893120 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 10:42:10.893120 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2583b630-2f89-45ba-b781-c0b7c206d61e could not be found. Aug 04 10:42:10.893120 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi Aug 04 10:42:10.893120 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:42:10.893120 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi Aug 04 10:42:10.893120 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:42:10.893120 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:42:10.893120 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:42:10.893120 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 10:42:10.893120 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 10:42:10.893120 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 10:42:10.896729 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 10:42:10.896729 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 10:42:10.896729 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 10:42:10.896729 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 10:42:10.896729 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 10:42:10.896729 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 10:42:10.896729 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 10:42:10.896729 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2583b630-2f89-45ba-b781-c0b7c206d61e could not be found. Aug 04 10:42:10.896729 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi Aug 04 10:42:10.896729 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:42:10.896729 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi Aug 04 10:42:10.896729 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:42:10.896729 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:42:10.896729 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:42:10.896729 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 10:42:10.896729 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 10:42:10.896729 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2583b630-2f89-45ba-b781-c0b7c206d61e could not be found. Aug 04 10:42:10.896729 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi Aug 04 10:42:10.899540 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-52b4ba3b-6092-4f70-91dc-84f8e0ac9425 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Returning 404 to user: Instance 2583b630-2f89-45ba-b781-c0b7c206d61e could not be found. {{(pid=124456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 10:42:10.899540 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-52b4ba3b-6092-4f70-91dc-84f8e0ac9425 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] 10.222.0.121 "GET /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e" status: 404 len: 111 microversion: 2.1 time: 0.036604 Aug 04 10:42:10.899540 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 417/841] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:42:10 2022] GET /compute/v2.1/servers/2583b630-2f89-45ba-b781-c0b7c206d61e => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 10:42:10.901744 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-fa00bf41-0e0d-498a-8fc6-0deecddcc67c tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:42:10.902266 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-fa00bf41-0e0d-498a-8fc6-0deecddcc67c tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] [instance: 9b09b542-5b10-4244-88af-cb6de23588d8] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:42:10.913474 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-fa00bf41-0e0d-498a-8fc6-0deecddcc67c tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:42:10.913988 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-fa00bf41-0e0d-498a-8fc6-0deecddcc67c tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:42:10.915008 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-fa00bf41-0e0d-498a-8fc6-0deecddcc67c tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:42:10.915492 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-fa00bf41-0e0d-498a-8fc6-0deecddcc67c tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:42:10.922615 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG dbcounter [-] [124457] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:42:10.949321 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-fa00bf41-0e0d-498a-8fc6-0deecddcc67c tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] [instance: 9b09b542-5b10-4244-88af-cb6de23588d8] Going to try to terminate instance {{(pid=124457) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 10:42:11.053340 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-ff73149d-714c-47b3-852e-4321808c02af tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:42:11.053616 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-fa00bf41-0e0d-498a-8fc6-0deecddcc67c tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] 10.222.0.121 "DELETE /compute/v2.1/servers/9b09b542-5b10-4244-88af-cb6de23588d8" status: 204 len: 0 microversion: 2.1 time: 0.155557 Aug 04 10:42:11.054722 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-ff73149d-714c-47b3-852e-4321808c02af tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] [instance: ec14be1f-7e78-45e3-a70a-587a47b2d1c9] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:42:11.055067 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 425/842] 10.222.0.121 () {58 vars in 1244 bytes} [Thu Aug 4 10:42:10 2022] DELETE /compute/v2.1/servers/9b09b542-5b10-4244-88af-cb6de23588d8 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 10:42:11.066091 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-ff73149d-714c-47b3-852e-4321808c02af tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:42:11.066659 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-ff73149d-714c-47b3-852e-4321808c02af tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:42:11.067778 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-ff73149d-714c-47b3-852e-4321808c02af tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:42:11.068415 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-ff73149d-714c-47b3-852e-4321808c02af tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:42:11.070601 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-e0cb453b-bc4e-42df-a803-36fd55adb34a tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:42:11.071408 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-e0cb453b-bc4e-42df-a803-36fd55adb34a tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] [instance: 9b09b542-5b10-4244-88af-cb6de23588d8] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:42:11.080274 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-e0cb453b-bc4e-42df-a803-36fd55adb34a tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:42:11.080923 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-e0cb453b-bc4e-42df-a803-36fd55adb34a tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:42:11.081944 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-e0cb453b-bc4e-42df-a803-36fd55adb34a tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:42:11.082405 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-e0cb453b-bc4e-42df-a803-36fd55adb34a tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:42:11.323581 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-ff73149d-714c-47b3-852e-4321808c02af tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6921033062424e14bc30f9b94bf911db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bee0d982e3ba4f7dba65f51636856b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:42:11.333170 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-e0cb453b-bc4e-42df-a803-36fd55adb34a tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3170dc3323f54512bc8819c8efa86b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7121bd118a2549c39332cfdb7edaa92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:42:11.335002 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-ff73149d-714c-47b3-852e-4321808c02af tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] 10.222.0.121 "GET /compute/v2.1/servers/ec14be1f-7e78-45e3-a70a-587a47b2d1c9" status: 200 len: 1577 microversion: 2.1 time: 0.287200 Aug 04 10:42:11.335986 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 418/843] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:42:11 2022] GET /compute/v2.1/servers/ec14be1f-7e78-45e3-a70a-587a47b2d1c9 => generated 1577 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:42:11.343984 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [req-99791946-2ec3-409b-9327-a602e7e6985a req-816dd153-2454-4ddf-8ac3-d18b875f7790 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f24d364-de0b-4fc9-81d6-463fd637722c", "tag": "fd99aa60-adfb-4fac-9ff3-016eace2d99d"}]} {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:42:11.346192 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-e0cb453b-bc4e-42df-a803-36fd55adb34a tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] 10.222.0.121 "GET /compute/v2.1/servers/9b09b542-5b10-4244-88af-cb6de23588d8" status: 200 len: 1525 microversion: 2.1 time: 0.284029 Aug 04 10:42:11.347175 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 426/844] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:42:11 2022] GET /compute/v2.1/servers/9b09b542-5b10-4244-88af-cb6de23588d8 => generated 1525 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:42:11.356688 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-5bd1d42a-0948-41ac-9f00-761bc69cb17e tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:42:11.357892 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-5bd1d42a-0948-41ac-9f00-761bc69cb17e tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] [instance: 1f24d364-de0b-4fc9-81d6-463fd637722c] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:42:11.360631 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [req-99791946-2ec3-409b-9327-a602e7e6985a req-816dd153-2454-4ddf-8ac3-d18b875f7790 service nova] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:42:11.361387 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [req-99791946-2ec3-409b-9327-a602e7e6985a req-816dd153-2454-4ddf-8ac3-d18b875f7790 service nova] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:42:11.371354 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-5bd1d42a-0948-41ac-9f00-761bc69cb17e tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:42:11.372132 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-5bd1d42a-0948-41ac-9f00-761bc69cb17e tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:42:11.373415 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-5bd1d42a-0948-41ac-9f00-761bc69cb17e tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:42:11.374145 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-5bd1d42a-0948-41ac-9f00-761bc69cb17e tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:42:11.381863 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.compute.server_external_events [req-99791946-2ec3-409b-9327-a602e7e6985a req-816dd153-2454-4ddf-8ac3-d18b875f7790 service nova] Creating event network-changed:fd99aa60-adfb-4fac-9ff3-016eace2d99d for instance 1f24d364-de0b-4fc9-81d6-463fd637722c on hv-cinder-85200 Aug 04 10:42:11.389643 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [req-99791946-2ec3-409b-9327-a602e7e6985a req-816dd153-2454-4ddf-8ac3-d18b875f7790 service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051703 Aug 04 10:42:11.390614 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 419/845] 10.222.0.121 () {64 vars in 1322 bytes} [Thu Aug 4 10:42:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:42:11.549121 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-5bd1d42a-0948-41ac-9f00-761bc69cb17e tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa2e2a5a6ed4c5c9db91269266dd30b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f46ab11dd0b428486c673afc14b5b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:42:11.566437 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-5bd1d42a-0948-41ac-9f00-761bc69cb17e tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] 10.222.0.121 "GET /compute/v2.1/servers/1f24d364-de0b-4fc9-81d6-463fd637722c" status: 200 len: 1367 microversion: 2.1 time: 0.217313 Aug 04 10:42:11.567055 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 427/846] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:42:11 2022] GET /compute/v2.1/servers/1f24d364-de0b-4fc9-81d6-463fd637722c => generated 1367 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:42:12.359100 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-858f2e89-eb44-4cf0-9183-1680649f2b49 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:42:12.359800 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-858f2e89-eb44-4cf0-9183-1680649f2b49 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] [instance: ec14be1f-7e78-45e3-a70a-587a47b2d1c9] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:42:12.367775 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-858f2e89-eb44-4cf0-9183-1680649f2b49 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:42:12.368322 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-858f2e89-eb44-4cf0-9183-1680649f2b49 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:42:12.369286 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-619c615e-98d0-4f10-879c-0c72b2f3a232 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:42:12.370114 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-858f2e89-eb44-4cf0-9183-1680649f2b49 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:42:12.370297 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-619c615e-98d0-4f10-879c-0c72b2f3a232 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] [instance: 9b09b542-5b10-4244-88af-cb6de23588d8] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:42:12.370474 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-858f2e89-eb44-4cf0-9183-1680649f2b49 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:42:12.372596 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG dbcounter [-] [124457] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=3,nova_api:INSERT=1 {{(pid=124457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:42:12.379675 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-619c615e-98d0-4f10-879c-0c72b2f3a232 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:42:12.380210 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-619c615e-98d0-4f10-879c-0c72b2f3a232 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:42:12.381047 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-619c615e-98d0-4f10-879c-0c72b2f3a232 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:42:12.381494 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-619c615e-98d0-4f10-879c-0c72b2f3a232 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:42:12.393585 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG dbcounter [-] [124456] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:42:12.591173 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-858f2e89-eb44-4cf0-9183-1680649f2b49 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6921033062424e14bc30f9b94bf911db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bee0d982e3ba4f7dba65f51636856b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:42:12.592275 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-619c615e-98d0-4f10-879c-0c72b2f3a232 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3170dc3323f54512bc8819c8efa86b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7121bd118a2549c39332cfdb7edaa92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:42:12.605292 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-858f2e89-eb44-4cf0-9183-1680649f2b49 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] 10.222.0.121 "GET /compute/v2.1/servers/ec14be1f-7e78-45e3-a70a-587a47b2d1c9" status: 200 len: 1577 microversion: 2.1 time: 0.251012 Aug 04 10:42:12.606625 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 420/847] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:42:12 2022] GET /compute/v2.1/servers/ec14be1f-7e78-45e3-a70a-587a47b2d1c9 => generated 1577 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:42:12.611057 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-619c615e-98d0-4f10-879c-0c72b2f3a232 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] 10.222.0.121 "GET /compute/v2.1/servers/9b09b542-5b10-4244-88af-cb6de23588d8" status: 200 len: 1525 microversion: 2.1 time: 0.245653 Aug 04 10:42:12.616791 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 428/848] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:42:12 2022] GET /compute/v2.1/servers/9b09b542-5b10-4244-88af-cb6de23588d8 => generated 1525 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:42:12.617079 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-1e9cf93c-37d0-4ff4-89a4-c99201009beb tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:42:12.617079 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-1e9cf93c-37d0-4ff4-89a4-c99201009beb tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] [instance: 1f24d364-de0b-4fc9-81d6-463fd637722c] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:42:12.620773 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-1e9cf93c-37d0-4ff4-89a4-c99201009beb tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:42:12.621488 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-1e9cf93c-37d0-4ff4-89a4-c99201009beb tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:42:12.622503 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-1e9cf93c-37d0-4ff4-89a4-c99201009beb tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:42:12.622964 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-1e9cf93c-37d0-4ff4-89a4-c99201009beb tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:42:12.767253 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-1e9cf93c-37d0-4ff4-89a4-c99201009beb tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa2e2a5a6ed4c5c9db91269266dd30b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f46ab11dd0b428486c673afc14b5b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:42:12.775829 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-1e9cf93c-37d0-4ff4-89a4-c99201009beb tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] 10.222.0.121 "GET /compute/v2.1/servers/1f24d364-de0b-4fc9-81d6-463fd637722c" status: 200 len: 1367 microversion: 2.1 time: 0.167955 Aug 04 10:42:12.776477 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 421/849] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:42:12 2022] GET /compute/v2.1/servers/1f24d364-de0b-4fc9-81d6-463fd637722c => generated 1367 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:42:13.630630 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-3aa56648-c558-4491-ad0d-52fb32da00a6 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:42:13.631718 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-3aa56648-c558-4491-ad0d-52fb32da00a6 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] [instance: ec14be1f-7e78-45e3-a70a-587a47b2d1c9] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:42:13.638920 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-cf15ff56-bbf4-44e3-927f-e8dfb99dfdd5 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:42:13.640133 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-cf15ff56-bbf4-44e3-927f-e8dfb99dfdd5 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] [instance: 9b09b542-5b10-4244-88af-cb6de23588d8] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:42:13.643190 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-3aa56648-c558-4491-ad0d-52fb32da00a6 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:42:13.643938 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-3aa56648-c558-4491-ad0d-52fb32da00a6 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:42:13.645263 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-3aa56648-c558-4491-ad0d-52fb32da00a6 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:42:13.645966 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-3aa56648-c558-4491-ad0d-52fb32da00a6 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:42:13.651364 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-cf15ff56-bbf4-44e3-927f-e8dfb99dfdd5 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:42:13.652137 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-cf15ff56-bbf4-44e3-927f-e8dfb99dfdd5 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:42:13.653298 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-cf15ff56-bbf4-44e3-927f-e8dfb99dfdd5 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:42:13.653802 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-cf15ff56-bbf4-44e3-927f-e8dfb99dfdd5 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:42:13.860069 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-3aa56648-c558-4491-ad0d-52fb32da00a6 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6921033062424e14bc30f9b94bf911db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bee0d982e3ba4f7dba65f51636856b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:42:13.862632 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-cf15ff56-bbf4-44e3-927f-e8dfb99dfdd5 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3170dc3323f54512bc8819c8efa86b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7121bd118a2549c39332cfdb7edaa92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:42:13.863029 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG dbcounter [-] [124457] Writing DB stats nova_cell0:SELECT=4 {{(pid=124457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:42:13.872034 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-cf15ff56-bbf4-44e3-927f-e8dfb99dfdd5 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] 10.222.0.121 "GET /compute/v2.1/servers/9b09b542-5b10-4244-88af-cb6de23588d8" status: 200 len: 1525 microversion: 2.1 time: 0.239891 Aug 04 10:42:13.872985 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-3aa56648-c558-4491-ad0d-52fb32da00a6 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] 10.222.0.121 "GET /compute/v2.1/servers/ec14be1f-7e78-45e3-a70a-587a47b2d1c9" status: 200 len: 1577 microversion: 2.1 time: 0.246744 Aug 04 10:42:13.873199 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 422/850] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:42:13 2022] GET /compute/v2.1/servers/9b09b542-5b10-4244-88af-cb6de23588d8 => generated 1525 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:42:13.873497 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 429/851] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:42:13 2022] GET /compute/v2.1/servers/ec14be1f-7e78-45e3-a70a-587a47b2d1c9 => generated 1577 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:42:13.878817 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-d0960679-c875-4cd9-a942-5a7c58de445e tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:42:13.879527 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-d0960679-c875-4cd9-a942-5a7c58de445e tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] [instance: 1f24d364-de0b-4fc9-81d6-463fd637722c] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:42:13.886571 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-d0960679-c875-4cd9-a942-5a7c58de445e tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:42:13.887059 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-d0960679-c875-4cd9-a942-5a7c58de445e tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:42:13.887809 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-d0960679-c875-4cd9-a942-5a7c58de445e tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:42:13.888373 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-d0960679-c875-4cd9-a942-5a7c58de445e tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:42:14.028685 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-d0960679-c875-4cd9-a942-5a7c58de445e tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa2e2a5a6ed4c5c9db91269266dd30b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f46ab11dd0b428486c673afc14b5b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:42:14.037600 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-d0960679-c875-4cd9-a942-5a7c58de445e tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] 10.222.0.121 "GET /compute/v2.1/servers/1f24d364-de0b-4fc9-81d6-463fd637722c" status: 200 len: 1367 microversion: 2.1 time: 0.162617 Aug 04 10:42:14.038170 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 423/852] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:42:13 2022] GET /compute/v2.1/servers/1f24d364-de0b-4fc9-81d6-463fd637722c => generated 1367 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:42:14.894414 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-ec593d87-cb99-4c5d-a059-9160a2e871de tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:42:14.895433 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-ec593d87-cb99-4c5d-a059-9160a2e871de tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] [instance: 9b09b542-5b10-4244-88af-cb6de23588d8] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:42:14.896360 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-6837dfc0-22d3-4f1a-89f3-531e1125e63e tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:42:14.897356 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-6837dfc0-22d3-4f1a-89f3-531e1125e63e tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] [instance: ec14be1f-7e78-45e3-a70a-587a47b2d1c9] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:42:14.902818 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-ec593d87-cb99-4c5d-a059-9160a2e871de tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:42:14.903389 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-ec593d87-cb99-4c5d-a059-9160a2e871de tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:42:14.904306 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-ec593d87-cb99-4c5d-a059-9160a2e871de tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:42:14.904757 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-ec593d87-cb99-4c5d-a059-9160a2e871de tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:42:14.908032 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-6837dfc0-22d3-4f1a-89f3-531e1125e63e tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:42:14.908445 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-6837dfc0-22d3-4f1a-89f3-531e1125e63e tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:42:14.909358 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-6837dfc0-22d3-4f1a-89f3-531e1125e63e tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:42:14.912059 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-6837dfc0-22d3-4f1a-89f3-531e1125e63e tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:42:15.193298 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-ec593d87-cb99-4c5d-a059-9160a2e871de tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3170dc3323f54512bc8819c8efa86b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7121bd118a2549c39332cfdb7edaa92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:42:15.202184 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-ec593d87-cb99-4c5d-a059-9160a2e871de tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] 10.222.0.121 "GET /compute/v2.1/servers/9b09b542-5b10-4244-88af-cb6de23588d8" status: 200 len: 1525 microversion: 2.1 time: 0.311780 Aug 04 10:42:15.202851 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 430/853] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:42:14 2022] GET /compute/v2.1/servers/9b09b542-5b10-4244-88af-cb6de23588d8 => generated 1525 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:42:15.203294 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-6837dfc0-22d3-4f1a-89f3-531e1125e63e tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6921033062424e14bc30f9b94bf911db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bee0d982e3ba4f7dba65f51636856b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:42:15.210251 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-b613071c-27d7-4db3-8151-e6b63b057503 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:42:15.211343 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-b613071c-27d7-4db3-8151-e6b63b057503 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] [instance: 1f24d364-de0b-4fc9-81d6-463fd637722c] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:42:15.217960 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-6837dfc0-22d3-4f1a-89f3-531e1125e63e tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] 10.222.0.121 "GET /compute/v2.1/servers/ec14be1f-7e78-45e3-a70a-587a47b2d1c9" status: 200 len: 1577 microversion: 2.1 time: 0.326376 Aug 04 10:42:15.219080 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 424/854] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:42:14 2022] GET /compute/v2.1/servers/ec14be1f-7e78-45e3-a70a-587a47b2d1c9 => generated 1577 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:42:15.221205 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-b613071c-27d7-4db3-8151-e6b63b057503 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:42:15.221820 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-b613071c-27d7-4db3-8151-e6b63b057503 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:42:15.223114 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-b613071c-27d7-4db3-8151-e6b63b057503 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:42:15.224307 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-b613071c-27d7-4db3-8151-e6b63b057503 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:42:15.384443 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-b613071c-27d7-4db3-8151-e6b63b057503 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa2e2a5a6ed4c5c9db91269266dd30b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f46ab11dd0b428486c673afc14b5b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:42:15.393310 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-b613071c-27d7-4db3-8151-e6b63b057503 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] 10.222.0.121 "GET /compute/v2.1/servers/1f24d364-de0b-4fc9-81d6-463fd637722c" status: 200 len: 1367 microversion: 2.1 time: 0.188789 Aug 04 10:42:15.393954 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 431/855] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:42:15 2022] GET /compute/v2.1/servers/1f24d364-de0b-4fc9-81d6-463fd637722c => generated 1367 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:42:16.229345 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-d0b35788-ff6a-45b7-98d9-0a136cf4742a tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:42:16.230163 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-d0b35788-ff6a-45b7-98d9-0a136cf4742a tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] [instance: 9b09b542-5b10-4244-88af-cb6de23588d8] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:42:16.242310 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-52a52b2d-ed19-4a03-bb10-7e5815678dcb tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:42:16.243404 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-52a52b2d-ed19-4a03-bb10-7e5815678dcb tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] [instance: ec14be1f-7e78-45e3-a70a-587a47b2d1c9] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:42:16.251791 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-d0b35788-ff6a-45b7-98d9-0a136cf4742a tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:42:16.254934 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-d0b35788-ff6a-45b7-98d9-0a136cf4742a tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:42:16.255854 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-d0b35788-ff6a-45b7-98d9-0a136cf4742a tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:42:16.259341 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-d0b35788-ff6a-45b7-98d9-0a136cf4742a tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:42:16.266372 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-52a52b2d-ed19-4a03-bb10-7e5815678dcb tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:42:16.267158 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-52a52b2d-ed19-4a03-bb10-7e5815678dcb tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:42:16.268198 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-52a52b2d-ed19-4a03-bb10-7e5815678dcb tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:42:16.268796 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-52a52b2d-ed19-4a03-bb10-7e5815678dcb tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:42:16.450686 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG dbcounter [-] [124456] Writing DB stats nova_cell0:SELECT=2 {{(pid=124456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:42:16.655699 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG dbcounter [-] [124456] Writing DB stats nova_cell0:SELECT=8 {{(pid=124456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:42:16.675582 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-d0b35788-ff6a-45b7-98d9-0a136cf4742a tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3170dc3323f54512bc8819c8efa86b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7121bd118a2549c39332cfdb7edaa92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:42:16.690431 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-d0b35788-ff6a-45b7-98d9-0a136cf4742a tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] 10.222.0.121 "GET /compute/v2.1/servers/9b09b542-5b10-4244-88af-cb6de23588d8" status: 200 len: 1525 microversion: 2.1 time: 0.465989 Aug 04 10:42:16.691550 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 425/856] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:42:16 2022] GET /compute/v2.1/servers/9b09b542-5b10-4244-88af-cb6de23588d8 => generated 1525 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:42:16.701766 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-4f700267-fb6d-4472-bfc1-97561fe20263 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:42:16.703809 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-4f700267-fb6d-4472-bfc1-97561fe20263 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] [instance: 1f24d364-de0b-4fc9-81d6-463fd637722c] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:42:16.719069 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-4f700267-fb6d-4472-bfc1-97561fe20263 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:42:16.720374 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-4f700267-fb6d-4472-bfc1-97561fe20263 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:42:16.722431 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-4f700267-fb6d-4472-bfc1-97561fe20263 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:42:16.723587 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-4f700267-fb6d-4472-bfc1-97561fe20263 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:42:16.775102 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-52a52b2d-ed19-4a03-bb10-7e5815678dcb tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6921033062424e14bc30f9b94bf911db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bee0d982e3ba4f7dba65f51636856b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:42:16.784365 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-52a52b2d-ed19-4a03-bb10-7e5815678dcb tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] 10.222.0.121 "GET /compute/v2.1/servers/ec14be1f-7e78-45e3-a70a-587a47b2d1c9" status: 200 len: 1577 microversion: 2.1 time: 0.546284 Aug 04 10:42:16.785068 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 432/857] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:42:16 2022] GET /compute/v2.1/servers/ec14be1f-7e78-45e3-a70a-587a47b2d1c9 => generated 1577 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:42:16.789797 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [req-8eef36b5-14c3-45e4-8088-6801ebc9348a req-52d4f318-f84b-4647-8ee8-ec6f1bd04311 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f24d364-de0b-4fc9-81d6-463fd637722c", "name": "network-vif-plugged", "status": "completed", "tag": "fd99aa60-adfb-4fac-9ff3-016eace2d99d"}]} {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:42:16.802204 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [req-8eef36b5-14c3-45e4-8088-6801ebc9348a req-52d4f318-f84b-4647-8ee8-ec6f1bd04311 service nova] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:42:16.803094 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [req-8eef36b5-14c3-45e4-8088-6801ebc9348a req-52d4f318-f84b-4647-8ee8-ec6f1bd04311 service nova] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:42:16.818687 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.compute.server_external_events [req-8eef36b5-14c3-45e4-8088-6801ebc9348a req-52d4f318-f84b-4647-8ee8-ec6f1bd04311 service nova] Creating event network-vif-plugged:fd99aa60-adfb-4fac-9ff3-016eace2d99d for instance 1f24d364-de0b-4fc9-81d6-463fd637722c on hv-cinder-85200 Aug 04 10:42:16.827582 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [req-8eef36b5-14c3-45e4-8088-6801ebc9348a req-52d4f318-f84b-4647-8ee8-ec6f1bd04311 service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040857 Aug 04 10:42:16.829347 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 433/858] 10.222.0.121 () {64 vars in 1322 bytes} [Thu Aug 4 10:42:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:42:16.953908 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [req-fc18c6df-8dd5-401a-bd8c-1582b42b3e24 req-d295673c-f9f4-4a3d-87cb-cb34269be562 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b09b542-5b10-4244-88af-cb6de23588d8", "name": "network-vif-deleted", "tag": "d8ed119b-b3f2-4fd9-99a2-09f4903e50d6"}]} {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:42:16.976082 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [req-fc18c6df-8dd5-401a-bd8c-1582b42b3e24 req-d295673c-f9f4-4a3d-87cb-cb34269be562 service nova] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:42:16.977065 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [req-fc18c6df-8dd5-401a-bd8c-1582b42b3e24 req-d295673c-f9f4-4a3d-87cb-cb34269be562 service nova] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:42:17.001539 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.compute.server_external_events [req-fc18c6df-8dd5-401a-bd8c-1582b42b3e24 req-d295673c-f9f4-4a3d-87cb-cb34269be562 service nova] Creating event network-vif-deleted:d8ed119b-b3f2-4fd9-99a2-09f4903e50d6 for instance 9b09b542-5b10-4244-88af-cb6de23588d8 on hv-cinder-85200 Aug 04 10:42:17.011937 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [req-fc18c6df-8dd5-401a-bd8c-1582b42b3e24 req-d295673c-f9f4-4a3d-87cb-cb34269be562 service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065324 Aug 04 10:42:17.013325 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 434/859] 10.222.0.121 () {64 vars in 1322 bytes} [Thu Aug 4 10:42:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 10:42:17.026700 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-4f700267-fb6d-4472-bfc1-97561fe20263 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa2e2a5a6ed4c5c9db91269266dd30b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f46ab11dd0b428486c673afc14b5b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:42:17.037094 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-4f700267-fb6d-4472-bfc1-97561fe20263 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] 10.222.0.121 "GET /compute/v2.1/servers/1f24d364-de0b-4fc9-81d6-463fd637722c" status: 200 len: 1367 microversion: 2.1 time: 0.343515 Aug 04 10:42:17.037975 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 426/860] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:42:16 2022] GET /compute/v2.1/servers/1f24d364-de0b-4fc9-81d6-463fd637722c => generated 1367 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:42:17.732022 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-536fdba7-9af1-453a-b3b2-007587241110 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:42:17.732762 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-536fdba7-9af1-453a-b3b2-007587241110 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] [instance: 9b09b542-5b10-4244-88af-cb6de23588d8] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:42:17.740947 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-536fdba7-9af1-453a-b3b2-007587241110 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:42:17.741435 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-536fdba7-9af1-453a-b3b2-007587241110 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:42:17.742404 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-536fdba7-9af1-453a-b3b2-007587241110 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:42:17.742866 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-536fdba7-9af1-453a-b3b2-007587241110 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:42:17.815382 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-d7af0b68-8351-4c85-b65c-4fd2afaa7816 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:42:17.816162 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-d7af0b68-8351-4c85-b65c-4fd2afaa7816 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] [instance: ec14be1f-7e78-45e3-a70a-587a47b2d1c9] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:42:17.824266 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-d7af0b68-8351-4c85-b65c-4fd2afaa7816 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:42:17.824731 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-d7af0b68-8351-4c85-b65c-4fd2afaa7816 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:42:17.825581 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-d7af0b68-8351-4c85-b65c-4fd2afaa7816 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:42:17.826066 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-d7af0b68-8351-4c85-b65c-4fd2afaa7816 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:42:17.945165 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-536fdba7-9af1-453a-b3b2-007587241110 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:42:17.945680 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-536fdba7-9af1-453a-b3b2-007587241110 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:42:17.946125 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.objects.instance [None req-536fdba7-9af1-453a-b3b2-007587241110 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lazy-loading 'fault' on Instance uuid 9b09b542-5b10-4244-88af-cb6de23588d8 {{(pid=124457) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 10:42:18.003807 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-536fdba7-9af1-453a-b3b2-007587241110 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3170dc3323f54512bc8819c8efa86b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7121bd118a2549c39332cfdb7edaa92f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:42:18.013046 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-536fdba7-9af1-453a-b3b2-007587241110 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] 10.222.0.121 "GET /compute/v2.1/servers/9b09b542-5b10-4244-88af-cb6de23588d8" status: 200 len: 1315 microversion: 2.1 time: 0.285399 Aug 04 10:42:18.013898 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 435/861] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:42:17 2022] GET /compute/v2.1/servers/9b09b542-5b10-4244-88af-cb6de23588d8 => generated 1315 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:42:18.024219 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-d7af0b68-8351-4c85-b65c-4fd2afaa7816 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6921033062424e14bc30f9b94bf911db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bee0d982e3ba4f7dba65f51636856b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:42:18.032522 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-d7af0b68-8351-4c85-b65c-4fd2afaa7816 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] 10.222.0.121 "GET /compute/v2.1/servers/ec14be1f-7e78-45e3-a70a-587a47b2d1c9" status: 200 len: 1577 microversion: 2.1 time: 0.221444 Aug 04 10:42:18.033126 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 427/862] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:42:17 2022] GET /compute/v2.1/servers/ec14be1f-7e78-45e3-a70a-587a47b2d1c9 => generated 1577 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:42:18.061743 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-a468f506-dc14-4525-b59f-a4651e270021 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:42:18.062295 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-a468f506-dc14-4525-b59f-a4651e270021 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] [instance: 1f24d364-de0b-4fc9-81d6-463fd637722c] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:42:18.069411 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-a468f506-dc14-4525-b59f-a4651e270021 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:42:18.069891 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-a468f506-dc14-4525-b59f-a4651e270021 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:42:18.070771 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-a468f506-dc14-4525-b59f-a4651e270021 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:42:18.071226 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-a468f506-dc14-4525-b59f-a4651e270021 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:42:18.217121 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-a468f506-dc14-4525-b59f-a4651e270021 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa2e2a5a6ed4c5c9db91269266dd30b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f46ab11dd0b428486c673afc14b5b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:42:18.225673 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-a468f506-dc14-4525-b59f-a4651e270021 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] 10.222.0.121 "GET /compute/v2.1/servers/1f24d364-de0b-4fc9-81d6-463fd637722c" status: 200 len: 1367 microversion: 2.1 time: 0.168782 Aug 04 10:42:18.226219 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 436/863] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:42:18 2022] GET /compute/v2.1/servers/1f24d364-de0b-4fc9-81d6-463fd637722c => generated 1367 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:42:18.845732 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [req-a98cf0f5-0a6b-458d-991c-b3f79c0f0123 req-1a647f51-368f-4607-b027-028a4973e0db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec14be1f-7e78-45e3-a70a-587a47b2d1c9", "name": "network-vif-plugged", "status": "completed", "tag": "c3025d1c-cab8-4711-9bcc-0663813275c3"}]} {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:42:18.857323 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [req-a98cf0f5-0a6b-458d-991c-b3f79c0f0123 req-1a647f51-368f-4607-b027-028a4973e0db service nova] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:42:18.857779 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [req-a98cf0f5-0a6b-458d-991c-b3f79c0f0123 req-1a647f51-368f-4607-b027-028a4973e0db service nova] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:42:18.870199 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.compute.server_external_events [req-a98cf0f5-0a6b-458d-991c-b3f79c0f0123 req-1a647f51-368f-4607-b027-028a4973e0db service nova] Creating event network-vif-plugged:c3025d1c-cab8-4711-9bcc-0663813275c3 for instance ec14be1f-7e78-45e3-a70a-587a47b2d1c9 on hv-cinder-85200 Aug 04 10:42:18.876598 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [req-a98cf0f5-0a6b-458d-991c-b3f79c0f0123 req-1a647f51-368f-4607-b027-028a4973e0db service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035502 Aug 04 10:42:18.877551 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 428/864] 10.222.0.121 () {64 vars in 1322 bytes} [Thu Aug 4 10:42:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:42:19.036668 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-4245660b-bcbc-4905-b128-5a906a755e34 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:42:19.037471 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-4245660b-bcbc-4905-b128-5a906a755e34 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] [instance: 9b09b542-5b10-4244-88af-cb6de23588d8] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:42:19.044577 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-4245660b-bcbc-4905-b128-5a906a755e34 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:42:19.045042 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-4245660b-bcbc-4905-b128-5a906a755e34 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:42:19.045833 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-4245660b-bcbc-4905-b128-5a906a755e34 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:42:19.046364 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-4245660b-bcbc-4905-b128-5a906a755e34 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:42:19.056690 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-fe1462b3-7e98-42ef-8335-d84d8c4715f1 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:42:19.057696 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-fe1462b3-7e98-42ef-8335-d84d8c4715f1 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] [instance: ec14be1f-7e78-45e3-a70a-587a47b2d1c9] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:42:19.062446 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.wsgi [None req-4245660b-bcbc-4905-b128-5a906a755e34 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] HTTP exception thrown: Instance 9b09b542-5b10-4244-88af-cb6de23588d8 could not be found. Aug 04 10:42:19.064253 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-4245660b-bcbc-4905-b128-5a906a755e34 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Request method failure captured: Aug 04 10:42:19.064253 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: request: GET /compute/v2.1/servers/9b09b542-5b10-4244-88af-cb6de23588d8 HTTP/1.1 Aug 04 10:42:19.064253 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: Accept: application/json Aug 04 10:42:19.064253 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: Accept-Encoding: identity Aug 04 10:42:19.064253 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: Connection: close Aug 04 10:42:19.064253 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: Content-Length: 0 Aug 04 10:42:19.064253 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: Content-Type: application/json Aug 04 10:42:19.064253 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: Host: 10.222.0.121 Aug 04 10:42:19.064253 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: Openstack-System-Scope: None Aug 04 10:42:19.064253 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: User-Agent: python-urllib3/1.26.11 Aug 04 10:42:19.064253 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Auth-Token: gAAAAABi66Bc3v4QS1FtUMzLABOQnByGgDiNvJ-JvGmdBDVbq6x7lQW47g6_YVrbEeRME3TfDfNZZQZzvek1irFXoT0OrvdtDRcHao-WSK1U1LXxlYJ7lzEubI7Szk80hERaW5e12YVPeHwUKRft5YXP3uZ6ZxfgU3B2fGKT8Q_qAH4d7HdL2nw Aug 04 10:42:19.064253 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Domain-Id: None Aug 04 10:42:19.064253 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Domain-Name: None Aug 04 10:42:19.064253 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Identity-Status: Confirmed Aug 04 10:42:19.064253 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Is-Admin-Project: True Aug 04 10:42:19.064253 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Project-Domain-Id: default Aug 04 10:42:19.064253 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Project-Domain-Name: Default Aug 04 10:42:19.064253 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Project-Id: 7121bd118a2549c39332cfdb7edaa92f Aug 04 10:42:19.064253 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-47221404 Aug 04 10:42:19.064253 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Role: reader,member Aug 04 10:42:19.064253 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Roles: reader,member Aug 04 10:42:19.067215 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/7121bd118a2549c39332cfdb7edaa92f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/7121bd118a2549c39332cfdb7edaa92f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.121:8080", "publicURL": "http://10.222.0.121:8080/v1/AUTH_7121bd118a2549c39332cfdb7edaa92f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2/7121bd118a2549c39332cfdb7edaa92f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:9696/networking"}]}] Aug 04 10:42:19.067215 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Tenant: tempest-ServerRescueNegativeTestJSON-47221404 Aug 04 10:42:19.067215 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Tenant-Id: 7121bd118a2549c39332cfdb7edaa92f Aug 04 10:42:19.067215 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-47221404 Aug 04 10:42:19.067215 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-User: tempest-ServerRescueNegativeTestJSON-47221404-project Aug 04 10:42:19.067215 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-User-Domain-Id: default Aug 04 10:42:19.067215 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-User-Domain-Name: Default Aug 04 10:42:19.067215 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-User-Id: 3170dc3323f54512bc8819c8efa86b0f Aug 04 10:42:19.067215 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-User-Name: tempest-ServerRescueNegativeTestJSON-47221404-project Aug 04 10:42:19.067215 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: method: > Aug 04 10:42:19.067215 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: exception: Instance 9b09b542-5b10-4244-88af-cb6de23588d8 could not be found. Aug 04 10:42:19.067215 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: action_args: {'id': '9b09b542-5b10-4244-88af-cb6de23588d8'} Aug 04 10:42:19.069098 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 10:42:19.069098 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:42:19.069098 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 10:42:19.069098 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 10:42:19.069098 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 10:42:19.069098 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 10:42:19.069098 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 10:42:19.069098 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 10:42:19.069098 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 10:42:19.069098 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 10:42:19.069098 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9b09b542-5b10-4244-88af-cb6de23588d8 could not be found. Aug 04 10:42:19.069098 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Aug 04 10:42:19.069098 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:42:19.069098 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Aug 04 10:42:19.069098 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:42:19.069098 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:42:19.069098 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:42:19.069098 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 10:42:19.069098 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 10:42:19.069098 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 10:42:19.072252 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 10:42:19.072252 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 10:42:19.072252 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 10:42:19.072252 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 10:42:19.072252 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 10:42:19.072252 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 10:42:19.072252 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 10:42:19.072252 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9b09b542-5b10-4244-88af-cb6de23588d8 could not be found. Aug 04 10:42:19.072252 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Aug 04 10:42:19.072252 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:42:19.072252 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Aug 04 10:42:19.072252 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:42:19.072252 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:42:19.072252 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:42:19.072252 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 10:42:19.072252 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 10:42:19.072252 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9b09b542-5b10-4244-88af-cb6de23588d8 could not be found. Aug 04 10:42:19.072252 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Aug 04 10:42:19.075694 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-4245660b-bcbc-4905-b128-5a906a755e34 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] Returning 404 to user: Instance 9b09b542-5b10-4244-88af-cb6de23588d8 could not be found. {{(pid=124457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 10:42:19.075694 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-4245660b-bcbc-4905-b128-5a906a755e34 tempest-ServerRescueNegativeTestJSON-47221404 tempest-ServerRescueNegativeTestJSON-47221404-project] 10.222.0.121 "GET /compute/v2.1/servers/9b09b542-5b10-4244-88af-cb6de23588d8" status: 404 len: 111 microversion: 2.1 time: 0.033316 Aug 04 10:42:19.075694 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 437/865] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:42:19 2022] GET /compute/v2.1/servers/9b09b542-5b10-4244-88af-cb6de23588d8 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 10:42:19.076744 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-fe1462b3-7e98-42ef-8335-d84d8c4715f1 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:42:19.076744 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-fe1462b3-7e98-42ef-8335-d84d8c4715f1 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:42:19.076744 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-fe1462b3-7e98-42ef-8335-d84d8c4715f1 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:42:19.076744 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-fe1462b3-7e98-42ef-8335-d84d8c4715f1 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:42:19.247531 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-19750713-f087-45eb-a01f-20d02b213575 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:42:19.248631 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-19750713-f087-45eb-a01f-20d02b213575 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] [instance: 1f24d364-de0b-4fc9-81d6-463fd637722c] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:42:19.256893 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-19750713-f087-45eb-a01f-20d02b213575 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:42:19.257353 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-19750713-f087-45eb-a01f-20d02b213575 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:42:19.260695 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-19750713-f087-45eb-a01f-20d02b213575 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:42:19.261301 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-19750713-f087-45eb-a01f-20d02b213575 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:42:19.267784 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-fe1462b3-7e98-42ef-8335-d84d8c4715f1 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6921033062424e14bc30f9b94bf911db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bee0d982e3ba4f7dba65f51636856b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:42:19.279889 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-fe1462b3-7e98-42ef-8335-d84d8c4715f1 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] 10.222.0.121 "GET /compute/v2.1/servers/ec14be1f-7e78-45e3-a70a-587a47b2d1c9" status: 200 len: 1577 microversion: 2.1 time: 0.227964 Aug 04 10:42:19.283103 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 429/866] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:42:19 2022] GET /compute/v2.1/servers/ec14be1f-7e78-45e3-a70a-587a47b2d1c9 => generated 1577 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 10:42:19.476193 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-19750713-f087-45eb-a01f-20d02b213575 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa2e2a5a6ed4c5c9db91269266dd30b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f46ab11dd0b428486c673afc14b5b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:42:19.489438 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-19750713-f087-45eb-a01f-20d02b213575 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] 10.222.0.121 "GET /compute/v2.1/servers/1f24d364-de0b-4fc9-81d6-463fd637722c" status: 200 len: 1367 microversion: 2.1 time: 0.245782 Aug 04 10:42:19.491478 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 438/867] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:42:19 2022] GET /compute/v2.1/servers/1f24d364-de0b-4fc9-81d6-463fd637722c => generated 1367 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:42:20.305746 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-5568922e-c8a1-4c81-b95b-4c9566eaf0ea tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:42:20.306536 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-5568922e-c8a1-4c81-b95b-4c9566eaf0ea tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] [instance: ec14be1f-7e78-45e3-a70a-587a47b2d1c9] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:42:20.321755 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-5568922e-c8a1-4c81-b95b-4c9566eaf0ea tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:42:20.322211 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-5568922e-c8a1-4c81-b95b-4c9566eaf0ea tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:42:20.323051 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-5568922e-c8a1-4c81-b95b-4c9566eaf0ea tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:42:20.323496 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-5568922e-c8a1-4c81-b95b-4c9566eaf0ea tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:42:20.514865 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-c0503445-7f3e-494f-b3ad-61e7cfcd6c72 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:42:20.515793 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-c0503445-7f3e-494f-b3ad-61e7cfcd6c72 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] [instance: 1f24d364-de0b-4fc9-81d6-463fd637722c] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:42:20.528203 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-c0503445-7f3e-494f-b3ad-61e7cfcd6c72 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:42:20.528967 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-c0503445-7f3e-494f-b3ad-61e7cfcd6c72 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:42:20.530659 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-c0503445-7f3e-494f-b3ad-61e7cfcd6c72 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:42:20.531113 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-c0503445-7f3e-494f-b3ad-61e7cfcd6c72 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:42:20.706159 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-5568922e-c8a1-4c81-b95b-4c9566eaf0ea tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6921033062424e14bc30f9b94bf911db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bee0d982e3ba4f7dba65f51636856b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:42:20.715904 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-5568922e-c8a1-4c81-b95b-4c9566eaf0ea tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] 10.222.0.121 "GET /compute/v2.1/servers/ec14be1f-7e78-45e3-a70a-587a47b2d1c9" status: 200 len: 1577 microversion: 2.1 time: 0.414519 Aug 04 10:42:20.718263 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 430/868] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:42:20 2022] GET /compute/v2.1/servers/ec14be1f-7e78-45e3-a70a-587a47b2d1c9 => generated 1577 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:42:20.755069 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-c0503445-7f3e-494f-b3ad-61e7cfcd6c72 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa2e2a5a6ed4c5c9db91269266dd30b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f46ab11dd0b428486c673afc14b5b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:42:20.765595 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-c0503445-7f3e-494f-b3ad-61e7cfcd6c72 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] 10.222.0.121 "GET /compute/v2.1/servers/1f24d364-de0b-4fc9-81d6-463fd637722c" status: 200 len: 1551 microversion: 2.1 time: 0.255416 Aug 04 10:42:20.766182 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 439/869] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:42:20 2022] GET /compute/v2.1/servers/1f24d364-de0b-4fc9-81d6-463fd637722c => generated 1551 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:42:20.786937 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-b16c4d6c-6937-403f-bce7-844156a8cc8e tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:42:20.787457 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-b16c4d6c-6937-403f-bce7-844156a8cc8e tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] [instance: 1f24d364-de0b-4fc9-81d6-463fd637722c] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:42:20.794969 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-b16c4d6c-6937-403f-bce7-844156a8cc8e tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:42:20.795433 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-b16c4d6c-6937-403f-bce7-844156a8cc8e tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:42:20.796428 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-b16c4d6c-6937-403f-bce7-844156a8cc8e tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:42:20.796876 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-b16c4d6c-6937-403f-bce7-844156a8cc8e tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:42:20.896609 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-b16c4d6c-6937-403f-bce7-844156a8cc8e tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] 10.222.0.121 "GET /compute/v2.1/servers/1f24d364-de0b-4fc9-81d6-463fd637722c/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.113585 Aug 04 10:42:20.898121 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 431/870] 10.222.0.121 () {58 vars in 1280 bytes} [Thu Aug 4 10:42:20 2022] GET /compute/v2.1/servers/1f24d364-de0b-4fc9-81d6-463fd637722c/os-interface => generated 284 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 10:42:21.744009 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-2d9a4cda-956d-4f70-aaa0-fb7c19b96743 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:42:21.745163 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-2d9a4cda-956d-4f70-aaa0-fb7c19b96743 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] [instance: ec14be1f-7e78-45e3-a70a-587a47b2d1c9] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:42:21.760498 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-2d9a4cda-956d-4f70-aaa0-fb7c19b96743 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:42:21.762260 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-2d9a4cda-956d-4f70-aaa0-fb7c19b96743 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:42:21.763734 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-2d9a4cda-956d-4f70-aaa0-fb7c19b96743 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:42:21.764587 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-2d9a4cda-956d-4f70-aaa0-fb7c19b96743 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:42:22.112721 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-2d9a4cda-956d-4f70-aaa0-fb7c19b96743 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6921033062424e14bc30f9b94bf911db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bee0d982e3ba4f7dba65f51636856b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:42:22.122765 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-2d9a4cda-956d-4f70-aaa0-fb7c19b96743 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] 10.222.0.121 "GET /compute/v2.1/servers/ec14be1f-7e78-45e3-a70a-587a47b2d1c9" status: 200 len: 1564 microversion: 2.1 time: 0.386389 Aug 04 10:42:22.123543 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 440/871] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:42:21 2022] GET /compute/v2.1/servers/ec14be1f-7e78-45e3-a70a-587a47b2d1c9 => generated 1564 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:42:22.414438 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [req-e7f04869-39c1-460d-be2b-61b58d627459 req-a9207fff-f1ab-4dc9-9eac-eb4180fe0396 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f24d364-de0b-4fc9-81d6-463fd637722c", "tag": "fd99aa60-adfb-4fac-9ff3-016eace2d99d"}]} {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:42:22.428436 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [req-e7f04869-39c1-460d-be2b-61b58d627459 req-a9207fff-f1ab-4dc9-9eac-eb4180fe0396 service nova] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:42:22.428974 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [req-e7f04869-39c1-460d-be2b-61b58d627459 req-a9207fff-f1ab-4dc9-9eac-eb4180fe0396 service nova] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:42:22.445760 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.compute.server_external_events [req-e7f04869-39c1-460d-be2b-61b58d627459 req-a9207fff-f1ab-4dc9-9eac-eb4180fe0396 service nova] Creating event network-changed:fd99aa60-adfb-4fac-9ff3-016eace2d99d for instance 1f24d364-de0b-4fc9-81d6-463fd637722c on hv-cinder-85200 Aug 04 10:42:22.452679 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [req-e7f04869-39c1-460d-be2b-61b58d627459 req-a9207fff-f1ab-4dc9-9eac-eb4180fe0396 service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043621 Aug 04 10:42:22.453685 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 432/872] 10.222.0.121 () {64 vars in 1322 bytes} [Thu Aug 4 10:42:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:42:29.820987 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-ca8eecd7-d443-4b3a-94c9-79f81b16f82b tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Action: 'create', calling method: .version_select at 0x7f6754ed0a60>, body: {"keypair": {"name": "tempest-keypair-97523757", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFc/EdUMf5W+cvIRIjGoaK885lzymDvRMGJzIwiAgxaFOImrSsOs0BaVMcIXDCbU4AqAVJBuFCxAQc6xk1xaXTJl+9PHOIEeH5ncENs2bJS0jp6RU0vTuVDhtEOAWCU+zQ=="}} {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:42:29.843413 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.quota [None req-ca8eecd7-d443-4b3a-94c9-79f81b16f82b tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Getting quotas for project 18d95fd38a664ce1b69afbb11189020a. Resources: {'key_pairs'} {{(pid=124457) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 10:42:29.847798 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.quota [None req-ca8eecd7-d443-4b3a-94c9-79f81b16f82b tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Getting quotas for user f2c14f2350dd450b846db0c22c43688b and project 18d95fd38a664ce1b69afbb11189020a. Resources: {'key_pairs'} {{(pid=124457) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 10:42:29.886365 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-ca8eecd7-d443-4b3a-94c9-79f81b16f82b tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] 10.222.0.121 "POST /compute/v2.1/os-keypairs" status: 201 len: 399 microversion: 2.20 time: 0.213268 Aug 04 10:42:29.888001 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 441/873] 10.222.0.121 () {62 vars in 1205 bytes} [Thu Aug 4 10:42:29 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 215 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 04 10:42:31.826353 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-21554cff-775e-45d7-84e6-b03cce167ca0 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-865298043", "imageRef": "46724bb5-955f-4f3f-bd6a-b561fdde55e3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0d806319-6112-4986-8f37-97e9e0b31209"}], "security_groups": [{"name": "tempest-securitygroup--247027127"}], "key_name": "tempest-keypair-97523757", "user_data": "}} {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:42:31.952370 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.network.neutron [None req-21554cff-775e-45d7-84e6-b03cce167ca0 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] validate_networks() for [('0d806319-6112-4986-8f37-97e9e0b31209', None, None, None, None, None)] {{(pid=124456) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 10:42:32.372289 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.virt.hardware [None req-21554cff-775e-45d7-84e6-b03cce167ca0 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Flavor limits 0:0:0 {{(pid=124456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 10:42:32.372699 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.virt.hardware [None req-21554cff-775e-45d7-84e6-b03cce167ca0 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Image limits 0:0:0 {{(pid=124456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 10:42:32.373170 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.virt.hardware [None req-21554cff-775e-45d7-84e6-b03cce167ca0 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Flavor pref 0:0:0 {{(pid=124456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 10:42:32.373631 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.virt.hardware [None req-21554cff-775e-45d7-84e6-b03cce167ca0 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Image pref 0:0:0 {{(pid=124456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 10:42:32.374070 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.virt.hardware [None req-21554cff-775e-45d7-84e6-b03cce167ca0 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 10:42:32.384254 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-21554cff-775e-45d7-84e6-b03cce167ca0 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:42:32.384711 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-21554cff-775e-45d7-84e6-b03cce167ca0 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:42:32.385526 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-21554cff-775e-45d7-84e6-b03cce167ca0 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:42:32.385970 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-21554cff-775e-45d7-84e6-b03cce167ca0 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:42:32.404703 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.quota [None req-21554cff-775e-45d7-84e6-b03cce167ca0 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Getting quotas for project 18d95fd38a664ce1b69afbb11189020a. Resources: {'ram', 'instances', 'cores'} {{(pid=124456) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 10:42:32.409136 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.quota [None req-21554cff-775e-45d7-84e6-b03cce167ca0 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Getting quotas for user f2c14f2350dd450b846db0c22c43688b and project 18d95fd38a664ce1b69afbb11189020a. Resources: {'ram', 'instances', 'cores'} {{(pid=124456) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 10:42:32.420918 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-21554cff-775e-45d7-84e6-b03cce167ca0 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Going to run 1 instances... {{(pid=124456) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 10:42:32.423324 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-21554cff-775e-45d7-84e6-b03cce167ca0 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] [instance: b0d153c5-90d0-4814-92ec-6f237601def9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='46724bb5-955f-4f3f-bd6a-b561fdde55e3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124456) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 10:42:32.478130 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-21554cff-775e-45d7-84e6-b03cce167ca0 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] 10.222.0.121 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.20 time: 0.658060 Aug 04 10:42:32.478790 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 433/874] 10.222.0.121 () {62 vars in 1193 bytes} [Thu Aug 4 10:42:31 2022] POST /compute/v2.1/servers => generated 403 bytes in 660 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Aug 04 10:42:32.490864 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-2df04e79-44e1-4f57-8159-da4421b06400 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:42:32.492585 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-2df04e79-44e1-4f57-8159-da4421b06400 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] [instance: b0d153c5-90d0-4814-92ec-6f237601def9] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:42:32.522414 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG dbcounter [-] [124457] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:42:32.590816 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-2df04e79-44e1-4f57-8159-da4421b06400 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:42:32.600569 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-2df04e79-44e1-4f57-8159-da4421b06400 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:42:32.602144 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-2df04e79-44e1-4f57-8159-da4421b06400 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:42:32.603515 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-2df04e79-44e1-4f57-8159-da4421b06400 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] 10.222.0.121 "GET /compute/v2.1/servers/b0d153c5-90d0-4814-92ec-6f237601def9" status: 200 len: 1283 microversion: 2.20 time: 0.117162 Aug 04 10:42:32.604203 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 442/875] 10.222.0.121 () {60 vars in 1282 bytes} [Thu Aug 4 10:42:32 2022] GET /compute/v2.1/servers/b0d153c5-90d0-4814-92ec-6f237601def9 => generated 1283 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:42:33.629167 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-56d6e18e-785c-480c-b758-7c38ee5cf71e tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:42:33.630544 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-56d6e18e-785c-480c-b758-7c38ee5cf71e tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] [instance: b0d153c5-90d0-4814-92ec-6f237601def9] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:42:33.638329 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-56d6e18e-785c-480c-b758-7c38ee5cf71e tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:42:33.638749 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-56d6e18e-785c-480c-b758-7c38ee5cf71e tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:42:33.639576 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-56d6e18e-785c-480c-b758-7c38ee5cf71e tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:42:33.640025 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-56d6e18e-785c-480c-b758-7c38ee5cf71e tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:42:33.689573 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-901bbfdc-5127-48bc-bec2-7b75a99811ce tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:42:33.690284 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-901bbfdc-5127-48bc-bec2-7b75a99811ce tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] [instance: aca71cfb-26a8-4881-af52-7a1c370fee28] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:42:33.699640 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-901bbfdc-5127-48bc-bec2-7b75a99811ce tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:42:33.700209 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-901bbfdc-5127-48bc-bec2-7b75a99811ce tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:42:33.701742 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-901bbfdc-5127-48bc-bec2-7b75a99811ce tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:42:33.707789 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-901bbfdc-5127-48bc-bec2-7b75a99811ce tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:42:33.717842 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-56d6e18e-785c-480c-b758-7c38ee5cf71e tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:42:33.728012 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-56d6e18e-785c-480c-b758-7c38ee5cf71e tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:42:33.730252 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-56d6e18e-785c-480c-b758-7c38ee5cf71e tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:42:33.731426 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-56d6e18e-785c-480c-b758-7c38ee5cf71e tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] 10.222.0.121 "GET /compute/v2.1/servers/b0d153c5-90d0-4814-92ec-6f237601def9" status: 200 len: 1335 microversion: 2.20 time: 0.107745 Aug 04 10:42:33.732295 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 434/876] 10.222.0.121 () {60 vars in 1282 bytes} [Thu Aug 4 10:42:33 2022] GET /compute/v2.1/servers/b0d153c5-90d0-4814-92ec-6f237601def9 => generated 1335 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:42:33.757834 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-901bbfdc-5127-48bc-bec2-7b75a99811ce tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] 10.222.0.121 "GET /compute/v2.1/servers/aca71cfb-26a8-4881-af52-7a1c370fee28/ips" status: 200 len: 150 microversion: 2.1 time: 0.072158 Aug 04 10:42:33.765667 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 443/877] 10.222.0.121 () {58 vars in 1253 bytes} [Thu Aug 4 10:42:33 2022] GET /compute/v2.1/servers/aca71cfb-26a8-4881-af52-7a1c370fee28/ips => generated 150 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:42:34.756935 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-2e4031a8-4c3c-4de1-b0de-31a1027ebb9f tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:42:34.757879 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-2e4031a8-4c3c-4de1-b0de-31a1027ebb9f tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] [instance: b0d153c5-90d0-4814-92ec-6f237601def9] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:42:34.767001 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-2e4031a8-4c3c-4de1-b0de-31a1027ebb9f tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:42:34.767816 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-2e4031a8-4c3c-4de1-b0de-31a1027ebb9f tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:42:34.768845 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-2e4031a8-4c3c-4de1-b0de-31a1027ebb9f tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:42:34.769277 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-2e4031a8-4c3c-4de1-b0de-31a1027ebb9f tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:42:35.017304 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-2e4031a8-4c3c-4de1-b0de-31a1027ebb9f tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:42:35.028922 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-2e4031a8-4c3c-4de1-b0de-31a1027ebb9f tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:42:35.030514 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-2e4031a8-4c3c-4de1-b0de-31a1027ebb9f tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:42:35.032147 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-2e4031a8-4c3c-4de1-b0de-31a1027ebb9f tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] 10.222.0.121 "GET /compute/v2.1/servers/b0d153c5-90d0-4814-92ec-6f237601def9" status: 200 len: 1408 microversion: 2.20 time: 0.280000 Aug 04 10:42:35.047884 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 435/878] 10.222.0.121 () {60 vars in 1282 bytes} [Thu Aug 4 10:42:34 2022] GET /compute/v2.1/servers/b0d153c5-90d0-4814-92ec-6f237601def9 => generated 1408 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:42:35.204118 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-ec4541cb-874a-47b2-95a8-6d7f27c6d900 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3985c612-86d3-4c83-81f9-e46a7681a1b3"}} {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:42:35.206687 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-ec4541cb-874a-47b2-95a8-6d7f27c6d900 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] [instance: aca71cfb-26a8-4881-af52-7a1c370fee28] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:42:35.213883 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-ec4541cb-874a-47b2-95a8-6d7f27c6d900 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:42:35.214334 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-ec4541cb-874a-47b2-95a8-6d7f27c6d900 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:42:35.215122 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-ec4541cb-874a-47b2-95a8-6d7f27c6d900 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:42:35.215541 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-ec4541cb-874a-47b2-95a8-6d7f27c6d900 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:42:35.546692 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-ec4541cb-874a-47b2-95a8-6d7f27c6d900 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] 10.222.0.121 "POST /compute/v2.1/servers/aca71cfb-26a8-4881-af52-7a1c370fee28/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.346582 Aug 04 10:42:35.548089 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 444/879] 10.222.0.121 () {60 vars in 1328 bytes} [Thu Aug 4 10:42:35 2022] POST /compute/v2.1/servers/aca71cfb-26a8-4881-af52-7a1c370fee28/os-volume_attachments => generated 194 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 10:42:35.709537 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [req-96fb8f7b-7ece-468a-84f8-dfd5227320ae req-560651dc-2554-429a-a585-7927cba6ccd1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b0d153c5-90d0-4814-92ec-6f237601def9", "tag": "800ffaa9-8acb-4634-8260-3d89de6eccd5"}]} {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:42:35.720817 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [req-96fb8f7b-7ece-468a-84f8-dfd5227320ae req-560651dc-2554-429a-a585-7927cba6ccd1 service nova] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:42:35.721252 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [req-96fb8f7b-7ece-468a-84f8-dfd5227320ae req-560651dc-2554-429a-a585-7927cba6ccd1 service nova] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:42:35.734403 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.compute.server_external_events [req-96fb8f7b-7ece-468a-84f8-dfd5227320ae req-560651dc-2554-429a-a585-7927cba6ccd1 service nova] Creating event network-changed:800ffaa9-8acb-4634-8260-3d89de6eccd5 for instance b0d153c5-90d0-4814-92ec-6f237601def9 on hv-cinder-85200 Aug 04 10:42:35.741006 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [req-96fb8f7b-7ece-468a-84f8-dfd5227320ae req-560651dc-2554-429a-a585-7927cba6ccd1 service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035116 Aug 04 10:42:35.742268 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 436/880] 10.222.0.121 () {64 vars in 1322 bytes} [Thu Aug 4 10:42:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:42:36.057519 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-070f4821-a770-4232-8e5b-b9f3607ba258 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:42:36.058620 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-070f4821-a770-4232-8e5b-b9f3607ba258 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] [instance: b0d153c5-90d0-4814-92ec-6f237601def9] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:42:36.068282 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-070f4821-a770-4232-8e5b-b9f3607ba258 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:42:36.068763 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-070f4821-a770-4232-8e5b-b9f3607ba258 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:42:36.069665 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-070f4821-a770-4232-8e5b-b9f3607ba258 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:42:36.070164 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-070f4821-a770-4232-8e5b-b9f3607ba258 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:42:36.265100 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-070f4821-a770-4232-8e5b-b9f3607ba258 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:42:36.275809 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-070f4821-a770-4232-8e5b-b9f3607ba258 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:42:36.277746 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-070f4821-a770-4232-8e5b-b9f3607ba258 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:42:36.279154 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-070f4821-a770-4232-8e5b-b9f3607ba258 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] 10.222.0.121 "GET /compute/v2.1/servers/b0d153c5-90d0-4814-92ec-6f237601def9" status: 200 len: 1408 microversion: 2.20 time: 0.227299 Aug 04 10:42:36.279843 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 445/881] 10.222.0.121 () {60 vars in 1282 bytes} [Thu Aug 4 10:42:36 2022] GET /compute/v2.1/servers/b0d153c5-90d0-4814-92ec-6f237601def9 => generated 1408 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:42:37.304562 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-9f12098c-016e-4137-af89-c234d856bfd3 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:42:37.305188 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-9f12098c-016e-4137-af89-c234d856bfd3 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] [instance: b0d153c5-90d0-4814-92ec-6f237601def9] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:42:37.312810 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-9f12098c-016e-4137-af89-c234d856bfd3 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:42:37.313410 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-9f12098c-016e-4137-af89-c234d856bfd3 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:42:37.314459 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-9f12098c-016e-4137-af89-c234d856bfd3 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:42:37.315036 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-9f12098c-016e-4137-af89-c234d856bfd3 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:42:37.463462 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-9f12098c-016e-4137-af89-c234d856bfd3 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:42:37.474483 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-9f12098c-016e-4137-af89-c234d856bfd3 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:42:37.476653 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-9f12098c-016e-4137-af89-c234d856bfd3 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:42:37.478141 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-9f12098c-016e-4137-af89-c234d856bfd3 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] 10.222.0.121 "GET /compute/v2.1/servers/b0d153c5-90d0-4814-92ec-6f237601def9" status: 200 len: 1408 microversion: 2.20 time: 0.178744 Aug 04 10:42:37.478892 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 437/882] 10.222.0.121 () {60 vars in 1282 bytes} [Thu Aug 4 10:42:37 2022] GET /compute/v2.1/servers/b0d153c5-90d0-4814-92ec-6f237601def9 => generated 1408 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:42:38.505140 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-5fa9b094-d2e0-46b3-b708-2d2f4f4b2621 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:42:38.505815 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-5fa9b094-d2e0-46b3-b708-2d2f4f4b2621 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] [instance: b0d153c5-90d0-4814-92ec-6f237601def9] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:42:38.514943 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-5fa9b094-d2e0-46b3-b708-2d2f4f4b2621 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:42:38.515445 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-5fa9b094-d2e0-46b3-b708-2d2f4f4b2621 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:42:38.516444 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-5fa9b094-d2e0-46b3-b708-2d2f4f4b2621 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:42:38.517036 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-5fa9b094-d2e0-46b3-b708-2d2f4f4b2621 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:42:38.655572 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-5fa9b094-d2e0-46b3-b708-2d2f4f4b2621 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:42:38.664875 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-5fa9b094-d2e0-46b3-b708-2d2f4f4b2621 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:42:38.666391 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-5fa9b094-d2e0-46b3-b708-2d2f4f4b2621 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:42:38.667564 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-5fa9b094-d2e0-46b3-b708-2d2f4f4b2621 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] 10.222.0.121 "GET /compute/v2.1/servers/b0d153c5-90d0-4814-92ec-6f237601def9" status: 200 len: 1408 microversion: 2.20 time: 0.169436 Aug 04 10:42:38.668188 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 446/883] 10.222.0.121 () {60 vars in 1282 bytes} [Thu Aug 4 10:42:38 2022] GET /compute/v2.1/servers/b0d153c5-90d0-4814-92ec-6f237601def9 => generated 1408 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:42:39.691276 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-2c9e0d29-d1b2-40e7-8a66-0c6b3cb6a882 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:42:39.692006 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-2c9e0d29-d1b2-40e7-8a66-0c6b3cb6a882 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] [instance: b0d153c5-90d0-4814-92ec-6f237601def9] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:42:39.699906 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-2c9e0d29-d1b2-40e7-8a66-0c6b3cb6a882 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:42:39.700405 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-2c9e0d29-d1b2-40e7-8a66-0c6b3cb6a882 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:42:39.701202 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-2c9e0d29-d1b2-40e7-8a66-0c6b3cb6a882 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:42:39.701654 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-2c9e0d29-d1b2-40e7-8a66-0c6b3cb6a882 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:42:39.858210 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-2c9e0d29-d1b2-40e7-8a66-0c6b3cb6a882 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:42:39.867171 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-2c9e0d29-d1b2-40e7-8a66-0c6b3cb6a882 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:42:39.868827 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-2c9e0d29-d1b2-40e7-8a66-0c6b3cb6a882 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:42:39.869973 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-2c9e0d29-d1b2-40e7-8a66-0c6b3cb6a882 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] 10.222.0.121 "GET /compute/v2.1/servers/b0d153c5-90d0-4814-92ec-6f237601def9" status: 200 len: 1408 microversion: 2.20 time: 0.182933 Aug 04 10:42:39.870523 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 438/884] 10.222.0.121 () {60 vars in 1282 bytes} [Thu Aug 4 10:42:39 2022] GET /compute/v2.1/servers/b0d153c5-90d0-4814-92ec-6f237601def9 => generated 1408 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:42:40.893955 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-209a79ae-37a7-4c8b-b0d2-caadb80e6ddd tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:42:40.894580 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-209a79ae-37a7-4c8b-b0d2-caadb80e6ddd tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] [instance: b0d153c5-90d0-4814-92ec-6f237601def9] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:42:40.910776 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-209a79ae-37a7-4c8b-b0d2-caadb80e6ddd tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:42:40.911310 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-209a79ae-37a7-4c8b-b0d2-caadb80e6ddd tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:42:40.912052 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-209a79ae-37a7-4c8b-b0d2-caadb80e6ddd tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:42:40.912541 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-209a79ae-37a7-4c8b-b0d2-caadb80e6ddd tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:42:41.058075 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-209a79ae-37a7-4c8b-b0d2-caadb80e6ddd tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:42:41.069239 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-209a79ae-37a7-4c8b-b0d2-caadb80e6ddd tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:42:41.071170 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-209a79ae-37a7-4c8b-b0d2-caadb80e6ddd tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:42:41.072368 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-209a79ae-37a7-4c8b-b0d2-caadb80e6ddd tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] 10.222.0.121 "GET /compute/v2.1/servers/b0d153c5-90d0-4814-92ec-6f237601def9" status: 200 len: 1408 microversion: 2.20 time: 0.182600 Aug 04 10:42:41.072935 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 447/885] 10.222.0.121 () {60 vars in 1282 bytes} [Thu Aug 4 10:42:40 2022] GET /compute/v2.1/servers/b0d153c5-90d0-4814-92ec-6f237601def9 => generated 1408 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:42:42.096690 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-b209814d-21c3-4eba-9427-c39a720e118b tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:42:42.097381 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-b209814d-21c3-4eba-9427-c39a720e118b tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] [instance: b0d153c5-90d0-4814-92ec-6f237601def9] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:42:42.100789 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG dbcounter [-] [124456] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=3 {{(pid=124456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:42:42.108106 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-b209814d-21c3-4eba-9427-c39a720e118b tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:42:42.108542 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-b209814d-21c3-4eba-9427-c39a720e118b tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:42:42.109359 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-b209814d-21c3-4eba-9427-c39a720e118b tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:42:42.109806 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-b209814d-21c3-4eba-9427-c39a720e118b tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:42:42.280979 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-b209814d-21c3-4eba-9427-c39a720e118b tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:42:42.290004 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-b209814d-21c3-4eba-9427-c39a720e118b tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:42:42.291537 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-b209814d-21c3-4eba-9427-c39a720e118b tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:42:42.292738 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-b209814d-21c3-4eba-9427-c39a720e118b tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] 10.222.0.121 "GET /compute/v2.1/servers/b0d153c5-90d0-4814-92ec-6f237601def9" status: 200 len: 1408 microversion: 2.20 time: 0.201271 Aug 04 10:42:42.293344 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 439/886] 10.222.0.121 () {60 vars in 1282 bytes} [Thu Aug 4 10:42:42 2022] GET /compute/v2.1/servers/b0d153c5-90d0-4814-92ec-6f237601def9 => generated 1408 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:42:42.560541 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [req-0fb6a597-e0f6-42ea-be23-2387bd4cf887 req-0f682edc-4738-4e2a-be0d-e194d264c53f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0d153c5-90d0-4814-92ec-6f237601def9", "name": "network-vif-plugged", "status": "completed", "tag": "800ffaa9-8acb-4634-8260-3d89de6eccd5"}]} {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:42:42.566941 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG dbcounter [-] [124457] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=1 {{(pid=124457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:42:42.584651 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [req-0fb6a597-e0f6-42ea-be23-2387bd4cf887 req-0f682edc-4738-4e2a-be0d-e194d264c53f service nova] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:42:42.584651 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [req-0fb6a597-e0f6-42ea-be23-2387bd4cf887 req-0f682edc-4738-4e2a-be0d-e194d264c53f service nova] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:42:42.595612 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG dbcounter [-] [124457] Writing DB stats nova_cell0:SELECT=6 {{(pid=124457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:42:42.599149 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.compute.server_external_events [req-0fb6a597-e0f6-42ea-be23-2387bd4cf887 req-0f682edc-4738-4e2a-be0d-e194d264c53f service nova] Creating event network-vif-plugged:800ffaa9-8acb-4634-8260-3d89de6eccd5 for instance b0d153c5-90d0-4814-92ec-6f237601def9 on hv-cinder-85200 Aug 04 10:42:42.607620 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [req-0fb6a597-e0f6-42ea-be23-2387bd4cf887 req-0f682edc-4738-4e2a-be0d-e194d264c53f service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049047 Aug 04 10:42:42.607620 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 448/887] 10.222.0.121 () {64 vars in 1322 bytes} [Thu Aug 4 10:42:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:42:43.161120 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-86faea23-089f-47b0-a423-bedaf549aa47 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3985c612-86d3-4c83-81f9-e46a7681a1b3"}} {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:42:43.163543 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-86faea23-089f-47b0-a423-bedaf549aa47 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] [instance: aca71cfb-26a8-4881-af52-7a1c370fee28] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:42:43.165561 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG dbcounter [-] [124456] Writing DB stats nova_cell0:SELECT=2 {{(pid=124456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:42:43.166239 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG dbcounter [-] [124456] Writing DB stats nova_cell0:SELECT=6 {{(pid=124456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:42:43.173402 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-86faea23-089f-47b0-a423-bedaf549aa47 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:42:43.173402 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-86faea23-089f-47b0-a423-bedaf549aa47 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:42:43.174071 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-86faea23-089f-47b0-a423-bedaf549aa47 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:42:43.174502 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-86faea23-089f-47b0-a423-bedaf549aa47 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:42:43.177015 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG dbcounter [-] [124456] Writing DB stats nova_cell1:SELECT=99 {{(pid=124456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:42:43.277223 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.wsgi [None req-86faea23-089f-47b0-a423-bedaf549aa47 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] HTTP exception thrown: Invalid volume: volume 3985c612-86d3-4c83-81f9-e46a7681a1b3 is already attached to instances: aca71cfb-26a8-4881-af52-7a1c370fee28 Aug 04 10:42:43.278998 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-86faea23-089f-47b0-a423-bedaf549aa47 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Request method failure captured: Aug 04 10:42:43.278998 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: request: POST /compute/v2.1/servers/aca71cfb-26a8-4881-af52-7a1c370fee28/os-volume_attachments HTTP/1.1 Aug 04 10:42:43.278998 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: Accept: application/json Aug 04 10:42:43.278998 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: Accept-Encoding: identity Aug 04 10:42:43.278998 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: Connection: close Aug 04 10:42:43.278998 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: Content-Length: 74 Aug 04 10:42:43.278998 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: Content-Type: application/json Aug 04 10:42:43.278998 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: Host: 10.222.0.121 Aug 04 10:42:43.278998 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: Openstack-System-Scope: None Aug 04 10:42:43.278998 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: User-Agent: python-urllib3/1.26.11 Aug 04 10:42:43.278998 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Auth-Token: gAAAAABi66BYmE2gBqIXhQG24OFFWzVprzGeGbZ6oWrpD9juFQnTdf9ST5LtrG_tq8UPT6UiMvXECGt7-Rb5xRfm_FUvpCA0aMeQcAwPVFfAZaKkKC5hs5ouvidzrTVo1nH2TD4SvjZYb98NZaHzipnkuU-vQFrG4wdkP89b_O5rLKaczIbRvag Aug 04 10:42:43.278998 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Domain-Id: None Aug 04 10:42:43.278998 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Domain-Name: None Aug 04 10:42:43.278998 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Identity-Status: Confirmed Aug 04 10:42:43.278998 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Is-Admin-Project: True Aug 04 10:42:43.278998 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Project-Domain-Id: default Aug 04 10:42:43.278998 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Project-Domain-Name: Default Aug 04 10:42:43.278998 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Project-Id: 051b6a3defca48d7b4f8bb6705f89f20 Aug 04 10:42:43.278998 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Project-Name: tempest-AttachVolumeNegativeTest-18806726 Aug 04 10:42:43.278998 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Role: reader,member Aug 04 10:42:43.278998 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Roles: reader,member Aug 04 10:42:43.280705 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/051b6a3defca48d7b4f8bb6705f89f20"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/051b6a3defca48d7b4f8bb6705f89f20"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.121:8080", "publicURL": "http://10.222.0.121:8080/v1/AUTH_051b6a3defca48d7b4f8bb6705f89f20"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2/051b6a3defca48d7b4f8bb6705f89f20"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:9696/networking"}]}] Aug 04 10:42:43.280705 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Tenant: tempest-AttachVolumeNegativeTest-18806726 Aug 04 10:42:43.280705 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Tenant-Id: 051b6a3defca48d7b4f8bb6705f89f20 Aug 04 10:42:43.280705 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-18806726 Aug 04 10:42:43.280705 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-User: tempest-AttachVolumeNegativeTest-18806726-project Aug 04 10:42:43.280705 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-User-Domain-Id: default Aug 04 10:42:43.280705 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-User-Domain-Name: Default Aug 04 10:42:43.280705 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-User-Id: 41a38b5af1654f44bc6cb5832c2e8e87 Aug 04 10:42:43.280705 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-User-Name: tempest-AttachVolumeNegativeTest-18806726-project Aug 04 10:42:43.280705 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: Aug 04 10:42:43.280705 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: {"volumeAttachment": {"volumeId": "3985c612-86d3-4c83-81f9-e46a7681a1b3"}} Aug 04 10:42:43.280705 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: method: > Aug 04 10:42:43.281598 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: exception: Invalid volume: volume 3985c612-86d3-4c83-81f9-e46a7681a1b3 is already attached to instances: aca71cfb-26a8-4881-af52-7a1c370fee28 Aug 04 10:42:43.281598 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: action_args: {'server_id': 'aca71cfb-26a8-4881-af52-7a1c370fee28', 'body': {'volumeAttachment': {'volumeId': '3985c612-86d3-4c83-81f9-e46a7681a1b3'}}} Aug 04 10:42:43.281598 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 10:42:43.281598 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:42:43.281598 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 04 10:42:43.281598 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 04 10:42:43.281598 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 04 10:42:43.281598 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 04 10:42:43.281598 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 04 10:42:43.281598 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 04 10:42:43.281598 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5066, in attach_volume Aug 04 10:42:43.281598 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 04 10:42:43.281598 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4906, in _check_volume_already_attached Aug 04 10:42:43.281598 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 04 10:42:43.281598 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 3985c612-86d3-4c83-81f9-e46a7681a1b3 is already attached to instances: aca71cfb-26a8-4881-af52-7a1c370fee28 Aug 04 10:42:43.281598 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi Aug 04 10:42:43.281598 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:42:43.281598 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi Aug 04 10:42:43.281598 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:42:43.283095 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:42:43.283095 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:42:43.283095 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 10:42:43.283095 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 10:42:43.283095 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 10:42:43.283095 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 10:42:43.283095 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 10:42:43.283095 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 10:42:43.283095 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 10:42:43.283095 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 10:42:43.283095 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 10:42:43.283095 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 10:42:43.283095 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 04 10:42:43.283095 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 04 10:42:43.283095 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 3985c612-86d3-4c83-81f9-e46a7681a1b3 is already attached to instances: aca71cfb-26a8-4881-af52-7a1c370fee28 Aug 04 10:42:43.283095 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi Aug 04 10:42:43.283095 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:42:43.283095 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi Aug 04 10:42:43.283095 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:42:43.283095 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:42:43.284691 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:42:43.284691 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 10:42:43.284691 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 10:42:43.284691 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 3985c612-86d3-4c83-81f9-e46a7681a1b3 is already attached to instances: aca71cfb-26a8-4881-af52-7a1c370fee28 Aug 04 10:42:43.284691 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi Aug 04 10:42:43.284691 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-86faea23-089f-47b0-a423-bedaf549aa47 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Returning 400 to user: Invalid volume: volume 3985c612-86d3-4c83-81f9-e46a7681a1b3 is already attached to instances: aca71cfb-26a8-4881-af52-7a1c370fee28 {{(pid=124456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 10:42:43.284691 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-86faea23-089f-47b0-a423-bedaf549aa47 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] 10.222.0.121 "POST /compute/v2.1/servers/aca71cfb-26a8-4881-af52-7a1c370fee28/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.123671 Aug 04 10:42:43.284691 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 440/888] 10.222.0.121 () {60 vars in 1328 bytes} [Thu Aug 4 10:42:43 2022] POST /compute/v2.1/servers/aca71cfb-26a8-4881-af52-7a1c370fee28/os-volume_attachments => generated 174 bytes in 125 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 04 10:42:43.317770 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-befe27a8-6b56-4116-aa67-c7db778d6f17 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:42:43.318481 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-befe27a8-6b56-4116-aa67-c7db778d6f17 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] [instance: b0d153c5-90d0-4814-92ec-6f237601def9] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:42:43.325345 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-befe27a8-6b56-4116-aa67-c7db778d6f17 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:42:43.325801 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-befe27a8-6b56-4116-aa67-c7db778d6f17 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:42:43.326586 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-befe27a8-6b56-4116-aa67-c7db778d6f17 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:42:43.327026 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-befe27a8-6b56-4116-aa67-c7db778d6f17 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:42:43.347575 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-bb6ac2ae-dd24-47d9-9419-174484b663ad tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:42:43.348476 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-bb6ac2ae-dd24-47d9-9419-174484b663ad tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] [instance: aca71cfb-26a8-4881-af52-7a1c370fee28] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:42:43.354946 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-bb6ac2ae-dd24-47d9-9419-174484b663ad tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:42:43.355437 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-bb6ac2ae-dd24-47d9-9419-174484b663ad tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:42:43.356270 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-bb6ac2ae-dd24-47d9-9419-174484b663ad tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:42:43.356716 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-bb6ac2ae-dd24-47d9-9419-174484b663ad tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:42:43.442007 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.objects.instance [None req-bb6ac2ae-dd24-47d9-9419-174484b663ad tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lazy-loading 'services' on Instance uuid aca71cfb-26a8-4881-af52-7a1c370fee28 {{(pid=124456) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 10:42:43.470374 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-befe27a8-6b56-4116-aa67-c7db778d6f17 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:42:43.480417 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-befe27a8-6b56-4116-aa67-c7db778d6f17 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:42:43.481955 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-befe27a8-6b56-4116-aa67-c7db778d6f17 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:42:43.483103 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-befe27a8-6b56-4116-aa67-c7db778d6f17 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] 10.222.0.121 "GET /compute/v2.1/servers/b0d153c5-90d0-4814-92ec-6f237601def9" status: 200 len: 1408 microversion: 2.20 time: 0.170234 Aug 04 10:42:43.483667 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 449/889] 10.222.0.121 () {60 vars in 1282 bytes} [Thu Aug 4 10:42:43 2022] GET /compute/v2.1/servers/b0d153c5-90d0-4814-92ec-6f237601def9 => generated 1408 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:42:43.663272 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-bb6ac2ae-dd24-47d9-9419-174484b663ad tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] 10.222.0.121 "DELETE /compute/v2.1/servers/aca71cfb-26a8-4881-af52-7a1c370fee28/os-volume_attachments/3985c612-86d3-4c83-81f9-e46a7681a1b3" status: 202 len: 0 microversion: 2.1 time: 0.319820 Aug 04 10:42:43.663903 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 441/890] 10.222.0.121 () {58 vars in 1421 bytes} [Thu Aug 4 10:42:43 2022] DELETE /compute/v2.1/servers/aca71cfb-26a8-4881-af52-7a1c370fee28/os-volume_attachments/3985c612-86d3-4c83-81f9-e46a7681a1b3 => generated 0 bytes in 321 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 10:42:43.673011 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-f8c647f2-f529-4e71-bd27-3f027ec9062c tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:42:43.675235 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-f8c647f2-f529-4e71-bd27-3f027ec9062c tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] [instance: aca71cfb-26a8-4881-af52-7a1c370fee28] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:42:43.682556 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-f8c647f2-f529-4e71-bd27-3f027ec9062c tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:42:43.683081 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-f8c647f2-f529-4e71-bd27-3f027ec9062c tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:42:43.683885 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-f8c647f2-f529-4e71-bd27-3f027ec9062c tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:42:43.684373 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-f8c647f2-f529-4e71-bd27-3f027ec9062c tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:42:43.718096 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-f8c647f2-f529-4e71-bd27-3f027ec9062c tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] 10.222.0.121 "GET /compute/v2.1/servers/aca71cfb-26a8-4881-af52-7a1c370fee28/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049195 Aug 04 10:42:43.718659 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 450/891] 10.222.0.121 () {58 vars in 1307 bytes} [Thu Aug 4 10:42:43 2022] GET /compute/v2.1/servers/aca71cfb-26a8-4881-af52-7a1c370fee28/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:42:44.510758 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-c2b4bc4b-db2e-4687-83ef-bf71bc0568b6 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:42:44.511526 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-c2b4bc4b-db2e-4687-83ef-bf71bc0568b6 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] [instance: b0d153c5-90d0-4814-92ec-6f237601def9] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:42:44.520536 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-c2b4bc4b-db2e-4687-83ef-bf71bc0568b6 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:42:44.521166 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-c2b4bc4b-db2e-4687-83ef-bf71bc0568b6 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:42:44.522354 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-c2b4bc4b-db2e-4687-83ef-bf71bc0568b6 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:42:44.522972 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-c2b4bc4b-db2e-4687-83ef-bf71bc0568b6 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:42:44.682510 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-c2b4bc4b-db2e-4687-83ef-bf71bc0568b6 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:42:44.694411 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-c2b4bc4b-db2e-4687-83ef-bf71bc0568b6 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:42:44.696040 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-c2b4bc4b-db2e-4687-83ef-bf71bc0568b6 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:42:44.697222 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-c2b4bc4b-db2e-4687-83ef-bf71bc0568b6 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] 10.222.0.121 "GET /compute/v2.1/servers/b0d153c5-90d0-4814-92ec-6f237601def9" status: 200 len: 1408 microversion: 2.20 time: 0.193637 Aug 04 10:42:44.698837 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 442/892] 10.222.0.121 () {60 vars in 1282 bytes} [Thu Aug 4 10:42:44 2022] GET /compute/v2.1/servers/b0d153c5-90d0-4814-92ec-6f237601def9 => generated 1408 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:42:44.731237 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-1cb759fa-8691-43e6-8378-442f78402daa tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:42:44.733704 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-1cb759fa-8691-43e6-8378-442f78402daa tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] [instance: aca71cfb-26a8-4881-af52-7a1c370fee28] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:42:44.740806 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-1cb759fa-8691-43e6-8378-442f78402daa tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:42:44.741263 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-1cb759fa-8691-43e6-8378-442f78402daa tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:42:44.742071 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-1cb759fa-8691-43e6-8378-442f78402daa tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:42:44.742508 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-1cb759fa-8691-43e6-8378-442f78402daa tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:42:44.778166 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-1cb759fa-8691-43e6-8378-442f78402daa tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] 10.222.0.121 "GET /compute/v2.1/servers/aca71cfb-26a8-4881-af52-7a1c370fee28/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050997 Aug 04 10:42:44.778765 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 451/893] 10.222.0.121 () {58 vars in 1307 bytes} [Thu Aug 4 10:42:44 2022] GET /compute/v2.1/servers/aca71cfb-26a8-4881-af52-7a1c370fee28/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:42:45.725575 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-aa89372f-0923-41af-841a-76914ebf0f18 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:42:45.726266 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-aa89372f-0923-41af-841a-76914ebf0f18 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] [instance: b0d153c5-90d0-4814-92ec-6f237601def9] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:42:45.734791 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-aa89372f-0923-41af-841a-76914ebf0f18 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:42:45.735472 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-aa89372f-0923-41af-841a-76914ebf0f18 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:42:45.736398 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-aa89372f-0923-41af-841a-76914ebf0f18 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:42:45.736944 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-aa89372f-0923-41af-841a-76914ebf0f18 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:42:45.791818 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-b7082d51-a3ea-4b2d-9398-f4e6693f2cb5 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:42:45.794140 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-b7082d51-a3ea-4b2d-9398-f4e6693f2cb5 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] [instance: aca71cfb-26a8-4881-af52-7a1c370fee28] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:42:45.801568 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-b7082d51-a3ea-4b2d-9398-f4e6693f2cb5 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:42:45.802024 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-b7082d51-a3ea-4b2d-9398-f4e6693f2cb5 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:42:45.803055 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-b7082d51-a3ea-4b2d-9398-f4e6693f2cb5 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:42:45.803502 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-b7082d51-a3ea-4b2d-9398-f4e6693f2cb5 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:42:45.838744 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-b7082d51-a3ea-4b2d-9398-f4e6693f2cb5 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] 10.222.0.121 "GET /compute/v2.1/servers/aca71cfb-26a8-4881-af52-7a1c370fee28/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051256 Aug 04 10:42:45.839385 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 452/894] 10.222.0.121 () {58 vars in 1307 bytes} [Thu Aug 4 10:42:45 2022] GET /compute/v2.1/servers/aca71cfb-26a8-4881-af52-7a1c370fee28/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 10:42:45.893987 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-aa89372f-0923-41af-841a-76914ebf0f18 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:42:45.904328 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-aa89372f-0923-41af-841a-76914ebf0f18 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:42:45.905864 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-aa89372f-0923-41af-841a-76914ebf0f18 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:42:45.907084 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-aa89372f-0923-41af-841a-76914ebf0f18 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] 10.222.0.121 "GET /compute/v2.1/servers/b0d153c5-90d0-4814-92ec-6f237601def9" status: 200 len: 1600 microversion: 2.20 time: 0.187111 Aug 04 10:42:45.907659 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 443/895] 10.222.0.121 () {60 vars in 1282 bytes} [Thu Aug 4 10:42:45 2022] GET /compute/v2.1/servers/b0d153c5-90d0-4814-92ec-6f237601def9 => generated 1600 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:42:45.909063 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-8878cb9c-fd98-4af4-8e3e-f01e70a2fffc tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:42:45.909591 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-8878cb9c-fd98-4af4-8e3e-f01e70a2fffc tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] [instance: aca71cfb-26a8-4881-af52-7a1c370fee28] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:42:45.917871 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-8878cb9c-fd98-4af4-8e3e-f01e70a2fffc tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:42:45.918233 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-8878cb9c-fd98-4af4-8e3e-f01e70a2fffc tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:42:45.919032 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-8878cb9c-fd98-4af4-8e3e-f01e70a2fffc tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:42:45.919474 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-8878cb9c-fd98-4af4-8e3e-f01e70a2fffc tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:42:45.930431 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-04bbe92a-d6ed-4677-bb08-f5ec985b8785 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:42:45.930926 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-04bbe92a-d6ed-4677-bb08-f5ec985b8785 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] [instance: b0d153c5-90d0-4814-92ec-6f237601def9] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:42:45.937685 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-04bbe92a-d6ed-4677-bb08-f5ec985b8785 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:42:45.938150 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-04bbe92a-d6ed-4677-bb08-f5ec985b8785 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:42:45.938965 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-04bbe92a-d6ed-4677-bb08-f5ec985b8785 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:42:45.939396 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-04bbe92a-d6ed-4677-bb08-f5ec985b8785 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:42:45.949109 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-8878cb9c-fd98-4af4-8e3e-f01e70a2fffc tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] [instance: aca71cfb-26a8-4881-af52-7a1c370fee28] Going to try to terminate instance {{(pid=124457) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 10:42:46.033492 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-04bbe92a-d6ed-4677-bb08-f5ec985b8785 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] 10.222.0.121 "GET /compute/v2.1/servers/b0d153c5-90d0-4814-92ec-6f237601def9/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.107028 Aug 04 10:42:46.034215 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 444/896] 10.222.0.121 () {60 vars in 1321 bytes} [Thu Aug 4 10:42:45 2022] GET /compute/v2.1/servers/b0d153c5-90d0-4814-92ec-6f237601def9/os-interface => generated 284 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 04 10:42:46.043137 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-8878cb9c-fd98-4af4-8e3e-f01e70a2fffc tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] 10.222.0.121 "DELETE /compute/v2.1/servers/aca71cfb-26a8-4881-af52-7a1c370fee28" status: 204 len: 0 microversion: 2.1 time: 0.137672 Aug 04 10:42:46.043859 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 453/897] 10.222.0.121 () {58 vars in 1244 bytes} [Thu Aug 4 10:42:45 2022] DELETE /compute/v2.1/servers/aca71cfb-26a8-4881-af52-7a1c370fee28 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 04 10:42:46.052323 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-feb4aff4-42ec-4120-b026-c206142d69e6 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:42:46.053314 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-feb4aff4-42ec-4120-b026-c206142d69e6 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] [instance: aca71cfb-26a8-4881-af52-7a1c370fee28] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:42:46.060369 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-feb4aff4-42ec-4120-b026-c206142d69e6 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:42:46.061108 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-feb4aff4-42ec-4120-b026-c206142d69e6 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:42:46.062112 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-feb4aff4-42ec-4120-b026-c206142d69e6 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:42:46.062557 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-feb4aff4-42ec-4120-b026-c206142d69e6 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:42:46.210806 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-feb4aff4-42ec-4120-b026-c206142d69e6 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a38b5af1654f44bc6cb5832c2e8e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051b6a3defca48d7b4f8bb6705f89f20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:42:46.220012 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-feb4aff4-42ec-4120-b026-c206142d69e6 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] 10.222.0.121 "GET /compute/v2.1/servers/aca71cfb-26a8-4881-af52-7a1c370fee28" status: 200 len: 1686 microversion: 2.1 time: 0.171576 Aug 04 10:42:46.220602 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 445/898] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:42:46 2022] GET /compute/v2.1/servers/aca71cfb-26a8-4881-af52-7a1c370fee28 => generated 1686 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:42:47.244460 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-c66c19ff-fd57-41b0-af27-5d295728adb9 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:42:47.245912 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-c66c19ff-fd57-41b0-af27-5d295728adb9 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] [instance: aca71cfb-26a8-4881-af52-7a1c370fee28] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:42:47.253505 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-c66c19ff-fd57-41b0-af27-5d295728adb9 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:42:47.253947 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-c66c19ff-fd57-41b0-af27-5d295728adb9 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:42:47.254800 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-c66c19ff-fd57-41b0-af27-5d295728adb9 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:42:47.255250 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-c66c19ff-fd57-41b0-af27-5d295728adb9 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:42:47.310841 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [req-2c67cec8-3fdf-4ccf-a655-cd3528536d90 req-aa385559-3116-45c4-a5df-187a8cb35bb5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b0d153c5-90d0-4814-92ec-6f237601def9", "tag": "800ffaa9-8acb-4634-8260-3d89de6eccd5"}]} {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:42:47.322247 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [req-2c67cec8-3fdf-4ccf-a655-cd3528536d90 req-aa385559-3116-45c4-a5df-187a8cb35bb5 service nova] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:42:47.322708 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [req-2c67cec8-3fdf-4ccf-a655-cd3528536d90 req-aa385559-3116-45c4-a5df-187a8cb35bb5 service nova] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:42:47.334968 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.compute.server_external_events [req-2c67cec8-3fdf-4ccf-a655-cd3528536d90 req-aa385559-3116-45c4-a5df-187a8cb35bb5 service nova] Creating event network-changed:800ffaa9-8acb-4634-8260-3d89de6eccd5 for instance b0d153c5-90d0-4814-92ec-6f237601def9 on hv-cinder-85200 Aug 04 10:42:47.340901 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [req-2c67cec8-3fdf-4ccf-a655-cd3528536d90 req-aa385559-3116-45c4-a5df-187a8cb35bb5 service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033947 Aug 04 10:42:47.344859 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 446/899] 10.222.0.121 () {64 vars in 1322 bytes} [Thu Aug 4 10:42:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:42:47.464420 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-c66c19ff-fd57-41b0-af27-5d295728adb9 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a38b5af1654f44bc6cb5832c2e8e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051b6a3defca48d7b4f8bb6705f89f20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:42:47.474175 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-c66c19ff-fd57-41b0-af27-5d295728adb9 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] 10.222.0.121 "GET /compute/v2.1/servers/aca71cfb-26a8-4881-af52-7a1c370fee28" status: 200 len: 1686 microversion: 2.1 time: 0.234512 Aug 04 10:42:47.474772 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 454/900] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:42:47 2022] GET /compute/v2.1/servers/aca71cfb-26a8-4881-af52-7a1c370fee28 => generated 1686 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:42:48.498564 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-12728abe-94b4-4b7b-a1ec-5e6129213081 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:42:48.500110 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-12728abe-94b4-4b7b-a1ec-5e6129213081 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] [instance: aca71cfb-26a8-4881-af52-7a1c370fee28] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:42:48.508643 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-12728abe-94b4-4b7b-a1ec-5e6129213081 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:42:48.509091 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-12728abe-94b4-4b7b-a1ec-5e6129213081 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:42:48.510326 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-12728abe-94b4-4b7b-a1ec-5e6129213081 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:42:48.511182 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-12728abe-94b4-4b7b-a1ec-5e6129213081 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:42:48.779934 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-12728abe-94b4-4b7b-a1ec-5e6129213081 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a38b5af1654f44bc6cb5832c2e8e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051b6a3defca48d7b4f8bb6705f89f20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:42:48.790823 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-12728abe-94b4-4b7b-a1ec-5e6129213081 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] 10.222.0.121 "GET /compute/v2.1/servers/aca71cfb-26a8-4881-af52-7a1c370fee28" status: 200 len: 1686 microversion: 2.1 time: 0.297412 Aug 04 10:42:48.791428 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 447/901] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:42:48 2022] GET /compute/v2.1/servers/aca71cfb-26a8-4881-af52-7a1c370fee28 => generated 1686 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:42:49.615431 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [req-2e4496a1-7f10-4d98-8482-7391ec873ffa req-843f3591-58c1-4b1c-9919-51283441b7db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aca71cfb-26a8-4881-af52-7a1c370fee28", "name": "network-vif-deleted", "tag": "cacda5a6-f10e-4545-9afd-a4d6723e126b"}]} {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:42:49.628315 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [req-2e4496a1-7f10-4d98-8482-7391ec873ffa req-843f3591-58c1-4b1c-9919-51283441b7db service nova] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:42:49.628816 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [req-2e4496a1-7f10-4d98-8482-7391ec873ffa req-843f3591-58c1-4b1c-9919-51283441b7db service nova] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:42:49.641280 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.compute.server_external_events [req-2e4496a1-7f10-4d98-8482-7391ec873ffa req-843f3591-58c1-4b1c-9919-51283441b7db service nova] Creating event network-vif-deleted:cacda5a6-f10e-4545-9afd-a4d6723e126b for instance aca71cfb-26a8-4881-af52-7a1c370fee28 on hv-cinder-85200 Aug 04 10:42:49.647980 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [req-2e4496a1-7f10-4d98-8482-7391ec873ffa req-843f3591-58c1-4b1c-9919-51283441b7db service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035562 Aug 04 10:42:49.648656 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 455/902] 10.222.0.121 () {64 vars in 1322 bytes} [Thu Aug 4 10:42:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:42:49.812838 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-a7c5afd9-c227-4cad-85df-1213f830dbbd tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:42:49.817108 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-a7c5afd9-c227-4cad-85df-1213f830dbbd tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] [instance: aca71cfb-26a8-4881-af52-7a1c370fee28] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:42:49.825376 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-a7c5afd9-c227-4cad-85df-1213f830dbbd tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:42:49.825956 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-a7c5afd9-c227-4cad-85df-1213f830dbbd tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:42:49.826844 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-a7c5afd9-c227-4cad-85df-1213f830dbbd tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:42:49.827357 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-a7c5afd9-c227-4cad-85df-1213f830dbbd tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:42:49.868251 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-a7c5afd9-c227-4cad-85df-1213f830dbbd tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:42:49.868753 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-a7c5afd9-c227-4cad-85df-1213f830dbbd tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:42:49.869306 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.objects.instance [None req-a7c5afd9-c227-4cad-85df-1213f830dbbd tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lazy-loading 'fault' on Instance uuid aca71cfb-26a8-4881-af52-7a1c370fee28 {{(pid=124456) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 10:42:49.914782 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-a7c5afd9-c227-4cad-85df-1213f830dbbd tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a38b5af1654f44bc6cb5832c2e8e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051b6a3defca48d7b4f8bb6705f89f20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:42:49.923213 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-a7c5afd9-c227-4cad-85df-1213f830dbbd tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] 10.222.0.121 "GET /compute/v2.1/servers/aca71cfb-26a8-4881-af52-7a1c370fee28" status: 200 len: 1336 microversion: 2.1 time: 0.114420 Aug 04 10:42:49.923812 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 448/903] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:42:49 2022] GET /compute/v2.1/servers/aca71cfb-26a8-4881-af52-7a1c370fee28 => generated 1336 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:42:50.947790 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-74d70551-33e2-43ed-84b8-e1888c10275d tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:42:50.948535 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-74d70551-33e2-43ed-84b8-e1888c10275d tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] [instance: aca71cfb-26a8-4881-af52-7a1c370fee28] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:42:50.956424 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-74d70551-33e2-43ed-84b8-e1888c10275d tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:42:50.956901 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-74d70551-33e2-43ed-84b8-e1888c10275d tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:42:50.957688 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-74d70551-33e2-43ed-84b8-e1888c10275d tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:42:50.958134 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-74d70551-33e2-43ed-84b8-e1888c10275d tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:42:50.973364 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.wsgi [None req-74d70551-33e2-43ed-84b8-e1888c10275d tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] HTTP exception thrown: Instance aca71cfb-26a8-4881-af52-7a1c370fee28 could not be found. Aug 04 10:42:50.975068 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-74d70551-33e2-43ed-84b8-e1888c10275d tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Request method failure captured: Aug 04 10:42:50.975068 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: request: GET /compute/v2.1/servers/aca71cfb-26a8-4881-af52-7a1c370fee28 HTTP/1.1 Aug 04 10:42:50.975068 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: Accept: application/json Aug 04 10:42:50.975068 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: Accept-Encoding: identity Aug 04 10:42:50.975068 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: Connection: close Aug 04 10:42:50.975068 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: Content-Length: 0 Aug 04 10:42:50.975068 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: Content-Type: application/json Aug 04 10:42:50.975068 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: Host: 10.222.0.121 Aug 04 10:42:50.975068 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: Openstack-System-Scope: None Aug 04 10:42:50.975068 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: User-Agent: python-urllib3/1.26.11 Aug 04 10:42:50.975068 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Auth-Token: gAAAAABi66BYmE2gBqIXhQG24OFFWzVprzGeGbZ6oWrpD9juFQnTdf9ST5LtrG_tq8UPT6UiMvXECGt7-Rb5xRfm_FUvpCA0aMeQcAwPVFfAZaKkKC5hs5ouvidzrTVo1nH2TD4SvjZYb98NZaHzipnkuU-vQFrG4wdkP89b_O5rLKaczIbRvag Aug 04 10:42:50.975068 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Domain-Id: None Aug 04 10:42:50.975068 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Domain-Name: None Aug 04 10:42:50.975068 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Identity-Status: Confirmed Aug 04 10:42:50.975068 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Is-Admin-Project: True Aug 04 10:42:50.975068 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Project-Domain-Id: default Aug 04 10:42:50.975068 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Project-Domain-Name: Default Aug 04 10:42:50.975068 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Project-Id: 051b6a3defca48d7b4f8bb6705f89f20 Aug 04 10:42:50.975068 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Project-Name: tempest-AttachVolumeNegativeTest-18806726 Aug 04 10:42:50.975068 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Role: reader,member Aug 04 10:42:50.975068 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Roles: reader,member Aug 04 10:42:50.976737 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/051b6a3defca48d7b4f8bb6705f89f20"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/051b6a3defca48d7b4f8bb6705f89f20"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.121:8080", "publicURL": "http://10.222.0.121:8080/v1/AUTH_051b6a3defca48d7b4f8bb6705f89f20"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2/051b6a3defca48d7b4f8bb6705f89f20"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:9696/networking"}]}] Aug 04 10:42:50.976737 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Tenant: tempest-AttachVolumeNegativeTest-18806726 Aug 04 10:42:50.976737 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Tenant-Id: 051b6a3defca48d7b4f8bb6705f89f20 Aug 04 10:42:50.976737 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-18806726 Aug 04 10:42:50.976737 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-User: tempest-AttachVolumeNegativeTest-18806726-project Aug 04 10:42:50.976737 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-User-Domain-Id: default Aug 04 10:42:50.976737 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-User-Domain-Name: Default Aug 04 10:42:50.976737 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-User-Id: 41a38b5af1654f44bc6cb5832c2e8e87 Aug 04 10:42:50.976737 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-User-Name: tempest-AttachVolumeNegativeTest-18806726-project Aug 04 10:42:50.976737 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: method: > Aug 04 10:42:50.976737 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: exception: Instance aca71cfb-26a8-4881-af52-7a1c370fee28 could not be found. Aug 04 10:42:50.976737 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: action_args: {'id': 'aca71cfb-26a8-4881-af52-7a1c370fee28'} Aug 04 10:42:50.977733 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 10:42:50.977733 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:42:50.977733 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 10:42:50.977733 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 10:42:50.977733 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 10:42:50.977733 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 10:42:50.977733 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 10:42:50.977733 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 10:42:50.977733 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 10:42:50.977733 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 10:42:50.977733 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aca71cfb-26a8-4881-af52-7a1c370fee28 could not be found. Aug 04 10:42:50.977733 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Aug 04 10:42:50.977733 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:42:50.977733 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Aug 04 10:42:50.977733 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:42:50.977733 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:42:50.977733 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:42:50.977733 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 10:42:50.977733 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 10:42:50.977733 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 10:42:50.979390 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 10:42:50.979390 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 10:42:50.979390 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 10:42:50.979390 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 10:42:50.979390 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 10:42:50.979390 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 10:42:50.979390 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 10:42:50.979390 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aca71cfb-26a8-4881-af52-7a1c370fee28 could not be found. Aug 04 10:42:50.979390 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Aug 04 10:42:50.979390 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:42:50.979390 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Aug 04 10:42:50.979390 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:42:50.979390 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:42:50.979390 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:42:50.979390 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 10:42:50.979390 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 10:42:50.979390 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aca71cfb-26a8-4881-af52-7a1c370fee28 could not be found. Aug 04 10:42:50.979390 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Aug 04 10:42:50.980746 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-74d70551-33e2-43ed-84b8-e1888c10275d tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Returning 404 to user: Instance aca71cfb-26a8-4881-af52-7a1c370fee28 could not be found. {{(pid=124457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 10:42:50.980746 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-74d70551-33e2-43ed-84b8-e1888c10275d tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] 10.222.0.121 "GET /compute/v2.1/servers/aca71cfb-26a8-4881-af52-7a1c370fee28" status: 404 len: 111 microversion: 2.1 time: 0.034248 Aug 04 10:42:50.980746 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 456/904] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:42:50 2022] GET /compute/v2.1/servers/aca71cfb-26a8-4881-af52-7a1c370fee28 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 10:42:50.986700 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-8dc13b95-8c93-42e7-9640-59b89cfac5f7 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Calling method '.version_select at 0x7f67550ac790>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:42:51.009793 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-8dc13b95-8c93-42e7-9640-59b89cfac5f7 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] 10.222.0.121 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2129296901" status: 202 len: 0 microversion: 2.1 time: 0.026964 Aug 04 10:42:51.010421 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 449/905] 10.222.0.121 () {58 vars in 1226 bytes} [Thu Aug 4 10:42:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2129296901 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 10:42:51.684207 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-733556f9-c050-462d-8e78-7892d112a94f tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Action: 'create', calling method: .version_select at 0x7f6754d4c1f0>, body: {"keypair": {"name": "tempest-keypair-442889244", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI87Qdffrt3/2rgkHaPIPeqNVU4kXCUg+ubQ0ASitk5wFc+0K/HvReikcYxz5AC66a12LBAuqkoa0+W1LJ7NTS1UaHP54TG4LIvlOZopM8gaV3Jg5fNXizWtGtykrcazkA=="}} {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:42:51.700488 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.quota [None req-733556f9-c050-462d-8e78-7892d112a94f tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Getting quotas for project 051b6a3defca48d7b4f8bb6705f89f20. Resources: {'key_pairs'} {{(pid=124457) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 10:42:51.704527 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.quota [None req-733556f9-c050-462d-8e78-7892d112a94f tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Getting quotas for user 41a38b5af1654f44bc6cb5832c2e8e87 and project 051b6a3defca48d7b4f8bb6705f89f20. Resources: {'key_pairs'} {{(pid=124457) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 10:42:51.735094 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-733556f9-c050-462d-8e78-7892d112a94f tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] 10.222.0.121 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.054953 Aug 04 10:42:51.735729 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 457/906] 10.222.0.121 () {60 vars in 1164 bytes} [Thu Aug 4 10:42:51 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:42:53.598219 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-a6b0f224-ea3b-491d-89a5-d491ba336f0c tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2063077180", "imageRef": "46724bb5-955f-4f3f-bd6a-b561fdde55e3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ddbd5a12-fb68-4b76-a245-c2162d57f8f9"}], "security_groups": [{"name": "tempest-securitygroup--955728716"}], "key_name": "tempest-keypair-442889244", "user_data": "}} {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:42:53.719300 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.network.neutron [None req-a6b0f224-ea3b-491d-89a5-d491ba336f0c tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] validate_networks() for [('ddbd5a12-fb68-4b76-a245-c2162d57f8f9', None, None, None, None, None)] {{(pid=124456) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 10:42:54.128953 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.virt.hardware [None req-a6b0f224-ea3b-491d-89a5-d491ba336f0c tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Flavor limits 0:0:0 {{(pid=124456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 10:42:54.129527 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.virt.hardware [None req-a6b0f224-ea3b-491d-89a5-d491ba336f0c tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Image limits 0:0:0 {{(pid=124456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 10:42:54.130037 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.virt.hardware [None req-a6b0f224-ea3b-491d-89a5-d491ba336f0c tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Flavor pref 0:0:0 {{(pid=124456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 10:42:54.130555 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.virt.hardware [None req-a6b0f224-ea3b-491d-89a5-d491ba336f0c tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Image pref 0:0:0 {{(pid=124456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 10:42:54.131086 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.virt.hardware [None req-a6b0f224-ea3b-491d-89a5-d491ba336f0c tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 10:42:54.142291 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-a6b0f224-ea3b-491d-89a5-d491ba336f0c tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:42:54.142753 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-a6b0f224-ea3b-491d-89a5-d491ba336f0c tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:42:54.143613 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-a6b0f224-ea3b-491d-89a5-d491ba336f0c tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:42:54.144109 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-a6b0f224-ea3b-491d-89a5-d491ba336f0c tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:42:54.166064 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.quota [None req-a6b0f224-ea3b-491d-89a5-d491ba336f0c tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Getting quotas for project 051b6a3defca48d7b4f8bb6705f89f20. Resources: {'ram', 'instances', 'cores'} {{(pid=124456) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 10:42:54.170210 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.quota [None req-a6b0f224-ea3b-491d-89a5-d491ba336f0c tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Getting quotas for user 41a38b5af1654f44bc6cb5832c2e8e87 and project 051b6a3defca48d7b4f8bb6705f89f20. Resources: {'ram', 'instances', 'cores'} {{(pid=124456) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 10:42:54.182088 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-a6b0f224-ea3b-491d-89a5-d491ba336f0c tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Going to run 1 instances... {{(pid=124456) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 10:42:54.184477 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-a6b0f224-ea3b-491d-89a5-d491ba336f0c tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] [instance: 20c0019f-807e-4c55-9d6b-73288200060d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='46724bb5-955f-4f3f-bd6a-b561fdde55e3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124456) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 10:42:54.234065 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-a6b0f224-ea3b-491d-89a5-d491ba336f0c tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] 10.222.0.121 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.641537 Aug 04 10:42:54.234759 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 450/907] 10.222.0.121 () {60 vars in 1152 bytes} [Thu Aug 4 10:42:53 2022] POST /compute/v2.1/servers => generated 403 bytes in 643 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 04 10:42:54.247330 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-8ccba0d0-e666-4f0b-9a88-893eb3b3f701 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:42:54.248058 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-8ccba0d0-e666-4f0b-9a88-893eb3b3f701 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] [instance: 20c0019f-807e-4c55-9d6b-73288200060d] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:42:54.314741 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-8ccba0d0-e666-4f0b-9a88-893eb3b3f701 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a38b5af1654f44bc6cb5832c2e8e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051b6a3defca48d7b4f8bb6705f89f20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:42:54.326267 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-8ccba0d0-e666-4f0b-9a88-893eb3b3f701 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] 10.222.0.121 "GET /compute/v2.1/servers/20c0019f-807e-4c55-9d6b-73288200060d" status: 200 len: 1245 microversion: 2.1 time: 0.081115 Aug 04 10:42:54.326267 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 458/908] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:42:54 2022] GET /compute/v2.1/servers/20c0019f-807e-4c55-9d6b-73288200060d => generated 1245 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:42:55.346341 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-1929fed5-890f-4a76-8664-8e030ef000b7 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:42:55.347321 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-1929fed5-890f-4a76-8664-8e030ef000b7 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] [instance: 20c0019f-807e-4c55-9d6b-73288200060d] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:42:55.357064 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-1929fed5-890f-4a76-8664-8e030ef000b7 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:42:55.357521 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-1929fed5-890f-4a76-8664-8e030ef000b7 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:42:55.358300 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-1929fed5-890f-4a76-8664-8e030ef000b7 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:42:55.358826 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-1929fed5-890f-4a76-8664-8e030ef000b7 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:42:55.432618 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-1929fed5-890f-4a76-8664-8e030ef000b7 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a38b5af1654f44bc6cb5832c2e8e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051b6a3defca48d7b4f8bb6705f89f20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:42:55.440871 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-1929fed5-890f-4a76-8664-8e030ef000b7 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] 10.222.0.121 "GET /compute/v2.1/servers/20c0019f-807e-4c55-9d6b-73288200060d" status: 200 len: 1305 microversion: 2.1 time: 0.099581 Aug 04 10:42:55.455188 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 451/909] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:42:55 2022] GET /compute/v2.1/servers/20c0019f-807e-4c55-9d6b-73288200060d => generated 1305 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:42:56.463922 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-909d9139-c212-40c5-a372-1807fc114034 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:42:56.464365 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-909d9139-c212-40c5-a372-1807fc114034 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] [instance: 20c0019f-807e-4c55-9d6b-73288200060d] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:42:56.473957 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-909d9139-c212-40c5-a372-1807fc114034 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:42:56.474852 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-909d9139-c212-40c5-a372-1807fc114034 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:42:56.475657 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-909d9139-c212-40c5-a372-1807fc114034 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:42:56.476663 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-909d9139-c212-40c5-a372-1807fc114034 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:42:57.024126 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-909d9139-c212-40c5-a372-1807fc114034 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a38b5af1654f44bc6cb5832c2e8e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051b6a3defca48d7b4f8bb6705f89f20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:42:57.032075 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-909d9139-c212-40c5-a372-1807fc114034 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] 10.222.0.121 "GET /compute/v2.1/servers/20c0019f-807e-4c55-9d6b-73288200060d" status: 200 len: 1370 microversion: 2.1 time: 0.572904 Aug 04 10:42:57.032642 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 459/910] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:42:56 2022] GET /compute/v2.1/servers/20c0019f-807e-4c55-9d6b-73288200060d => generated 1370 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:42:57.363667 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [req-62e4e7fe-802f-4664-87b9-8906931decf5 req-d1c873d6-c4b2-4f34-b0b7-db876cd6f947 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "20c0019f-807e-4c55-9d6b-73288200060d", "tag": "ad4eaf65-e247-4b79-8096-76de3ec430d4"}]} {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:42:57.376791 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [req-62e4e7fe-802f-4664-87b9-8906931decf5 req-d1c873d6-c4b2-4f34-b0b7-db876cd6f947 service nova] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:42:57.377272 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [req-62e4e7fe-802f-4664-87b9-8906931decf5 req-d1c873d6-c4b2-4f34-b0b7-db876cd6f947 service nova] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:42:57.393334 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.compute.server_external_events [req-62e4e7fe-802f-4664-87b9-8906931decf5 req-d1c873d6-c4b2-4f34-b0b7-db876cd6f947 service nova] Creating event network-changed:ad4eaf65-e247-4b79-8096-76de3ec430d4 for instance 20c0019f-807e-4c55-9d6b-73288200060d on hv-cinder-85200 Aug 04 10:42:57.401227 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [req-62e4e7fe-802f-4664-87b9-8906931decf5 req-d1c873d6-c4b2-4f34-b0b7-db876cd6f947 service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041329 Aug 04 10:42:57.402293 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 452/911] 10.222.0.121 () {64 vars in 1322 bytes} [Thu Aug 4 10:42:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 10:42:58.133462 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-a26c9859-06db-4ff2-9f98-8f2009c79819 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:42:58.134418 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-a26c9859-06db-4ff2-9f98-8f2009c79819 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] [instance: 20c0019f-807e-4c55-9d6b-73288200060d] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:42:58.141964 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-a26c9859-06db-4ff2-9f98-8f2009c79819 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:42:58.142585 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-a26c9859-06db-4ff2-9f98-8f2009c79819 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:42:58.143732 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-a26c9859-06db-4ff2-9f98-8f2009c79819 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:42:58.144459 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-a26c9859-06db-4ff2-9f98-8f2009c79819 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:42:58.303593 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-a26c9859-06db-4ff2-9f98-8f2009c79819 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a38b5af1654f44bc6cb5832c2e8e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051b6a3defca48d7b4f8bb6705f89f20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:42:58.307273 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG dbcounter [-] [124457] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:42:58.312519 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-a26c9859-06db-4ff2-9f98-8f2009c79819 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] 10.222.0.121 "GET /compute/v2.1/servers/20c0019f-807e-4c55-9d6b-73288200060d" status: 200 len: 1370 microversion: 2.1 time: 0.261778 Aug 04 10:42:58.313125 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 460/912] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:42:58 2022] GET /compute/v2.1/servers/20c0019f-807e-4c55-9d6b-73288200060d => generated 1370 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:42:59.338920 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-5573781f-9e6c-487f-8dcd-ec3a340a5aff tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:42:59.339589 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-5573781f-9e6c-487f-8dcd-ec3a340a5aff tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] [instance: 20c0019f-807e-4c55-9d6b-73288200060d] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:42:59.347358 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-5573781f-9e6c-487f-8dcd-ec3a340a5aff tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:42:59.348200 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-5573781f-9e6c-487f-8dcd-ec3a340a5aff tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:42:59.348990 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-5573781f-9e6c-487f-8dcd-ec3a340a5aff tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:42:59.349463 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-5573781f-9e6c-487f-8dcd-ec3a340a5aff tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:42:59.523887 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-5573781f-9e6c-487f-8dcd-ec3a340a5aff tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a38b5af1654f44bc6cb5832c2e8e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051b6a3defca48d7b4f8bb6705f89f20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:42:59.532726 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-5573781f-9e6c-487f-8dcd-ec3a340a5aff tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] 10.222.0.121 "GET /compute/v2.1/servers/20c0019f-807e-4c55-9d6b-73288200060d" status: 200 len: 1370 microversion: 2.1 time: 0.200920 Aug 04 10:42:59.533341 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 453/913] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:42:59 2022] GET /compute/v2.1/servers/20c0019f-807e-4c55-9d6b-73288200060d => generated 1370 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:43:00.554872 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-9e63341a-d225-48e0-854b-1e2e970f9eb7 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:43:00.555469 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-9e63341a-d225-48e0-854b-1e2e970f9eb7 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] [instance: 20c0019f-807e-4c55-9d6b-73288200060d] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:43:00.565057 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-9e63341a-d225-48e0-854b-1e2e970f9eb7 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:43:00.565514 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-9e63341a-d225-48e0-854b-1e2e970f9eb7 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:43:00.566348 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-9e63341a-d225-48e0-854b-1e2e970f9eb7 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:43:00.566798 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-9e63341a-d225-48e0-854b-1e2e970f9eb7 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:43:00.784167 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-9e63341a-d225-48e0-854b-1e2e970f9eb7 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a38b5af1654f44bc6cb5832c2e8e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051b6a3defca48d7b4f8bb6705f89f20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:43:00.794150 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-9e63341a-d225-48e0-854b-1e2e970f9eb7 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] 10.222.0.121 "GET /compute/v2.1/servers/20c0019f-807e-4c55-9d6b-73288200060d" status: 200 len: 1370 microversion: 2.1 time: 0.243412 Aug 04 10:43:00.795333 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 461/914] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:43:00 2022] GET /compute/v2.1/servers/20c0019f-807e-4c55-9d6b-73288200060d => generated 1370 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:43:01.818174 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-e382b5a7-96f3-487a-b818-54fa1d6088b7 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:43:01.818865 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-e382b5a7-96f3-487a-b818-54fa1d6088b7 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] [instance: 20c0019f-807e-4c55-9d6b-73288200060d] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:43:01.827151 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-e382b5a7-96f3-487a-b818-54fa1d6088b7 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:43:01.827685 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-e382b5a7-96f3-487a-b818-54fa1d6088b7 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:43:01.828818 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-e382b5a7-96f3-487a-b818-54fa1d6088b7 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:43:01.829303 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-e382b5a7-96f3-487a-b818-54fa1d6088b7 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:43:01.980977 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-e382b5a7-96f3-487a-b818-54fa1d6088b7 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a38b5af1654f44bc6cb5832c2e8e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051b6a3defca48d7b4f8bb6705f89f20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:43:01.991323 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-e382b5a7-96f3-487a-b818-54fa1d6088b7 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] 10.222.0.121 "GET /compute/v2.1/servers/20c0019f-807e-4c55-9d6b-73288200060d" status: 200 len: 1370 microversion: 2.1 time: 0.177175 Aug 04 10:43:01.991971 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 454/915] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:43:01 2022] GET /compute/v2.1/servers/20c0019f-807e-4c55-9d6b-73288200060d => generated 1370 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:43:02.695344 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [req-b8bd58a8-df24-4bb4-b65c-5972f4846187 req-d54f0fc9-9060-48d4-b743-4950fd81e75a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20c0019f-807e-4c55-9d6b-73288200060d", "name": "network-vif-plugged", "status": "completed", "tag": "ad4eaf65-e247-4b79-8096-76de3ec430d4"}]} {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:43:02.721378 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [req-b8bd58a8-df24-4bb4-b65c-5972f4846187 req-d54f0fc9-9060-48d4-b743-4950fd81e75a service nova] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:43:02.722095 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [req-b8bd58a8-df24-4bb4-b65c-5972f4846187 req-d54f0fc9-9060-48d4-b743-4950fd81e75a service nova] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:43:02.735284 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.compute.server_external_events [req-b8bd58a8-df24-4bb4-b65c-5972f4846187 req-d54f0fc9-9060-48d4-b743-4950fd81e75a service nova] Creating event network-vif-plugged:ad4eaf65-e247-4b79-8096-76de3ec430d4 for instance 20c0019f-807e-4c55-9d6b-73288200060d on hv-cinder-85200 Aug 04 10:43:02.741341 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [req-b8bd58a8-df24-4bb4-b65c-5972f4846187 req-d54f0fc9-9060-48d4-b743-4950fd81e75a service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049862 Aug 04 10:43:02.742300 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 462/916] 10.222.0.121 () {64 vars in 1322 bytes} [Thu Aug 4 10:43:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:43:03.013467 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-48cba53b-49af-4b9b-a902-c14bc2fc095a tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:43:03.014244 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-48cba53b-49af-4b9b-a902-c14bc2fc095a tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] [instance: 20c0019f-807e-4c55-9d6b-73288200060d] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:43:03.022238 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-48cba53b-49af-4b9b-a902-c14bc2fc095a tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:43:03.022794 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-48cba53b-49af-4b9b-a902-c14bc2fc095a tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:43:03.023640 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-48cba53b-49af-4b9b-a902-c14bc2fc095a tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:43:03.024166 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-48cba53b-49af-4b9b-a902-c14bc2fc095a tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:43:03.170960 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-48cba53b-49af-4b9b-a902-c14bc2fc095a tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a38b5af1654f44bc6cb5832c2e8e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051b6a3defca48d7b4f8bb6705f89f20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:43:03.179876 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-48cba53b-49af-4b9b-a902-c14bc2fc095a tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] 10.222.0.121 "GET /compute/v2.1/servers/20c0019f-807e-4c55-9d6b-73288200060d" status: 200 len: 1370 microversion: 2.1 time: 0.170635 Aug 04 10:43:03.180523 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 455/917] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:43:03 2022] GET /compute/v2.1/servers/20c0019f-807e-4c55-9d6b-73288200060d => generated 1370 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:43:04.204542 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-8fb834fc-bfcf-4c45-93c5-865108fc587a tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:43:04.205505 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-8fb834fc-bfcf-4c45-93c5-865108fc587a tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] [instance: 20c0019f-807e-4c55-9d6b-73288200060d] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:43:04.212922 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-8fb834fc-bfcf-4c45-93c5-865108fc587a tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:43:04.213387 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-8fb834fc-bfcf-4c45-93c5-865108fc587a tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:43:04.214193 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-8fb834fc-bfcf-4c45-93c5-865108fc587a tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:43:04.214634 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-8fb834fc-bfcf-4c45-93c5-865108fc587a tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:43:04.320067 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG dbcounter [-] [124457] Writing DB stats nova_cell0:SELECT=6 {{(pid=124457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:43:04.369264 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-8fb834fc-bfcf-4c45-93c5-865108fc587a tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a38b5af1654f44bc6cb5832c2e8e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051b6a3defca48d7b4f8bb6705f89f20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:43:04.381770 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-8fb834fc-bfcf-4c45-93c5-865108fc587a tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] 10.222.0.121 "GET /compute/v2.1/servers/20c0019f-807e-4c55-9d6b-73288200060d" status: 200 len: 1370 microversion: 2.1 time: 0.183087 Aug 04 10:43:04.382451 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 463/918] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:43:04 2022] GET /compute/v2.1/servers/20c0019f-807e-4c55-9d6b-73288200060d => generated 1370 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:43:04.669568 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 10:43:04.669807 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: Thu Aug 4 10:43:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 10:43:05.406547 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-1c8b6f91-353f-4c28-9ccd-bf12e87d1128 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:43:05.407449 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-1c8b6f91-353f-4c28-9ccd-bf12e87d1128 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] [instance: 20c0019f-807e-4c55-9d6b-73288200060d] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:43:05.410549 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG dbcounter [-] [124456] Writing DB stats nova_cell0:SELECT=2 {{(pid=124456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:43:05.411572 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG dbcounter [-] [124456] Writing DB stats nova_cell0:SELECT=6 {{(pid=124456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:43:05.420439 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-1c8b6f91-353f-4c28-9ccd-bf12e87d1128 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:43:05.420955 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-1c8b6f91-353f-4c28-9ccd-bf12e87d1128 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:43:05.422081 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-1c8b6f91-353f-4c28-9ccd-bf12e87d1128 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:43:05.422744 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-1c8b6f91-353f-4c28-9ccd-bf12e87d1128 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:43:05.581555 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-1c8b6f91-353f-4c28-9ccd-bf12e87d1128 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a38b5af1654f44bc6cb5832c2e8e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051b6a3defca48d7b4f8bb6705f89f20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:43:05.590949 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-1c8b6f91-353f-4c28-9ccd-bf12e87d1128 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] 10.222.0.121 "GET /compute/v2.1/servers/20c0019f-807e-4c55-9d6b-73288200060d" status: 200 len: 1559 microversion: 2.1 time: 0.189705 Aug 04 10:43:05.591563 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 456/919] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:43:05 2022] GET /compute/v2.1/servers/20c0019f-807e-4c55-9d6b-73288200060d => generated 1559 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:43:05.612991 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-16c46024-e473-4b7a-a2d7-e0fe1634702a tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:43:05.613641 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-16c46024-e473-4b7a-a2d7-e0fe1634702a tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] [instance: 20c0019f-807e-4c55-9d6b-73288200060d] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:43:05.621365 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-16c46024-e473-4b7a-a2d7-e0fe1634702a tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:43:05.621889 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-16c46024-e473-4b7a-a2d7-e0fe1634702a tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:43:05.622756 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-16c46024-e473-4b7a-a2d7-e0fe1634702a tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:43:05.623200 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-16c46024-e473-4b7a-a2d7-e0fe1634702a tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:43:05.727102 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-16c46024-e473-4b7a-a2d7-e0fe1634702a tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] 10.222.0.121 "GET /compute/v2.1/servers/20c0019f-807e-4c55-9d6b-73288200060d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.117882 Aug 04 10:43:05.727978 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 464/920] 10.222.0.121 () {58 vars in 1280 bytes} [Thu Aug 4 10:43:05 2022] GET /compute/v2.1/servers/20c0019f-807e-4c55-9d6b-73288200060d/os-interface => generated 284 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:43:06.758867 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [req-0d20efd1-3a48-45e2-be20-cc48b6a09b44 req-7e982667-9d3b-4542-9f41-e58c739ecbfe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "20c0019f-807e-4c55-9d6b-73288200060d", "tag": "ad4eaf65-e247-4b79-8096-76de3ec430d4"}]} {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:43:06.769837 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [req-0d20efd1-3a48-45e2-be20-cc48b6a09b44 req-7e982667-9d3b-4542-9f41-e58c739ecbfe service nova] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:43:06.770190 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [req-0d20efd1-3a48-45e2-be20-cc48b6a09b44 req-7e982667-9d3b-4542-9f41-e58c739ecbfe service nova] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:43:06.782709 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.compute.server_external_events [req-0d20efd1-3a48-45e2-be20-cc48b6a09b44 req-7e982667-9d3b-4542-9f41-e58c739ecbfe service nova] Creating event network-changed:ad4eaf65-e247-4b79-8096-76de3ec430d4 for instance 20c0019f-807e-4c55-9d6b-73288200060d on hv-cinder-85200 Aug 04 10:43:06.788125 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [req-0d20efd1-3a48-45e2-be20-cc48b6a09b44 req-7e982667-9d3b-4542-9f41-e58c739ecbfe service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033123 Aug 04 10:43:06.788994 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 457/921] 10.222.0.121 () {64 vars in 1322 bytes} [Thu Aug 4 10:43:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:43:52.752596 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG dbcounter [-] [124457] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=124457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:43:52.754171 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG dbcounter [-] [124457] Writing DB stats nova_cell1:SELECT=18 {{(pid=124457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:43:52.901946 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-c7bbbbfe-4fd9-4078-9c3a-f9cc3e716d25 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:43:52.902608 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-c7bbbbfe-4fd9-4078-9c3a-f9cc3e716d25 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] [instance: 1f24d364-de0b-4fc9-81d6-463fd637722c] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:43:52.911489 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-c7bbbbfe-4fd9-4078-9c3a-f9cc3e716d25 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:43:52.911979 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-c7bbbbfe-4fd9-4078-9c3a-f9cc3e716d25 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:43:52.912862 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-c7bbbbfe-4fd9-4078-9c3a-f9cc3e716d25 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:43:52.913319 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-c7bbbbfe-4fd9-4078-9c3a-f9cc3e716d25 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:43:52.942995 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-c7bbbbfe-4fd9-4078-9c3a-f9cc3e716d25 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] 10.222.0.121 "GET /compute/v2.1/servers/1f24d364-de0b-4fc9-81d6-463fd637722c/ips" status: 200 len: 143 microversion: 2.1 time: 0.192041 Aug 04 10:43:52.943974 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 465/922] 10.222.0.121 () {58 vars in 1253 bytes} [Thu Aug 4 10:43:52 2022] GET /compute/v2.1/servers/1f24d364-de0b-4fc9-81d6-463fd637722c/ips => generated 143 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:43:55.371545 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG dbcounter [-] [124456] Writing DB stats nova_api:SELECT=53,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=124456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:43:55.372372 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG dbcounter [-] [124456] Writing DB stats nova_cell1:SELECT=88,nova_cell1:INSERT=1 {{(pid=124456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:43:55.377997 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-f6dc5c4b-f174-4b85-a388-a0caa52af204 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5b9bec70-22eb-4090-abe7-bbd9dc8be80b"}} {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:43:55.379491 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-f6dc5c4b-f174-4b85-a388-a0caa52af204 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] [instance: 1f24d364-de0b-4fc9-81d6-463fd637722c] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:43:55.387801 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-f6dc5c4b-f174-4b85-a388-a0caa52af204 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:43:55.388281 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-f6dc5c4b-f174-4b85-a388-a0caa52af204 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:43:55.389110 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-f6dc5c4b-f174-4b85-a388-a0caa52af204 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:43:55.389526 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-f6dc5c4b-f174-4b85-a388-a0caa52af204 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:43:55.691801 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-f6dc5c4b-f174-4b85-a388-a0caa52af204 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] 10.222.0.121 "POST /compute/v2.1/servers/1f24d364-de0b-4fc9-81d6-463fd637722c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.321854 Aug 04 10:43:55.692490 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 458/923] 10.222.0.121 () {60 vars in 1328 bytes} [Thu Aug 4 10:43:55 2022] POST /compute/v2.1/servers/1f24d364-de0b-4fc9-81d6-463fd637722c/os-volume_attachments => generated 194 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:44:02.626899 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-86232950-1dbb-48f8-8b99-11a54026402f tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:44:02.627604 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-86232950-1dbb-48f8-8b99-11a54026402f tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] [instance: ec14be1f-7e78-45e3-a70a-587a47b2d1c9] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:44:02.647506 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-86232950-1dbb-48f8-8b99-11a54026402f tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:44:02.648002 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-86232950-1dbb-48f8-8b99-11a54026402f tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:44:02.649047 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-86232950-1dbb-48f8-8b99-11a54026402f tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:44:02.649501 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-86232950-1dbb-48f8-8b99-11a54026402f tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:44:02.678479 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-86232950-1dbb-48f8-8b99-11a54026402f tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] [instance: ec14be1f-7e78-45e3-a70a-587a47b2d1c9] Going to try to terminate instance {{(pid=124457) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 10:44:02.707369 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [req-41a2dbf9-ce52-43be-bf18-84c39124b7c7 req-0c841abd-496d-4930-a288-ca4d5eecb897 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec14be1f-7e78-45e3-a70a-587a47b2d1c9", "tag": "c3025d1c-cab8-4711-9bcc-0663813275c3"}]} {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:44:02.722099 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [req-41a2dbf9-ce52-43be-bf18-84c39124b7c7 req-0c841abd-496d-4930-a288-ca4d5eecb897 service nova] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:44:02.722553 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [req-41a2dbf9-ce52-43be-bf18-84c39124b7c7 req-0c841abd-496d-4930-a288-ca4d5eecb897 service nova] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:44:02.735577 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.compute.server_external_events [req-41a2dbf9-ce52-43be-bf18-84c39124b7c7 req-0c841abd-496d-4930-a288-ca4d5eecb897 service nova] Creating event network-changed:c3025d1c-cab8-4711-9bcc-0663813275c3 for instance ec14be1f-7e78-45e3-a70a-587a47b2d1c9 on hv-cinder-85200 Aug 04 10:44:02.741550 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [req-41a2dbf9-ce52-43be-bf18-84c39124b7c7 req-0c841abd-496d-4930-a288-ca4d5eecb897 service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111984 Aug 04 10:44:02.742935 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 459/924] 10.222.0.121 () {64 vars in 1322 bytes} [Thu Aug 4 10:44:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:44:02.784725 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-86232950-1dbb-48f8-8b99-11a54026402f tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] 10.222.0.121 "DELETE /compute/v2.1/servers/ec14be1f-7e78-45e3-a70a-587a47b2d1c9" status: 204 len: 0 microversion: 2.1 time: 0.162182 Aug 04 10:44:02.790013 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 466/925] 10.222.0.121 () {58 vars in 1244 bytes} [Thu Aug 4 10:44:02 2022] DELETE /compute/v2.1/servers/ec14be1f-7e78-45e3-a70a-587a47b2d1c9 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 10:44:02.796586 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-0ec78b35-51f1-4710-89e6-a63530c2204b tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:44:02.797726 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-0ec78b35-51f1-4710-89e6-a63530c2204b tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] [instance: ec14be1f-7e78-45e3-a70a-587a47b2d1c9] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:44:02.806286 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-0ec78b35-51f1-4710-89e6-a63530c2204b tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:44:02.806748 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-0ec78b35-51f1-4710-89e6-a63530c2204b tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:44:02.807599 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-0ec78b35-51f1-4710-89e6-a63530c2204b tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:44:02.808027 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-0ec78b35-51f1-4710-89e6-a63530c2204b tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:44:02.972976 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-0ec78b35-51f1-4710-89e6-a63530c2204b tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6921033062424e14bc30f9b94bf911db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bee0d982e3ba4f7dba65f51636856b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:44:02.980914 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-0ec78b35-51f1-4710-89e6-a63530c2204b tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] 10.222.0.121 "GET /compute/v2.1/servers/ec14be1f-7e78-45e3-a70a-587a47b2d1c9" status: 200 len: 1570 microversion: 2.1 time: 0.189816 Aug 04 10:44:02.981525 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 460/926] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:44:02 2022] GET /compute/v2.1/servers/ec14be1f-7e78-45e3-a70a-587a47b2d1c9 => generated 1570 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:44:03.257466 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-8b9a7c3f-7994-4d9b-8ee7-e236d5c077b5 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:44:03.260778 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-8b9a7c3f-7994-4d9b-8ee7-e236d5c077b5 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] [instance: 1f24d364-de0b-4fc9-81d6-463fd637722c] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:44:03.267794 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-8b9a7c3f-7994-4d9b-8ee7-e236d5c077b5 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:44:03.268297 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-8b9a7c3f-7994-4d9b-8ee7-e236d5c077b5 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:44:03.269095 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-8b9a7c3f-7994-4d9b-8ee7-e236d5c077b5 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:44:03.269544 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-8b9a7c3f-7994-4d9b-8ee7-e236d5c077b5 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:44:03.303510 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-8b9a7c3f-7994-4d9b-8ee7-e236d5c077b5 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] 10.222.0.121 "GET /compute/v2.1/servers/1f24d364-de0b-4fc9-81d6-463fd637722c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050765 Aug 04 10:44:03.304154 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 467/927] 10.222.0.121 () {58 vars in 1307 bytes} [Thu Aug 4 10:44:03 2022] GET /compute/v2.1/servers/1f24d364-de0b-4fc9-81d6-463fd637722c/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:44:03.315587 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-4e79491f-65b9-482a-88f4-07d5ffe6adcd tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:44:03.316269 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-4e79491f-65b9-482a-88f4-07d5ffe6adcd tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] [instance: 1f24d364-de0b-4fc9-81d6-463fd637722c] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:44:03.323261 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-4e79491f-65b9-482a-88f4-07d5ffe6adcd tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:44:03.323725 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-4e79491f-65b9-482a-88f4-07d5ffe6adcd tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:44:03.324681 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-4e79491f-65b9-482a-88f4-07d5ffe6adcd tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:44:03.325384 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-4e79491f-65b9-482a-88f4-07d5ffe6adcd tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:44:03.357091 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-4e79491f-65b9-482a-88f4-07d5ffe6adcd tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] 10.222.0.121 "GET /compute/v2.1/servers/1f24d364-de0b-4fc9-81d6-463fd637722c/os-volume_attachments/5b9bec70-22eb-4090-abe7-bbd9dc8be80b" status: 200 len: 194 microversion: 2.1 time: 0.045742 Aug 04 10:44:03.358017 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 461/928] 10.222.0.121 () {58 vars in 1418 bytes} [Thu Aug 4 10:44:03 2022] GET /compute/v2.1/servers/1f24d364-de0b-4fc9-81d6-463fd637722c/os-volume_attachments/5b9bec70-22eb-4090-abe7-bbd9dc8be80b => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:44:04.003098 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-7a72b5f0-8421-4a8e-8de5-7d2819061033 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:44:04.003806 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-7a72b5f0-8421-4a8e-8de5-7d2819061033 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] [instance: ec14be1f-7e78-45e3-a70a-587a47b2d1c9] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:44:04.011413 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-7a72b5f0-8421-4a8e-8de5-7d2819061033 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:44:04.011869 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-7a72b5f0-8421-4a8e-8de5-7d2819061033 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:44:04.012703 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-7a72b5f0-8421-4a8e-8de5-7d2819061033 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:44:04.013133 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-7a72b5f0-8421-4a8e-8de5-7d2819061033 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:44:04.427086 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-7a72b5f0-8421-4a8e-8de5-7d2819061033 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6921033062424e14bc30f9b94bf911db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bee0d982e3ba4f7dba65f51636856b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:44:04.438357 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-7a72b5f0-8421-4a8e-8de5-7d2819061033 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] 10.222.0.121 "GET /compute/v2.1/servers/ec14be1f-7e78-45e3-a70a-587a47b2d1c9" status: 200 len: 1570 microversion: 2.1 time: 0.439248 Aug 04 10:44:04.439137 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 468/929] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:44:03 2022] GET /compute/v2.1/servers/ec14be1f-7e78-45e3-a70a-587a47b2d1c9 => generated 1570 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:44:04.741221 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-8e6aab08-b0d5-4b9b-a72c-ad2fe349f09f tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4592814d-5654-44e3-ad00-abff72a2af51"}} {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:44:04.743763 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-8e6aab08-b0d5-4b9b-a72c-ad2fe349f09f tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] [instance: 1f24d364-de0b-4fc9-81d6-463fd637722c] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:44:04.751889 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-8e6aab08-b0d5-4b9b-a72c-ad2fe349f09f tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:44:04.752352 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-8e6aab08-b0d5-4b9b-a72c-ad2fe349f09f tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:44:04.753826 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-8e6aab08-b0d5-4b9b-a72c-ad2fe349f09f tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:44:04.753826 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-8e6aab08-b0d5-4b9b-a72c-ad2fe349f09f tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:44:05.047738 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-8e6aab08-b0d5-4b9b-a72c-ad2fe349f09f tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] 10.222.0.121 "POST /compute/v2.1/servers/1f24d364-de0b-4fc9-81d6-463fd637722c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.313917 Aug 04 10:44:05.054423 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 462/930] 10.222.0.121 () {60 vars in 1328 bytes} [Thu Aug 4 10:44:04 2022] POST /compute/v2.1/servers/1f24d364-de0b-4fc9-81d6-463fd637722c/os-volume_attachments => generated 194 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:44:05.460520 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-3276cf91-15ac-4ce3-b897-f483f2858738 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:44:05.461599 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-3276cf91-15ac-4ce3-b897-f483f2858738 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] [instance: ec14be1f-7e78-45e3-a70a-587a47b2d1c9] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:44:05.470010 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-3276cf91-15ac-4ce3-b897-f483f2858738 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:44:05.470750 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-3276cf91-15ac-4ce3-b897-f483f2858738 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:44:05.472134 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-3276cf91-15ac-4ce3-b897-f483f2858738 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:44:05.472580 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-3276cf91-15ac-4ce3-b897-f483f2858738 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:44:05.476637 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [req-480e5b5b-e173-4988-9de6-f4c6a5df3bad req-d855c56c-50d7-4802-902c-c86537b5dc4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec14be1f-7e78-45e3-a70a-587a47b2d1c9", "name": "network-vif-deleted", "tag": "c3025d1c-cab8-4711-9bcc-0663813275c3"}]} {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:44:05.489309 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [req-480e5b5b-e173-4988-9de6-f4c6a5df3bad req-d855c56c-50d7-4802-902c-c86537b5dc4d service nova] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:44:05.490515 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [req-480e5b5b-e173-4988-9de6-f4c6a5df3bad req-d855c56c-50d7-4802-902c-c86537b5dc4d service nova] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:44:05.503108 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.compute.server_external_events [req-480e5b5b-e173-4988-9de6-f4c6a5df3bad req-d855c56c-50d7-4802-902c-c86537b5dc4d service nova] Creating event network-vif-deleted:c3025d1c-cab8-4711-9bcc-0663813275c3 for instance ec14be1f-7e78-45e3-a70a-587a47b2d1c9 on hv-cinder-85200 Aug 04 10:44:05.508241 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [req-480e5b5b-e173-4988-9de6-f4c6a5df3bad req-d855c56c-50d7-4802-902c-c86537b5dc4d service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102516 Aug 04 10:44:05.508863 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 469/931] 10.222.0.121 () {64 vars in 1322 bytes} [Thu Aug 4 10:44:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:44:05.550133 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-3276cf91-15ac-4ce3-b897-f483f2858738 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6921033062424e14bc30f9b94bf911db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bee0d982e3ba4f7dba65f51636856b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:44:05.558350 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-3276cf91-15ac-4ce3-b897-f483f2858738 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] 10.222.0.121 "GET /compute/v2.1/servers/ec14be1f-7e78-45e3-a70a-587a47b2d1c9" status: 200 len: 1221 microversion: 2.1 time: 0.102083 Aug 04 10:44:05.558911 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 463/932] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:44:05 2022] GET /compute/v2.1/servers/ec14be1f-7e78-45e3-a70a-587a47b2d1c9 => generated 1221 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:44:06.580557 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-6e6d6668-dd85-49b0-927e-c5c3a725f653 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:44:06.581282 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-6e6d6668-dd85-49b0-927e-c5c3a725f653 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] [instance: ec14be1f-7e78-45e3-a70a-587a47b2d1c9] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:44:06.588860 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-6e6d6668-dd85-49b0-927e-c5c3a725f653 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:44:06.589334 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-6e6d6668-dd85-49b0-927e-c5c3a725f653 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:44:06.590138 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-6e6d6668-dd85-49b0-927e-c5c3a725f653 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:44:06.590578 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-6e6d6668-dd85-49b0-927e-c5c3a725f653 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:44:06.605891 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.wsgi [None req-6e6d6668-dd85-49b0-927e-c5c3a725f653 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] HTTP exception thrown: Instance ec14be1f-7e78-45e3-a70a-587a47b2d1c9 could not be found. Aug 04 10:44:06.607594 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-6e6d6668-dd85-49b0-927e-c5c3a725f653 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Request method failure captured: Aug 04 10:44:06.607594 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: request: GET /compute/v2.1/servers/ec14be1f-7e78-45e3-a70a-587a47b2d1c9 HTTP/1.1 Aug 04 10:44:06.607594 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: Accept: application/json Aug 04 10:44:06.607594 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: Accept-Encoding: identity Aug 04 10:44:06.607594 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: Connection: close Aug 04 10:44:06.607594 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: Content-Length: 0 Aug 04 10:44:06.607594 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: Content-Type: application/json Aug 04 10:44:06.607594 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: Host: 10.222.0.121 Aug 04 10:44:06.607594 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: Openstack-System-Scope: None Aug 04 10:44:06.607594 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: User-Agent: python-urllib3/1.26.11 Aug 04 10:44:06.607594 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Auth-Token: gAAAAABi66FayaRjTrlUye9sTBFqA9o8pHpojEkfk2BX6bFd_H3jICWsKwiJXoNheHbfu44O7ZG4GqAFPS1SN4sj5rACDB9BPcb1-kmHNarQnibJAe7Z-eHkTbjyCKSv2NxanoNwjFI8vksMycOW0Y5qbNCEsIHCra7bYd2WFObQah0KdR4EvCw Aug 04 10:44:06.607594 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Domain-Id: None Aug 04 10:44:06.607594 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Domain-Name: None Aug 04 10:44:06.607594 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Identity-Status: Confirmed Aug 04 10:44:06.607594 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Is-Admin-Project: True Aug 04 10:44:06.607594 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Project-Domain-Id: default Aug 04 10:44:06.607594 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Project-Domain-Name: Default Aug 04 10:44:06.607594 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Project-Id: bee0d982e3ba4f7dba65f51636856b5a Aug 04 10:44:06.607594 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Project-Name: tempest-TestShelveInstance-801495382 Aug 04 10:44:06.607594 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Role: reader,member Aug 04 10:44:06.607594 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Roles: reader,member Aug 04 10:44:06.609446 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/bee0d982e3ba4f7dba65f51636856b5a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/bee0d982e3ba4f7dba65f51636856b5a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.121:8080", "publicURL": "http://10.222.0.121:8080/v1/AUTH_bee0d982e3ba4f7dba65f51636856b5a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2/bee0d982e3ba4f7dba65f51636856b5a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:9696/networking"}]}] Aug 04 10:44:06.609446 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Tenant: tempest-TestShelveInstance-801495382 Aug 04 10:44:06.609446 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Tenant-Id: bee0d982e3ba4f7dba65f51636856b5a Aug 04 10:44:06.609446 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Tenant-Name: tempest-TestShelveInstance-801495382 Aug 04 10:44:06.609446 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-User: tempest-TestShelveInstance-801495382-project Aug 04 10:44:06.609446 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-User-Domain-Id: default Aug 04 10:44:06.609446 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-User-Domain-Name: Default Aug 04 10:44:06.609446 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-User-Id: 6921033062424e14bc30f9b94bf911db Aug 04 10:44:06.609446 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-User-Name: tempest-TestShelveInstance-801495382-project Aug 04 10:44:06.609446 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: method: > Aug 04 10:44:06.609446 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: exception: Instance ec14be1f-7e78-45e3-a70a-587a47b2d1c9 could not be found. Aug 04 10:44:06.609446 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: action_args: {'id': 'ec14be1f-7e78-45e3-a70a-587a47b2d1c9'} Aug 04 10:44:06.610455 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 10:44:06.610455 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:44:06.610455 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 10:44:06.610455 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 10:44:06.610455 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 10:44:06.610455 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 10:44:06.610455 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 10:44:06.610455 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 10:44:06.610455 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 10:44:06.610455 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 10:44:06.610455 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ec14be1f-7e78-45e3-a70a-587a47b2d1c9 could not be found. Aug 04 10:44:06.610455 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Aug 04 10:44:06.610455 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:44:06.610455 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Aug 04 10:44:06.610455 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:44:06.610455 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:44:06.610455 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:44:06.610455 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 10:44:06.610455 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 10:44:06.610455 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 10:44:06.612122 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 10:44:06.612122 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 10:44:06.612122 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 10:44:06.612122 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 10:44:06.612122 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 10:44:06.612122 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 10:44:06.612122 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 10:44:06.612122 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ec14be1f-7e78-45e3-a70a-587a47b2d1c9 could not be found. Aug 04 10:44:06.612122 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Aug 04 10:44:06.612122 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:44:06.612122 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Aug 04 10:44:06.612122 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:44:06.612122 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:44:06.612122 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:44:06.612122 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 10:44:06.612122 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 10:44:06.612122 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ec14be1f-7e78-45e3-a70a-587a47b2d1c9 could not be found. Aug 04 10:44:06.612122 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Aug 04 10:44:06.613539 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-6e6d6668-dd85-49b0-927e-c5c3a725f653 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Returning 404 to user: Instance ec14be1f-7e78-45e3-a70a-587a47b2d1c9 could not be found. {{(pid=124457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 10:44:06.613539 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-6e6d6668-dd85-49b0-927e-c5c3a725f653 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] 10.222.0.121 "GET /compute/v2.1/servers/ec14be1f-7e78-45e3-a70a-587a47b2d1c9" status: 404 len: 111 microversion: 2.1 time: 0.033743 Aug 04 10:44:06.613539 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 470/933] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:44:06 2022] GET /compute/v2.1/servers/ec14be1f-7e78-45e3-a70a-587a47b2d1c9 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 10:44:06.799938 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-3bd60346-1abe-42e7-806e-1d4463191f78 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] Calling method '.version_select at 0x7f6754deaa60>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:44:06.829092 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-3bd60346-1abe-42e7-806e-1d4463191f78 tempest-TestShelveInstance-801495382 tempest-TestShelveInstance-801495382-project] 10.222.0.121 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-392572535" status: 202 len: 0 microversion: 2.1 time: 0.033013 Aug 04 10:44:06.829889 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 464/934] 10.222.0.121 () {58 vars in 1256 bytes} [Thu Aug 4 10:44:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-392572535 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 10:44:12.689792 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-c05b506f-e664-416f-84b2-e08cf580d894 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:44:12.694087 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-c05b506f-e664-416f-84b2-e08cf580d894 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] [instance: 1f24d364-de0b-4fc9-81d6-463fd637722c] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:44:12.703898 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-c05b506f-e664-416f-84b2-e08cf580d894 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:44:12.704396 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-c05b506f-e664-416f-84b2-e08cf580d894 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:44:12.705356 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-c05b506f-e664-416f-84b2-e08cf580d894 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:44:12.705804 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-c05b506f-e664-416f-84b2-e08cf580d894 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:44:12.739383 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-c05b506f-e664-416f-84b2-e08cf580d894 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] 10.222.0.121 "GET /compute/v2.1/servers/1f24d364-de0b-4fc9-81d6-463fd637722c/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.057104 Aug 04 10:44:12.740207 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 471/935] 10.222.0.121 () {58 vars in 1307 bytes} [Thu Aug 4 10:44:12 2022] GET /compute/v2.1/servers/1f24d364-de0b-4fc9-81d6-463fd637722c/os-volume_attachments => generated 371 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:44:12.912172 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-e47469c1-498b-449e-a5c1-2980de5dd635 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:44:12.914434 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-e47469c1-498b-449e-a5c1-2980de5dd635 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] [instance: 1f24d364-de0b-4fc9-81d6-463fd637722c] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:44:12.925436 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-e47469c1-498b-449e-a5c1-2980de5dd635 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:44:12.926180 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-e47469c1-498b-449e-a5c1-2980de5dd635 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:44:12.927451 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-e47469c1-498b-449e-a5c1-2980de5dd635 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:44:12.928160 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-e47469c1-498b-449e-a5c1-2980de5dd635 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:44:12.968479 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-e47469c1-498b-449e-a5c1-2980de5dd635 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] 10.222.0.121 "GET /compute/v2.1/servers/1f24d364-de0b-4fc9-81d6-463fd637722c/os-volume_attachments/5b9bec70-22eb-4090-abe7-bbd9dc8be80b" status: 200 len: 194 microversion: 2.1 time: 0.065686 Aug 04 10:44:12.969538 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 465/936] 10.222.0.121 () {58 vars in 1418 bytes} [Thu Aug 4 10:44:12 2022] GET /compute/v2.1/servers/1f24d364-de0b-4fc9-81d6-463fd637722c/os-volume_attachments/5b9bec70-22eb-4090-abe7-bbd9dc8be80b => generated 194 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:44:12.987900 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-4791e80a-fe2e-4b6f-871f-fe8e59a4680d tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:44:12.989008 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-4791e80a-fe2e-4b6f-871f-fe8e59a4680d tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] [instance: 1f24d364-de0b-4fc9-81d6-463fd637722c] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:44:13.014083 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-4791e80a-fe2e-4b6f-871f-fe8e59a4680d tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:44:13.014926 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-4791e80a-fe2e-4b6f-871f-fe8e59a4680d tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:44:13.019648 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-4791e80a-fe2e-4b6f-871f-fe8e59a4680d tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:44:13.020604 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-4791e80a-fe2e-4b6f-871f-fe8e59a4680d tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:44:13.155040 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.objects.instance [None req-4791e80a-fe2e-4b6f-871f-fe8e59a4680d tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lazy-loading 'services' on Instance uuid 1f24d364-de0b-4fc9-81d6-463fd637722c {{(pid=124457) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 10:44:13.294823 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-4791e80a-fe2e-4b6f-871f-fe8e59a4680d tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] 10.222.0.121 "DELETE /compute/v2.1/servers/1f24d364-de0b-4fc9-81d6-463fd637722c/os-volume_attachments/5b9bec70-22eb-4090-abe7-bbd9dc8be80b" status: 202 len: 0 microversion: 2.1 time: 0.314512 Aug 04 10:44:13.295439 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 472/937] 10.222.0.121 () {58 vars in 1421 bytes} [Thu Aug 4 10:44:12 2022] DELETE /compute/v2.1/servers/1f24d364-de0b-4fc9-81d6-463fd637722c/os-volume_attachments/5b9bec70-22eb-4090-abe7-bbd9dc8be80b => generated 0 bytes in 317 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 10:44:15.535531 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-80eca89a-5d65-488e-bbbe-9ec9b2f4aaa5 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:44:15.536173 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-80eca89a-5d65-488e-bbbe-9ec9b2f4aaa5 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] [instance: 1f24d364-de0b-4fc9-81d6-463fd637722c] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:44:15.542751 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-80eca89a-5d65-488e-bbbe-9ec9b2f4aaa5 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:44:15.543217 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-80eca89a-5d65-488e-bbbe-9ec9b2f4aaa5 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:44:15.543996 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-80eca89a-5d65-488e-bbbe-9ec9b2f4aaa5 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:44:15.544468 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-80eca89a-5d65-488e-bbbe-9ec9b2f4aaa5 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:44:15.574767 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-80eca89a-5d65-488e-bbbe-9ec9b2f4aaa5 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] 10.222.0.121 "GET /compute/v2.1/servers/1f24d364-de0b-4fc9-81d6-463fd637722c/os-volume_attachments/4592814d-5654-44e3-ad00-abff72a2af51" status: 200 len: 194 microversion: 2.1 time: 0.044241 Aug 04 10:44:15.575379 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 466/938] 10.222.0.121 () {58 vars in 1418 bytes} [Thu Aug 4 10:44:15 2022] GET /compute/v2.1/servers/1f24d364-de0b-4fc9-81d6-463fd637722c/os-volume_attachments/4592814d-5654-44e3-ad00-abff72a2af51 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:44:15.590143 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-803b2560-3bc2-4d66-af2b-03672ccbaf39 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:44:15.590703 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-803b2560-3bc2-4d66-af2b-03672ccbaf39 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] [instance: 1f24d364-de0b-4fc9-81d6-463fd637722c] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:44:15.599310 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-803b2560-3bc2-4d66-af2b-03672ccbaf39 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:44:15.599775 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-803b2560-3bc2-4d66-af2b-03672ccbaf39 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:44:15.600612 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-803b2560-3bc2-4d66-af2b-03672ccbaf39 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:44:15.601061 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-803b2560-3bc2-4d66-af2b-03672ccbaf39 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:44:15.690971 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.objects.instance [None req-803b2560-3bc2-4d66-af2b-03672ccbaf39 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lazy-loading 'services' on Instance uuid 1f24d364-de0b-4fc9-81d6-463fd637722c {{(pid=124457) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 10:44:15.771409 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-803b2560-3bc2-4d66-af2b-03672ccbaf39 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] 10.222.0.121 "DELETE /compute/v2.1/servers/1f24d364-de0b-4fc9-81d6-463fd637722c/os-volume_attachments/4592814d-5654-44e3-ad00-abff72a2af51" status: 202 len: 0 microversion: 2.1 time: 0.188223 Aug 04 10:44:15.772057 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 473/939] 10.222.0.121 () {58 vars in 1421 bytes} [Thu Aug 4 10:44:15 2022] DELETE /compute/v2.1/servers/1f24d364-de0b-4fc9-81d6-463fd637722c/os-volume_attachments/4592814d-5654-44e3-ad00-abff72a2af51 => generated 0 bytes in 190 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 10:44:16.955116 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-c4a847cd-8f17-4635-9509-475d85e3c6a2 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:44:16.958260 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-c4a847cd-8f17-4635-9509-475d85e3c6a2 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] [instance: 1f24d364-de0b-4fc9-81d6-463fd637722c] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:44:16.968626 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-c4a847cd-8f17-4635-9509-475d85e3c6a2 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:44:16.969170 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-c4a847cd-8f17-4635-9509-475d85e3c6a2 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:44:16.969962 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-c4a847cd-8f17-4635-9509-475d85e3c6a2 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:44:16.970406 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-c4a847cd-8f17-4635-9509-475d85e3c6a2 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:44:17.002241 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-c4a847cd-8f17-4635-9509-475d85e3c6a2 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] 10.222.0.121 "GET /compute/v2.1/servers/1f24d364-de0b-4fc9-81d6-463fd637722c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053803 Aug 04 10:44:17.002830 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 467/940] 10.222.0.121 () {58 vars in 1307 bytes} [Thu Aug 4 10:44:16 2022] GET /compute/v2.1/servers/1f24d364-de0b-4fc9-81d6-463fd637722c/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 10:44:17.127748 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-47d0285e-45c1-4f94-ac6a-e17cb8a996c9 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:44:17.130126 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-47d0285e-45c1-4f94-ac6a-e17cb8a996c9 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] [instance: 1f24d364-de0b-4fc9-81d6-463fd637722c] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:44:17.137448 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-47d0285e-45c1-4f94-ac6a-e17cb8a996c9 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:44:17.137982 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-47d0285e-45c1-4f94-ac6a-e17cb8a996c9 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:44:17.138787 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-47d0285e-45c1-4f94-ac6a-e17cb8a996c9 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:44:17.139239 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-47d0285e-45c1-4f94-ac6a-e17cb8a996c9 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:44:17.177824 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-47d0285e-45c1-4f94-ac6a-e17cb8a996c9 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] 10.222.0.121 "GET /compute/v2.1/servers/1f24d364-de0b-4fc9-81d6-463fd637722c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.054665 Aug 04 10:44:17.178374 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 474/941] 10.222.0.121 () {58 vars in 1307 bytes} [Thu Aug 4 10:44:17 2022] GET /compute/v2.1/servers/1f24d364-de0b-4fc9-81d6-463fd637722c/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 10:44:17.196521 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-645d7050-2c12-4193-818a-a3fc7938a1d3 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:44:17.197530 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-645d7050-2c12-4193-818a-a3fc7938a1d3 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] [instance: b0d153c5-90d0-4814-92ec-6f237601def9] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:44:17.205121 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-645d7050-2c12-4193-818a-a3fc7938a1d3 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:44:17.205568 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-645d7050-2c12-4193-818a-a3fc7938a1d3 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:44:17.206243 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-645d7050-2c12-4193-818a-a3fc7938a1d3 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:44:17.206688 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-645d7050-2c12-4193-818a-a3fc7938a1d3 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:44:17.235255 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-645d7050-2c12-4193-818a-a3fc7938a1d3 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] 10.222.0.121 "GET /compute/v2.1/servers/b0d153c5-90d0-4814-92ec-6f237601def9/ips" status: 200 len: 152 microversion: 2.20 time: 0.042799 Aug 04 10:44:17.235861 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 468/942] 10.222.0.121 () {60 vars in 1294 bytes} [Thu Aug 4 10:44:17 2022] GET /compute/v2.1/servers/b0d153c5-90d0-4814-92ec-6f237601def9/ips => generated 152 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 10:44:17.248182 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-a7e31e98-98ec-4943-9d6f-2619ab61e195 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:44:17.248701 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-a7e31e98-98ec-4943-9d6f-2619ab61e195 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] [instance: 1f24d364-de0b-4fc9-81d6-463fd637722c] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:44:17.255657 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-a7e31e98-98ec-4943-9d6f-2619ab61e195 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:44:17.256253 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-a7e31e98-98ec-4943-9d6f-2619ab61e195 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:44:17.257126 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-a7e31e98-98ec-4943-9d6f-2619ab61e195 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:44:17.257656 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-a7e31e98-98ec-4943-9d6f-2619ab61e195 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:44:17.285452 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-a7e31e98-98ec-4943-9d6f-2619ab61e195 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] [instance: 1f24d364-de0b-4fc9-81d6-463fd637722c] Going to try to terminate instance {{(pid=124457) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 10:44:17.371995 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-a7e31e98-98ec-4943-9d6f-2619ab61e195 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] 10.222.0.121 "DELETE /compute/v2.1/servers/1f24d364-de0b-4fc9-81d6-463fd637722c" status: 204 len: 0 microversion: 2.1 time: 0.127374 Aug 04 10:44:17.372651 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 475/943] 10.222.0.121 () {58 vars in 1244 bytes} [Thu Aug 4 10:44:17 2022] DELETE /compute/v2.1/servers/1f24d364-de0b-4fc9-81d6-463fd637722c => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 10:44:17.381869 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-8a1ed845-a0b9-4eaa-b0c5-be8af6028ae0 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:44:17.382508 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-8a1ed845-a0b9-4eaa-b0c5-be8af6028ae0 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] [instance: 1f24d364-de0b-4fc9-81d6-463fd637722c] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:44:17.389397 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-8a1ed845-a0b9-4eaa-b0c5-be8af6028ae0 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:44:17.389857 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-8a1ed845-a0b9-4eaa-b0c5-be8af6028ae0 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:44:17.390973 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-8a1ed845-a0b9-4eaa-b0c5-be8af6028ae0 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:44:17.391439 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-8a1ed845-a0b9-4eaa-b0c5-be8af6028ae0 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:44:17.533756 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-8a1ed845-a0b9-4eaa-b0c5-be8af6028ae0 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa2e2a5a6ed4c5c9db91269266dd30b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f46ab11dd0b428486c673afc14b5b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:44:17.544208 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-8a1ed845-a0b9-4eaa-b0c5-be8af6028ae0 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] 10.222.0.121 "GET /compute/v2.1/servers/1f24d364-de0b-4fc9-81d6-463fd637722c" status: 200 len: 1675 microversion: 2.1 time: 0.166462 Aug 04 10:44:17.545196 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 469/944] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:44:17 2022] GET /compute/v2.1/servers/1f24d364-de0b-4fc9-81d6-463fd637722c => generated 1675 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:44:18.567370 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-d81ad0c1-4777-4745-a316-2f73b096dd6d tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:44:18.568103 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-d81ad0c1-4777-4745-a316-2f73b096dd6d tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] [instance: 1f24d364-de0b-4fc9-81d6-463fd637722c] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:44:18.576121 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-d81ad0c1-4777-4745-a316-2f73b096dd6d tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:44:18.576121 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-d81ad0c1-4777-4745-a316-2f73b096dd6d tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:44:18.576855 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-d81ad0c1-4777-4745-a316-2f73b096dd6d tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:44:18.577295 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-d81ad0c1-4777-4745-a316-2f73b096dd6d tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:44:18.733129 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-d81ad0c1-4777-4745-a316-2f73b096dd6d tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa2e2a5a6ed4c5c9db91269266dd30b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f46ab11dd0b428486c673afc14b5b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:44:18.742044 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-d81ad0c1-4777-4745-a316-2f73b096dd6d tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] 10.222.0.121 "GET /compute/v2.1/servers/1f24d364-de0b-4fc9-81d6-463fd637722c" status: 200 len: 1675 microversion: 2.1 time: 0.179334 Aug 04 10:44:18.742663 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 476/945] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:44:18 2022] GET /compute/v2.1/servers/1f24d364-de0b-4fc9-81d6-463fd637722c => generated 1675 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:44:19.360272 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-525e0774-17fa-4e0c-8341-b1b863b31f2e tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:44:19.361284 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-525e0774-17fa-4e0c-8341-b1b863b31f2e tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] [instance: b0d153c5-90d0-4814-92ec-6f237601def9] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:44:19.368590 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-525e0774-17fa-4e0c-8341-b1b863b31f2e tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:44:19.368925 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-525e0774-17fa-4e0c-8341-b1b863b31f2e tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:44:19.369712 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-525e0774-17fa-4e0c-8341-b1b863b31f2e tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:44:19.370180 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-525e0774-17fa-4e0c-8341-b1b863b31f2e tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:44:19.395630 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.objects.instance [None req-525e0774-17fa-4e0c-8341-b1b863b31f2e tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lazy-loading 'flavor' on Instance uuid b0d153c5-90d0-4814-92ec-6f237601def9 {{(pid=124456) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 10:44:19.614204 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-525e0774-17fa-4e0c-8341-b1b863b31f2e tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] 10.222.0.121 "POST /compute/v2.1/servers/b0d153c5-90d0-4814-92ec-6f237601def9/action" status: 202 len: 0 microversion: 2.20 time: 0.259486 Aug 04 10:44:19.616226 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 470/946] 10.222.0.121 () {62 vars in 1324 bytes} [Thu Aug 4 10:44:19 2022] POST /compute/v2.1/servers/b0d153c5-90d0-4814-92ec-6f237601def9/action => generated 0 bytes in 262 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 04 10:44:19.623453 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-cdb3160e-3c53-4e49-95b7-1d3bf790b793 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:44:19.624099 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-cdb3160e-3c53-4e49-95b7-1d3bf790b793 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] [instance: b0d153c5-90d0-4814-92ec-6f237601def9] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:44:19.631764 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-cdb3160e-3c53-4e49-95b7-1d3bf790b793 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:44:19.632257 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-cdb3160e-3c53-4e49-95b7-1d3bf790b793 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:44:19.633045 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-cdb3160e-3c53-4e49-95b7-1d3bf790b793 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:44:19.633488 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-cdb3160e-3c53-4e49-95b7-1d3bf790b793 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:44:19.765223 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-22ed6e5c-a6c1-4901-9374-0bbbe2c7ac1e tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:44:19.766393 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-22ed6e5c-a6c1-4901-9374-0bbbe2c7ac1e tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] [instance: 1f24d364-de0b-4fc9-81d6-463fd637722c] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:44:19.773496 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-22ed6e5c-a6c1-4901-9374-0bbbe2c7ac1e tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:44:19.773952 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-22ed6e5c-a6c1-4901-9374-0bbbe2c7ac1e tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:44:19.774751 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-22ed6e5c-a6c1-4901-9374-0bbbe2c7ac1e tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:44:19.775232 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-22ed6e5c-a6c1-4901-9374-0bbbe2c7ac1e tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:44:19.857896 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-cdb3160e-3c53-4e49-95b7-1d3bf790b793 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:44:19.867105 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-cdb3160e-3c53-4e49-95b7-1d3bf790b793 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:44:19.868835 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-cdb3160e-3c53-4e49-95b7-1d3bf790b793 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:44:19.870152 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-cdb3160e-3c53-4e49-95b7-1d3bf790b793 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] 10.222.0.121 "GET /compute/v2.1/servers/b0d153c5-90d0-4814-92ec-6f237601def9" status: 200 len: 1725 microversion: 2.20 time: 0.251046 Aug 04 10:44:19.884704 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 477/947] 10.222.0.121 () {60 vars in 1282 bytes} [Thu Aug 4 10:44:19 2022] GET /compute/v2.1/servers/b0d153c5-90d0-4814-92ec-6f237601def9 => generated 1725 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:44:19.986569 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-22ed6e5c-a6c1-4901-9374-0bbbe2c7ac1e tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa2e2a5a6ed4c5c9db91269266dd30b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f46ab11dd0b428486c673afc14b5b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:44:19.990425 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG dbcounter [-] [124456] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=6,nova_cell1:INSERT=3 {{(pid=124456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:44:19.995448 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-22ed6e5c-a6c1-4901-9374-0bbbe2c7ac1e tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] 10.222.0.121 "GET /compute/v2.1/servers/1f24d364-de0b-4fc9-81d6-463fd637722c" status: 200 len: 1675 microversion: 2.1 time: 0.235131 Aug 04 10:44:20.008098 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 471/948] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:44:19 2022] GET /compute/v2.1/servers/1f24d364-de0b-4fc9-81d6-463fd637722c => generated 1675 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:44:20.899706 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-dec98b86-8093-44f5-a6e6-e01e3cbb0585 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:44:20.901727 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-dec98b86-8093-44f5-a6e6-e01e3cbb0585 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] [instance: b0d153c5-90d0-4814-92ec-6f237601def9] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:44:20.910732 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-dec98b86-8093-44f5-a6e6-e01e3cbb0585 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:44:20.911605 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-dec98b86-8093-44f5-a6e6-e01e3cbb0585 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:44:20.912942 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-dec98b86-8093-44f5-a6e6-e01e3cbb0585 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:44:20.913582 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-dec98b86-8093-44f5-a6e6-e01e3cbb0585 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:44:20.939420 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG dbcounter [-] [124457] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=2,nova_cell1:INSERT=4 {{(pid=124457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:44:21.024336 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-1c368f44-a8c9-4023-b138-a6d6f48fa675 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:44:21.025658 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-1c368f44-a8c9-4023-b138-a6d6f48fa675 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] [instance: 1f24d364-de0b-4fc9-81d6-463fd637722c] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:44:21.034904 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-1c368f44-a8c9-4023-b138-a6d6f48fa675 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:44:21.035539 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-1c368f44-a8c9-4023-b138-a6d6f48fa675 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:44:21.036451 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-1c368f44-a8c9-4023-b138-a6d6f48fa675 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:44:21.036907 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-1c368f44-a8c9-4023-b138-a6d6f48fa675 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:44:21.134316 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-1c368f44-a8c9-4023-b138-a6d6f48fa675 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa2e2a5a6ed4c5c9db91269266dd30b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f46ab11dd0b428486c673afc14b5b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:44:21.144035 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-1c368f44-a8c9-4023-b138-a6d6f48fa675 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] 10.222.0.121 "GET /compute/v2.1/servers/1f24d364-de0b-4fc9-81d6-463fd637722c" status: 200 len: 1608 microversion: 2.1 time: 0.128218 Aug 04 10:44:21.157239 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 472/949] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:44:21 2022] GET /compute/v2.1/servers/1f24d364-de0b-4fc9-81d6-463fd637722c => generated 1608 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:44:21.164283 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [req-e9a31cab-438d-4adc-b3b6-e61963b19561 req-ff304906-5fbb-4eb0-9004-7f9a13d83d3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f24d364-de0b-4fc9-81d6-463fd637722c", "name": "network-vif-deleted", "tag": "fd99aa60-adfb-4fac-9ff3-016eace2d99d"}]} {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:44:21.178900 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [req-e9a31cab-438d-4adc-b3b6-e61963b19561 req-ff304906-5fbb-4eb0-9004-7f9a13d83d3d service nova] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:44:21.179337 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [req-e9a31cab-438d-4adc-b3b6-e61963b19561 req-ff304906-5fbb-4eb0-9004-7f9a13d83d3d service nova] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:44:21.198616 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.compute.server_external_events [req-e9a31cab-438d-4adc-b3b6-e61963b19561 req-ff304906-5fbb-4eb0-9004-7f9a13d83d3d service nova] Creating event network-vif-deleted:fd99aa60-adfb-4fac-9ff3-016eace2d99d for instance 1f24d364-de0b-4fc9-81d6-463fd637722c on hv-cinder-85200 Aug 04 10:44:21.209811 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [req-e9a31cab-438d-4adc-b3b6-e61963b19561 req-ff304906-5fbb-4eb0-9004-7f9a13d83d3d service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052595 Aug 04 10:44:21.210506 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 473/950] 10.222.0.121 () {64 vars in 1322 bytes} [Thu Aug 4 10:44:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:44:21.211367 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-dec98b86-8093-44f5-a6e6-e01e3cbb0585 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:44:21.221868 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-dec98b86-8093-44f5-a6e6-e01e3cbb0585 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:44:21.223478 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-dec98b86-8093-44f5-a6e6-e01e3cbb0585 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:44:21.224736 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-dec98b86-8093-44f5-a6e6-e01e3cbb0585 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] 10.222.0.121 "GET /compute/v2.1/servers/b0d153c5-90d0-4814-92ec-6f237601def9" status: 200 len: 1725 microversion: 2.20 time: 0.331586 Aug 04 10:44:21.225310 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 478/951] 10.222.0.121 () {60 vars in 1282 bytes} [Thu Aug 4 10:44:20 2022] GET /compute/v2.1/servers/b0d153c5-90d0-4814-92ec-6f237601def9 => generated 1725 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:44:22.170698 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-519414d8-3c8f-4dae-8e30-49e9d706c9b3 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:44:22.171576 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-519414d8-3c8f-4dae-8e30-49e9d706c9b3 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] [instance: 1f24d364-de0b-4fc9-81d6-463fd637722c] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:44:22.182161 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-519414d8-3c8f-4dae-8e30-49e9d706c9b3 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:44:22.182765 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-519414d8-3c8f-4dae-8e30-49e9d706c9b3 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:44:22.183930 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-519414d8-3c8f-4dae-8e30-49e9d706c9b3 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:44:22.184667 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-519414d8-3c8f-4dae-8e30-49e9d706c9b3 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:44:22.200154 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.wsgi [None req-519414d8-3c8f-4dae-8e30-49e9d706c9b3 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] HTTP exception thrown: Instance 1f24d364-de0b-4fc9-81d6-463fd637722c could not be found. Aug 04 10:44:22.201828 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-519414d8-3c8f-4dae-8e30-49e9d706c9b3 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Request method failure captured: Aug 04 10:44:22.201828 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: request: GET /compute/v2.1/servers/1f24d364-de0b-4fc9-81d6-463fd637722c HTTP/1.1 Aug 04 10:44:22.201828 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: Accept: application/json Aug 04 10:44:22.201828 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: Accept-Encoding: identity Aug 04 10:44:22.201828 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: Connection: close Aug 04 10:44:22.201828 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: Content-Length: 0 Aug 04 10:44:22.201828 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: Content-Type: application/json Aug 04 10:44:22.201828 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: Host: 10.222.0.121 Aug 04 10:44:22.201828 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: Openstack-System-Scope: None Aug 04 10:44:22.201828 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: User-Agent: python-urllib3/1.26.11 Aug 04 10:44:22.201828 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Auth-Token: gAAAAABi66BQBuXsA_bT4-GZmN0f9Ka0cXGSipTTL32Akj9bxqipP5mHnx7R7itsoDHiY84MpgYxkTlT5FxaU3F7CRJ_POrtGVAZgOMHqx0cewiPQAaDcRvYwNZJxzhdqH4CB9gMxgSnJA14aWhkIvo9iiaCYPhEs9PxEGNL2J8Ci5KYmHa-yAs Aug 04 10:44:22.201828 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Domain-Id: None Aug 04 10:44:22.201828 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Domain-Name: None Aug 04 10:44:22.201828 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Identity-Status: Confirmed Aug 04 10:44:22.201828 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Is-Admin-Project: True Aug 04 10:44:22.201828 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Project-Domain-Id: default Aug 04 10:44:22.201828 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Project-Domain-Name: Default Aug 04 10:44:22.201828 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Project-Id: 6f46ab11dd0b428486c673afc14b5b63 Aug 04 10:44:22.201828 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Project-Name: tempest-AttachVolumeTestJSON-870835423 Aug 04 10:44:22.201828 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Role: reader,member Aug 04 10:44:22.201828 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Roles: reader,member Aug 04 10:44:22.203582 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/6f46ab11dd0b428486c673afc14b5b63"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/6f46ab11dd0b428486c673afc14b5b63"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.121:8080", "publicURL": "http://10.222.0.121:8080/v1/AUTH_6f46ab11dd0b428486c673afc14b5b63"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2/6f46ab11dd0b428486c673afc14b5b63"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:9696/networking"}]}] Aug 04 10:44:22.203582 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Tenant: tempest-AttachVolumeTestJSON-870835423 Aug 04 10:44:22.203582 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Tenant-Id: 6f46ab11dd0b428486c673afc14b5b63 Aug 04 10:44:22.203582 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Tenant-Name: tempest-AttachVolumeTestJSON-870835423 Aug 04 10:44:22.203582 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-User: tempest-AttachVolumeTestJSON-870835423-project Aug 04 10:44:22.203582 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-User-Domain-Id: default Aug 04 10:44:22.203582 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-User-Domain-Name: Default Aug 04 10:44:22.203582 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-User-Id: 3aa2e2a5a6ed4c5c9db91269266dd30b Aug 04 10:44:22.203582 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-User-Name: tempest-AttachVolumeTestJSON-870835423-project Aug 04 10:44:22.203582 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: method: > Aug 04 10:44:22.203582 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: exception: Instance 1f24d364-de0b-4fc9-81d6-463fd637722c could not be found. Aug 04 10:44:22.203582 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: action_args: {'id': '1f24d364-de0b-4fc9-81d6-463fd637722c'} Aug 04 10:44:22.204590 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 10:44:22.204590 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:44:22.204590 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 10:44:22.204590 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 10:44:22.204590 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 10:44:22.204590 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 10:44:22.204590 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 10:44:22.204590 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 10:44:22.204590 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 10:44:22.204590 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 10:44:22.204590 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f24d364-de0b-4fc9-81d6-463fd637722c could not be found. Aug 04 10:44:22.204590 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi Aug 04 10:44:22.204590 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:44:22.204590 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi Aug 04 10:44:22.204590 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:44:22.204590 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:44:22.204590 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:44:22.204590 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 10:44:22.204590 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 10:44:22.204590 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 10:44:22.206263 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 10:44:22.206263 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 10:44:22.206263 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 10:44:22.206263 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 10:44:22.206263 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 10:44:22.206263 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 10:44:22.206263 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 10:44:22.206263 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f24d364-de0b-4fc9-81d6-463fd637722c could not be found. Aug 04 10:44:22.206263 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi Aug 04 10:44:22.206263 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:44:22.206263 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi Aug 04 10:44:22.206263 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:44:22.206263 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:44:22.206263 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:44:22.206263 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 10:44:22.206263 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 10:44:22.206263 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f24d364-de0b-4fc9-81d6-463fd637722c could not be found. Aug 04 10:44:22.206263 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi Aug 04 10:44:22.207734 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-519414d8-3c8f-4dae-8e30-49e9d706c9b3 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Returning 404 to user: Instance 1f24d364-de0b-4fc9-81d6-463fd637722c could not be found. {{(pid=124456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 10:44:22.207734 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-519414d8-3c8f-4dae-8e30-49e9d706c9b3 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] 10.222.0.121 "GET /compute/v2.1/servers/1f24d364-de0b-4fc9-81d6-463fd637722c" status: 404 len: 111 microversion: 2.1 time: 0.040226 Aug 04 10:44:22.207734 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 474/952] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:44:22 2022] GET /compute/v2.1/servers/1f24d364-de0b-4fc9-81d6-463fd637722c => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 10:44:22.215199 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-afdd0969-20bc-4833-a2f8-4466ac12a9ad tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Calling method '.version_select at 0x7f6754ed0700>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:44:22.239751 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-afdd0969-20bc-4833-a2f8-4466ac12a9ad tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] 10.222.0.121 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2124904170" status: 202 len: 0 microversion: 2.1 time: 0.030206 Aug 04 10:44:22.240483 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 479/953] 10.222.0.121 () {58 vars in 1226 bytes} [Thu Aug 4 10:44:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2124904170 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 10:44:22.248300 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-4ae4d43c-1fba-401d-a7d3-71c668a8aa5c tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:44:22.248936 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-4ae4d43c-1fba-401d-a7d3-71c668a8aa5c tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] [instance: b0d153c5-90d0-4814-92ec-6f237601def9] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:44:22.256096 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-4ae4d43c-1fba-401d-a7d3-71c668a8aa5c tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:44:22.256566 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-4ae4d43c-1fba-401d-a7d3-71c668a8aa5c tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:44:22.257359 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-4ae4d43c-1fba-401d-a7d3-71c668a8aa5c tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:44:22.257798 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-4ae4d43c-1fba-401d-a7d3-71c668a8aa5c tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:44:22.449239 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-4ae4d43c-1fba-401d-a7d3-71c668a8aa5c tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:44:22.459500 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-4ae4d43c-1fba-401d-a7d3-71c668a8aa5c tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:44:22.461445 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-4ae4d43c-1fba-401d-a7d3-71c668a8aa5c tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:44:22.462846 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-4ae4d43c-1fba-401d-a7d3-71c668a8aa5c tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] 10.222.0.121 "GET /compute/v2.1/servers/b0d153c5-90d0-4814-92ec-6f237601def9" status: 200 len: 1725 microversion: 2.20 time: 0.218971 Aug 04 10:44:22.463444 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 475/954] 10.222.0.121 () {60 vars in 1282 bytes} [Thu Aug 4 10:44:22 2022] GET /compute/v2.1/servers/b0d153c5-90d0-4814-92ec-6f237601def9 => generated 1725 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 10:44:23.488707 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-088f3963-8e52-4d50-908f-72620441e9d2 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:44:23.489310 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-088f3963-8e52-4d50-908f-72620441e9d2 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] [instance: b0d153c5-90d0-4814-92ec-6f237601def9] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:44:23.491197 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG dbcounter [-] [124457] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=124457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:44:23.497491 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-088f3963-8e52-4d50-908f-72620441e9d2 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:44:23.497959 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-088f3963-8e52-4d50-908f-72620441e9d2 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:44:23.498761 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-088f3963-8e52-4d50-908f-72620441e9d2 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:44:23.499213 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-088f3963-8e52-4d50-908f-72620441e9d2 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:44:23.647591 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-088f3963-8e52-4d50-908f-72620441e9d2 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:44:23.660973 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-088f3963-8e52-4d50-908f-72620441e9d2 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:44:23.662664 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-088f3963-8e52-4d50-908f-72620441e9d2 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:44:23.663912 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-088f3963-8e52-4d50-908f-72620441e9d2 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] 10.222.0.121 "GET /compute/v2.1/servers/b0d153c5-90d0-4814-92ec-6f237601def9" status: 200 len: 1725 microversion: 2.20 time: 0.180608 Aug 04 10:44:23.664546 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 480/955] 10.222.0.121 () {60 vars in 1282 bytes} [Thu Aug 4 10:44:23 2022] GET /compute/v2.1/servers/b0d153c5-90d0-4814-92ec-6f237601def9 => generated 1725 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:44:24.688593 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-1a089e14-972a-46cb-bbb7-d9989747e0a1 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:44:24.689289 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-1a089e14-972a-46cb-bbb7-d9989747e0a1 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] [instance: b0d153c5-90d0-4814-92ec-6f237601def9] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:44:24.696935 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-1a089e14-972a-46cb-bbb7-d9989747e0a1 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:44:24.697390 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-1a089e14-972a-46cb-bbb7-d9989747e0a1 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:44:24.698169 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-1a089e14-972a-46cb-bbb7-d9989747e0a1 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:44:24.698584 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-1a089e14-972a-46cb-bbb7-d9989747e0a1 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:44:24.846167 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-1a089e14-972a-46cb-bbb7-d9989747e0a1 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:44:24.859711 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-1a089e14-972a-46cb-bbb7-d9989747e0a1 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:44:24.864414 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-1a089e14-972a-46cb-bbb7-d9989747e0a1 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:44:24.864414 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-1a089e14-972a-46cb-bbb7-d9989747e0a1 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] 10.222.0.121 "GET /compute/v2.1/servers/b0d153c5-90d0-4814-92ec-6f237601def9" status: 200 len: 1725 microversion: 2.20 time: 0.180279 Aug 04 10:44:24.865167 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 476/956] 10.222.0.121 () {60 vars in 1282 bytes} [Thu Aug 4 10:44:24 2022] GET /compute/v2.1/servers/b0d153c5-90d0-4814-92ec-6f237601def9 => generated 1725 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:44:25.259529 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-d4f60023-ef99-478f-83f6-62282119cfe3 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:44:25.260206 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-d4f60023-ef99-478f-83f6-62282119cfe3 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] [instance: 1f24d364-de0b-4fc9-81d6-463fd637722c] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:44:25.267507 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-d4f60023-ef99-478f-83f6-62282119cfe3 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:44:25.268113 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-d4f60023-ef99-478f-83f6-62282119cfe3 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:44:25.268956 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-d4f60023-ef99-478f-83f6-62282119cfe3 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:44:25.269410 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-d4f60023-ef99-478f-83f6-62282119cfe3 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:44:25.284355 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.wsgi [None req-d4f60023-ef99-478f-83f6-62282119cfe3 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] HTTP exception thrown: Instance 1f24d364-de0b-4fc9-81d6-463fd637722c could not be found. Aug 04 10:44:25.286085 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-d4f60023-ef99-478f-83f6-62282119cfe3 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Request method failure captured: Aug 04 10:44:25.286085 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: request: DELETE /compute/v2.1/servers/1f24d364-de0b-4fc9-81d6-463fd637722c HTTP/1.1 Aug 04 10:44:25.286085 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: Accept: application/json Aug 04 10:44:25.286085 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: Accept-Encoding: identity Aug 04 10:44:25.286085 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: Connection: close Aug 04 10:44:25.286085 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: Content-Length: 0 Aug 04 10:44:25.286085 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: Content-Type: application/json Aug 04 10:44:25.286085 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: Host: 10.222.0.121 Aug 04 10:44:25.286085 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: Openstack-System-Scope: None Aug 04 10:44:25.286085 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: User-Agent: python-urllib3/1.26.11 Aug 04 10:44:25.286085 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Auth-Token: gAAAAABi66BQBuXsA_bT4-GZmN0f9Ka0cXGSipTTL32Akj9bxqipP5mHnx7R7itsoDHiY84MpgYxkTlT5FxaU3F7CRJ_POrtGVAZgOMHqx0cewiPQAaDcRvYwNZJxzhdqH4CB9gMxgSnJA14aWhkIvo9iiaCYPhEs9PxEGNL2J8Ci5KYmHa-yAs Aug 04 10:44:25.286085 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Domain-Id: None Aug 04 10:44:25.286085 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Domain-Name: None Aug 04 10:44:25.286085 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Identity-Status: Confirmed Aug 04 10:44:25.286085 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Is-Admin-Project: True Aug 04 10:44:25.286085 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Project-Domain-Id: default Aug 04 10:44:25.286085 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Project-Domain-Name: Default Aug 04 10:44:25.286085 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Project-Id: 6f46ab11dd0b428486c673afc14b5b63 Aug 04 10:44:25.286085 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Project-Name: tempest-AttachVolumeTestJSON-870835423 Aug 04 10:44:25.286085 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Role: reader,member Aug 04 10:44:25.286085 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Roles: reader,member Aug 04 10:44:25.287708 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/6f46ab11dd0b428486c673afc14b5b63"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/6f46ab11dd0b428486c673afc14b5b63"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.121:8080", "publicURL": "http://10.222.0.121:8080/v1/AUTH_6f46ab11dd0b428486c673afc14b5b63"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2/6f46ab11dd0b428486c673afc14b5b63"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:9696/networking"}]}] Aug 04 10:44:25.287708 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Tenant: tempest-AttachVolumeTestJSON-870835423 Aug 04 10:44:25.287708 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Tenant-Id: 6f46ab11dd0b428486c673afc14b5b63 Aug 04 10:44:25.287708 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Tenant-Name: tempest-AttachVolumeTestJSON-870835423 Aug 04 10:44:25.287708 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-User: tempest-AttachVolumeTestJSON-870835423-project Aug 04 10:44:25.287708 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-User-Domain-Id: default Aug 04 10:44:25.287708 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-User-Domain-Name: Default Aug 04 10:44:25.287708 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-User-Id: 3aa2e2a5a6ed4c5c9db91269266dd30b Aug 04 10:44:25.287708 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-User-Name: tempest-AttachVolumeTestJSON-870835423-project Aug 04 10:44:25.287708 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: method: > Aug 04 10:44:25.287708 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: exception: Instance 1f24d364-de0b-4fc9-81d6-463fd637722c could not be found. Aug 04 10:44:25.287708 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: action_args: {'id': '1f24d364-de0b-4fc9-81d6-463fd637722c'} Aug 04 10:44:25.288702 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 10:44:25.288702 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:44:25.288702 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 10:44:25.288702 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 10:44:25.288702 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 10:44:25.288702 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 10:44:25.288702 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 10:44:25.288702 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 10:44:25.288702 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 10:44:25.288702 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 10:44:25.288702 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f24d364-de0b-4fc9-81d6-463fd637722c could not be found. Aug 04 10:44:25.288702 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Aug 04 10:44:25.288702 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:44:25.288702 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Aug 04 10:44:25.288702 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:44:25.288702 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:44:25.288702 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:44:25.288702 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 10:44:25.288702 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 10:44:25.288702 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 10:44:25.290104 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 10:44:25.290104 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 10:44:25.290104 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 10:44:25.290104 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 10:44:25.290104 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 10:44:25.290104 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 10:44:25.290104 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 10:44:25.290104 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 10:44:25.290104 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 10:44:25.290104 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f24d364-de0b-4fc9-81d6-463fd637722c could not be found. Aug 04 10:44:25.290104 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Aug 04 10:44:25.290104 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:44:25.290104 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Aug 04 10:44:25.290104 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:44:25.290104 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:44:25.290104 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:44:25.290104 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 10:44:25.290104 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 10:44:25.290104 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f24d364-de0b-4fc9-81d6-463fd637722c could not be found. Aug 04 10:44:25.290104 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Aug 04 10:44:25.291490 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-d4f60023-ef99-478f-83f6-62282119cfe3 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Returning 404 to user: Instance 1f24d364-de0b-4fc9-81d6-463fd637722c could not be found. {{(pid=124457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 10:44:25.291490 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-d4f60023-ef99-478f-83f6-62282119cfe3 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] 10.222.0.121 "DELETE /compute/v2.1/servers/1f24d364-de0b-4fc9-81d6-463fd637722c" status: 404 len: 111 microversion: 2.1 time: 0.032237 Aug 04 10:44:25.291490 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 481/957] 10.222.0.121 () {58 vars in 1244 bytes} [Thu Aug 4 10:44:25 2022] DELETE /compute/v2.1/servers/1f24d364-de0b-4fc9-81d6-463fd637722c => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 10:44:25.298647 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-3490e5ce-6c52-4bb4-86f4-b5997ee0fb57 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:44:25.299474 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-3490e5ce-6c52-4bb4-86f4-b5997ee0fb57 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] [instance: 1f24d364-de0b-4fc9-81d6-463fd637722c] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:44:25.306875 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-3490e5ce-6c52-4bb4-86f4-b5997ee0fb57 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:44:25.307333 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-3490e5ce-6c52-4bb4-86f4-b5997ee0fb57 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:44:25.308173 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-3490e5ce-6c52-4bb4-86f4-b5997ee0fb57 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:44:25.308622 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-3490e5ce-6c52-4bb4-86f4-b5997ee0fb57 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:44:25.322959 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.wsgi [None req-3490e5ce-6c52-4bb4-86f4-b5997ee0fb57 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] HTTP exception thrown: Instance 1f24d364-de0b-4fc9-81d6-463fd637722c could not be found. Aug 04 10:44:25.324608 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-3490e5ce-6c52-4bb4-86f4-b5997ee0fb57 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Request method failure captured: Aug 04 10:44:25.324608 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: request: GET /compute/v2.1/servers/1f24d364-de0b-4fc9-81d6-463fd637722c HTTP/1.1 Aug 04 10:44:25.324608 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: Accept: application/json Aug 04 10:44:25.324608 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: Accept-Encoding: identity Aug 04 10:44:25.324608 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: Connection: close Aug 04 10:44:25.324608 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: Content-Length: 0 Aug 04 10:44:25.324608 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: Content-Type: application/json Aug 04 10:44:25.324608 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: Host: 10.222.0.121 Aug 04 10:44:25.324608 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: Openstack-System-Scope: None Aug 04 10:44:25.324608 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: User-Agent: python-urllib3/1.26.11 Aug 04 10:44:25.324608 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Auth-Token: gAAAAABi66BQBuXsA_bT4-GZmN0f9Ka0cXGSipTTL32Akj9bxqipP5mHnx7R7itsoDHiY84MpgYxkTlT5FxaU3F7CRJ_POrtGVAZgOMHqx0cewiPQAaDcRvYwNZJxzhdqH4CB9gMxgSnJA14aWhkIvo9iiaCYPhEs9PxEGNL2J8Ci5KYmHa-yAs Aug 04 10:44:25.324608 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Domain-Id: None Aug 04 10:44:25.324608 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Domain-Name: None Aug 04 10:44:25.324608 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Identity-Status: Confirmed Aug 04 10:44:25.324608 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Is-Admin-Project: True Aug 04 10:44:25.324608 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Project-Domain-Id: default Aug 04 10:44:25.324608 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Project-Domain-Name: Default Aug 04 10:44:25.324608 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Project-Id: 6f46ab11dd0b428486c673afc14b5b63 Aug 04 10:44:25.324608 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Project-Name: tempest-AttachVolumeTestJSON-870835423 Aug 04 10:44:25.324608 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Role: reader,member Aug 04 10:44:25.324608 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Roles: reader,member Aug 04 10:44:25.326940 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/6f46ab11dd0b428486c673afc14b5b63"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/6f46ab11dd0b428486c673afc14b5b63"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.121:8080", "publicURL": "http://10.222.0.121:8080/v1/AUTH_6f46ab11dd0b428486c673afc14b5b63"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2/6f46ab11dd0b428486c673afc14b5b63"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:9696/networking"}]}] Aug 04 10:44:25.326940 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Tenant: tempest-AttachVolumeTestJSON-870835423 Aug 04 10:44:25.326940 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Tenant-Id: 6f46ab11dd0b428486c673afc14b5b63 Aug 04 10:44:25.326940 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Tenant-Name: tempest-AttachVolumeTestJSON-870835423 Aug 04 10:44:25.326940 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-User: tempest-AttachVolumeTestJSON-870835423-project Aug 04 10:44:25.326940 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-User-Domain-Id: default Aug 04 10:44:25.326940 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-User-Domain-Name: Default Aug 04 10:44:25.326940 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-User-Id: 3aa2e2a5a6ed4c5c9db91269266dd30b Aug 04 10:44:25.326940 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-User-Name: tempest-AttachVolumeTestJSON-870835423-project Aug 04 10:44:25.326940 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: method: > Aug 04 10:44:25.326940 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: exception: Instance 1f24d364-de0b-4fc9-81d6-463fd637722c could not be found. Aug 04 10:44:25.326940 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: action_args: {'id': '1f24d364-de0b-4fc9-81d6-463fd637722c'} Aug 04 10:44:25.328611 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 10:44:25.328611 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:44:25.328611 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 10:44:25.328611 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 10:44:25.328611 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 10:44:25.328611 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 10:44:25.328611 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 10:44:25.328611 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 10:44:25.328611 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 10:44:25.328611 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 10:44:25.328611 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f24d364-de0b-4fc9-81d6-463fd637722c could not be found. Aug 04 10:44:25.328611 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi Aug 04 10:44:25.328611 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:44:25.328611 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi Aug 04 10:44:25.328611 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:44:25.328611 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:44:25.328611 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:44:25.328611 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 10:44:25.328611 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 10:44:25.328611 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 10:44:25.331435 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 10:44:25.331435 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 10:44:25.331435 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 10:44:25.331435 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 10:44:25.331435 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 10:44:25.331435 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 10:44:25.331435 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 10:44:25.331435 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f24d364-de0b-4fc9-81d6-463fd637722c could not be found. Aug 04 10:44:25.331435 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi Aug 04 10:44:25.331435 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:44:25.331435 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi Aug 04 10:44:25.331435 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:44:25.331435 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:44:25.331435 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:44:25.331435 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 10:44:25.331435 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 10:44:25.331435 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f24d364-de0b-4fc9-81d6-463fd637722c could not be found. Aug 04 10:44:25.331435 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi Aug 04 10:44:25.332804 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-3490e5ce-6c52-4bb4-86f4-b5997ee0fb57 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Returning 404 to user: Instance 1f24d364-de0b-4fc9-81d6-463fd637722c could not be found. {{(pid=124456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 10:44:25.332804 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-3490e5ce-6c52-4bb4-86f4-b5997ee0fb57 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] 10.222.0.121 "GET /compute/v2.1/servers/1f24d364-de0b-4fc9-81d6-463fd637722c" status: 404 len: 111 microversion: 2.1 time: 0.033318 Aug 04 10:44:25.332804 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 477/958] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:44:25 2022] GET /compute/v2.1/servers/1f24d364-de0b-4fc9-81d6-463fd637722c => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 10:44:25.894946 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-8e64c57c-3b7a-4dd5-98e8-929d6b637a44 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:44:25.895586 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-8e64c57c-3b7a-4dd5-98e8-929d6b637a44 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] [instance: b0d153c5-90d0-4814-92ec-6f237601def9] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:44:25.903154 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-8e64c57c-3b7a-4dd5-98e8-929d6b637a44 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:44:25.903604 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-8e64c57c-3b7a-4dd5-98e8-929d6b637a44 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:44:25.904455 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-8e64c57c-3b7a-4dd5-98e8-929d6b637a44 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:44:25.904903 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-8e64c57c-3b7a-4dd5-98e8-929d6b637a44 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:44:26.066934 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-8e64c57c-3b7a-4dd5-98e8-929d6b637a44 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:44:26.076781 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-8e64c57c-3b7a-4dd5-98e8-929d6b637a44 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:44:26.078373 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-8e64c57c-3b7a-4dd5-98e8-929d6b637a44 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:44:26.079616 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-8e64c57c-3b7a-4dd5-98e8-929d6b637a44 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] 10.222.0.121 "GET /compute/v2.1/servers/b0d153c5-90d0-4814-92ec-6f237601def9" status: 200 len: 1725 microversion: 2.20 time: 0.190654 Aug 04 10:44:26.080262 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 482/959] 10.222.0.121 () {60 vars in 1282 bytes} [Thu Aug 4 10:44:25 2022] GET /compute/v2.1/servers/b0d153c5-90d0-4814-92ec-6f237601def9 => generated 1725 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:44:26.487383 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-c7f6ab21-7e42-44fd-8ec4-164b9d6f03be tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:44:26.488091 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-c7f6ab21-7e42-44fd-8ec4-164b9d6f03be tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] [instance: 81259012-5f3b-44f6-b979-39119f14929b] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:44:26.490630 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG dbcounter [-] [124456] Writing DB stats nova_api:SELECT=42,nova_api:DELETE=1 {{(pid=124456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:44:26.496715 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-c7f6ab21-7e42-44fd-8ec4-164b9d6f03be tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:44:26.497093 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-c7f6ab21-7e42-44fd-8ec4-164b9d6f03be tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:44:26.497908 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-c7f6ab21-7e42-44fd-8ec4-164b9d6f03be tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:44:26.498378 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-c7f6ab21-7e42-44fd-8ec4-164b9d6f03be tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:44:26.516054 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.wsgi [None req-c7f6ab21-7e42-44fd-8ec4-164b9d6f03be tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] HTTP exception thrown: Instance 81259012-5f3b-44f6-b979-39119f14929b could not be found. Aug 04 10:44:26.517655 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-c7f6ab21-7e42-44fd-8ec4-164b9d6f03be tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Request method failure captured: Aug 04 10:44:26.517655 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: request: DELETE /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b HTTP/1.1 Aug 04 10:44:26.517655 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: Accept: application/json Aug 04 10:44:26.517655 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: Accept-Encoding: identity Aug 04 10:44:26.517655 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: Connection: close Aug 04 10:44:26.517655 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: Content-Length: 0 Aug 04 10:44:26.517655 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: Content-Type: application/json Aug 04 10:44:26.517655 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: Host: 10.222.0.121 Aug 04 10:44:26.517655 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: Openstack-System-Scope: None Aug 04 10:44:26.517655 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: User-Agent: python-urllib3/1.26.11 Aug 04 10:44:26.517655 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Auth-Token: gAAAAABi66BQBuXsA_bT4-GZmN0f9Ka0cXGSipTTL32Akj9bxqipP5mHnx7R7itsoDHiY84MpgYxkTlT5FxaU3F7CRJ_POrtGVAZgOMHqx0cewiPQAaDcRvYwNZJxzhdqH4CB9gMxgSnJA14aWhkIvo9iiaCYPhEs9PxEGNL2J8Ci5KYmHa-yAs Aug 04 10:44:26.517655 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Domain-Id: None Aug 04 10:44:26.517655 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Domain-Name: None Aug 04 10:44:26.517655 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Identity-Status: Confirmed Aug 04 10:44:26.517655 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Is-Admin-Project: True Aug 04 10:44:26.517655 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Project-Domain-Id: default Aug 04 10:44:26.517655 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Project-Domain-Name: Default Aug 04 10:44:26.517655 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Project-Id: 6f46ab11dd0b428486c673afc14b5b63 Aug 04 10:44:26.517655 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Project-Name: tempest-AttachVolumeTestJSON-870835423 Aug 04 10:44:26.517655 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Role: reader,member Aug 04 10:44:26.517655 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Roles: reader,member Aug 04 10:44:26.519353 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/6f46ab11dd0b428486c673afc14b5b63"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/6f46ab11dd0b428486c673afc14b5b63"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.121:8080", "publicURL": "http://10.222.0.121:8080/v1/AUTH_6f46ab11dd0b428486c673afc14b5b63"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2/6f46ab11dd0b428486c673afc14b5b63"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:9696/networking"}]}] Aug 04 10:44:26.519353 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Tenant: tempest-AttachVolumeTestJSON-870835423 Aug 04 10:44:26.519353 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Tenant-Id: 6f46ab11dd0b428486c673afc14b5b63 Aug 04 10:44:26.519353 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Tenant-Name: tempest-AttachVolumeTestJSON-870835423 Aug 04 10:44:26.519353 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-User: tempest-AttachVolumeTestJSON-870835423-project Aug 04 10:44:26.519353 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-User-Domain-Id: default Aug 04 10:44:26.519353 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-User-Domain-Name: Default Aug 04 10:44:26.519353 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-User-Id: 3aa2e2a5a6ed4c5c9db91269266dd30b Aug 04 10:44:26.519353 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-User-Name: tempest-AttachVolumeTestJSON-870835423-project Aug 04 10:44:26.519353 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: method: > Aug 04 10:44:26.519353 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: exception: Instance 81259012-5f3b-44f6-b979-39119f14929b could not be found. Aug 04 10:44:26.519353 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: action_args: {'id': '81259012-5f3b-44f6-b979-39119f14929b'} Aug 04 10:44:26.520620 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 10:44:26.520620 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:44:26.520620 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 10:44:26.520620 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 10:44:26.520620 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 10:44:26.520620 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 10:44:26.520620 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 10:44:26.520620 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 10:44:26.520620 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 10:44:26.520620 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 10:44:26.520620 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 81259012-5f3b-44f6-b979-39119f14929b could not be found. Aug 04 10:44:26.520620 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi Aug 04 10:44:26.520620 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:44:26.520620 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi Aug 04 10:44:26.520620 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:44:26.520620 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:44:26.520620 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:44:26.520620 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 10:44:26.520620 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 10:44:26.520620 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 10:44:26.522629 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 10:44:26.522629 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 10:44:26.522629 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 10:44:26.522629 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 10:44:26.522629 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 10:44:26.522629 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 10:44:26.522629 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 10:44:26.522629 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 10:44:26.522629 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 10:44:26.522629 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 81259012-5f3b-44f6-b979-39119f14929b could not be found. Aug 04 10:44:26.522629 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi Aug 04 10:44:26.522629 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:44:26.522629 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi Aug 04 10:44:26.522629 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:44:26.522629 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:44:26.522629 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:44:26.522629 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 10:44:26.522629 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 10:44:26.522629 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 81259012-5f3b-44f6-b979-39119f14929b could not be found. Aug 04 10:44:26.522629 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi Aug 04 10:44:26.524321 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-c7f6ab21-7e42-44fd-8ec4-164b9d6f03be tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Returning 404 to user: Instance 81259012-5f3b-44f6-b979-39119f14929b could not be found. {{(pid=124456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 10:44:26.524321 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-c7f6ab21-7e42-44fd-8ec4-164b9d6f03be tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] 10.222.0.121 "DELETE /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b" status: 404 len: 111 microversion: 2.1 time: 0.036026 Aug 04 10:44:26.524321 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 478/960] 10.222.0.121 () {58 vars in 1244 bytes} [Thu Aug 4 10:44:26 2022] DELETE /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 10:44:26.529651 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-47fe5f71-0934-4ba7-bd35-7547091b1579 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:44:26.530289 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-47fe5f71-0934-4ba7-bd35-7547091b1579 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] [instance: 81259012-5f3b-44f6-b979-39119f14929b] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:44:26.537533 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-47fe5f71-0934-4ba7-bd35-7547091b1579 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:44:26.538113 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-47fe5f71-0934-4ba7-bd35-7547091b1579 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:44:26.538792 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-47fe5f71-0934-4ba7-bd35-7547091b1579 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:44:26.539586 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-47fe5f71-0934-4ba7-bd35-7547091b1579 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:44:26.554382 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.wsgi [None req-47fe5f71-0934-4ba7-bd35-7547091b1579 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] HTTP exception thrown: Instance 81259012-5f3b-44f6-b979-39119f14929b could not be found. Aug 04 10:44:26.556038 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-47fe5f71-0934-4ba7-bd35-7547091b1579 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Request method failure captured: Aug 04 10:44:26.556038 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: request: GET /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b HTTP/1.1 Aug 04 10:44:26.556038 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: Accept: application/json Aug 04 10:44:26.556038 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: Accept-Encoding: identity Aug 04 10:44:26.556038 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: Connection: close Aug 04 10:44:26.556038 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: Content-Length: 0 Aug 04 10:44:26.556038 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: Content-Type: application/json Aug 04 10:44:26.556038 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: Host: 10.222.0.121 Aug 04 10:44:26.556038 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: Openstack-System-Scope: None Aug 04 10:44:26.556038 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: User-Agent: python-urllib3/1.26.11 Aug 04 10:44:26.556038 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Auth-Token: gAAAAABi66BQBuXsA_bT4-GZmN0f9Ka0cXGSipTTL32Akj9bxqipP5mHnx7R7itsoDHiY84MpgYxkTlT5FxaU3F7CRJ_POrtGVAZgOMHqx0cewiPQAaDcRvYwNZJxzhdqH4CB9gMxgSnJA14aWhkIvo9iiaCYPhEs9PxEGNL2J8Ci5KYmHa-yAs Aug 04 10:44:26.556038 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Domain-Id: None Aug 04 10:44:26.556038 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Domain-Name: None Aug 04 10:44:26.556038 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Identity-Status: Confirmed Aug 04 10:44:26.556038 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Is-Admin-Project: True Aug 04 10:44:26.556038 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Project-Domain-Id: default Aug 04 10:44:26.556038 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Project-Domain-Name: Default Aug 04 10:44:26.556038 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Project-Id: 6f46ab11dd0b428486c673afc14b5b63 Aug 04 10:44:26.556038 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Project-Name: tempest-AttachVolumeTestJSON-870835423 Aug 04 10:44:26.556038 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Role: reader,member Aug 04 10:44:26.556038 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Roles: reader,member Aug 04 10:44:26.557892 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/6f46ab11dd0b428486c673afc14b5b63"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/6f46ab11dd0b428486c673afc14b5b63"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.121:8080", "publicURL": "http://10.222.0.121:8080/v1/AUTH_6f46ab11dd0b428486c673afc14b5b63"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2/6f46ab11dd0b428486c673afc14b5b63"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:9696/networking"}]}] Aug 04 10:44:26.557892 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Tenant: tempest-AttachVolumeTestJSON-870835423 Aug 04 10:44:26.557892 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Tenant-Id: 6f46ab11dd0b428486c673afc14b5b63 Aug 04 10:44:26.557892 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Tenant-Name: tempest-AttachVolumeTestJSON-870835423 Aug 04 10:44:26.557892 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-User: tempest-AttachVolumeTestJSON-870835423-project Aug 04 10:44:26.557892 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-User-Domain-Id: default Aug 04 10:44:26.557892 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-User-Domain-Name: Default Aug 04 10:44:26.557892 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-User-Id: 3aa2e2a5a6ed4c5c9db91269266dd30b Aug 04 10:44:26.557892 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-User-Name: tempest-AttachVolumeTestJSON-870835423-project Aug 04 10:44:26.557892 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: method: > Aug 04 10:44:26.557892 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: exception: Instance 81259012-5f3b-44f6-b979-39119f14929b could not be found. Aug 04 10:44:26.557892 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: action_args: {'id': '81259012-5f3b-44f6-b979-39119f14929b'} Aug 04 10:44:26.558851 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 10:44:26.558851 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:44:26.558851 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 10:44:26.558851 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 10:44:26.558851 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 10:44:26.558851 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 10:44:26.558851 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 10:44:26.558851 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 10:44:26.558851 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 10:44:26.558851 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 10:44:26.558851 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 81259012-5f3b-44f6-b979-39119f14929b could not be found. Aug 04 10:44:26.558851 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Aug 04 10:44:26.558851 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:44:26.558851 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Aug 04 10:44:26.558851 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:44:26.558851 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:44:26.558851 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:44:26.558851 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 10:44:26.558851 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 10:44:26.558851 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 10:44:26.560386 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 10:44:26.560386 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 10:44:26.560386 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 10:44:26.560386 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 10:44:26.560386 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 10:44:26.560386 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 10:44:26.560386 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 10:44:26.560386 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 81259012-5f3b-44f6-b979-39119f14929b could not be found. Aug 04 10:44:26.560386 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Aug 04 10:44:26.560386 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:44:26.560386 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Aug 04 10:44:26.560386 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:44:26.560386 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:44:26.560386 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:44:26.560386 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 10:44:26.560386 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 10:44:26.560386 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 81259012-5f3b-44f6-b979-39119f14929b could not be found. Aug 04 10:44:26.560386 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Aug 04 10:44:26.561944 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-47fe5f71-0934-4ba7-bd35-7547091b1579 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] Returning 404 to user: Instance 81259012-5f3b-44f6-b979-39119f14929b could not be found. {{(pid=124457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 10:44:26.561944 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-47fe5f71-0934-4ba7-bd35-7547091b1579 tempest-AttachVolumeTestJSON-870835423 tempest-AttachVolumeTestJSON-870835423-project] 10.222.0.121 "GET /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b" status: 404 len: 111 microversion: 2.1 time: 0.032069 Aug 04 10:44:26.561944 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 483/961] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:44:26 2022] GET /compute/v2.1/servers/81259012-5f3b-44f6-b979-39119f14929b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 10:44:27.107333 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-2ef4d6c9-f125-4b26-a1ff-90ffdd7d66b3 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:44:27.107982 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-2ef4d6c9-f125-4b26-a1ff-90ffdd7d66b3 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] [instance: b0d153c5-90d0-4814-92ec-6f237601def9] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:44:27.115494 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-2ef4d6c9-f125-4b26-a1ff-90ffdd7d66b3 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:44:27.116070 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-2ef4d6c9-f125-4b26-a1ff-90ffdd7d66b3 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:44:27.116886 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-2ef4d6c9-f125-4b26-a1ff-90ffdd7d66b3 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:44:27.117333 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-2ef4d6c9-f125-4b26-a1ff-90ffdd7d66b3 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:44:27.261642 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-2ef4d6c9-f125-4b26-a1ff-90ffdd7d66b3 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:44:27.272300 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-2ef4d6c9-f125-4b26-a1ff-90ffdd7d66b3 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:44:27.273826 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-2ef4d6c9-f125-4b26-a1ff-90ffdd7d66b3 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:44:27.275044 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-2ef4d6c9-f125-4b26-a1ff-90ffdd7d66b3 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] 10.222.0.121 "GET /compute/v2.1/servers/b0d153c5-90d0-4814-92ec-6f237601def9" status: 200 len: 1725 microversion: 2.20 time: 0.171966 Aug 04 10:44:27.275693 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 479/962] 10.222.0.121 () {60 vars in 1282 bytes} [Thu Aug 4 10:44:27 2022] GET /compute/v2.1/servers/b0d153c5-90d0-4814-92ec-6f237601def9 => generated 1725 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:44:28.298764 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-94d0b6b6-f323-4c39-8edc-2e0e10eccc24 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:44:28.299411 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-94d0b6b6-f323-4c39-8edc-2e0e10eccc24 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] [instance: b0d153c5-90d0-4814-92ec-6f237601def9] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:44:28.306519 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-94d0b6b6-f323-4c39-8edc-2e0e10eccc24 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:44:28.307051 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-94d0b6b6-f323-4c39-8edc-2e0e10eccc24 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:44:28.307970 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-94d0b6b6-f323-4c39-8edc-2e0e10eccc24 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:44:28.308425 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-94d0b6b6-f323-4c39-8edc-2e0e10eccc24 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:44:28.448903 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-94d0b6b6-f323-4c39-8edc-2e0e10eccc24 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:44:28.465671 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-94d0b6b6-f323-4c39-8edc-2e0e10eccc24 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:44:28.467370 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-94d0b6b6-f323-4c39-8edc-2e0e10eccc24 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:44:28.468740 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-94d0b6b6-f323-4c39-8edc-2e0e10eccc24 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] 10.222.0.121 "GET /compute/v2.1/servers/b0d153c5-90d0-4814-92ec-6f237601def9" status: 200 len: 1725 microversion: 2.20 time: 0.174288 Aug 04 10:44:28.469496 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 484/963] 10.222.0.121 () {60 vars in 1282 bytes} [Thu Aug 4 10:44:28 2022] GET /compute/v2.1/servers/b0d153c5-90d0-4814-92ec-6f237601def9 => generated 1725 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:44:29.493233 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-e191ea8d-d25f-4f8f-9d7b-0692663127d0 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:44:29.494056 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-e191ea8d-d25f-4f8f-9d7b-0692663127d0 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] [instance: b0d153c5-90d0-4814-92ec-6f237601def9] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:44:29.502385 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-e191ea8d-d25f-4f8f-9d7b-0692663127d0 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:44:29.502902 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-e191ea8d-d25f-4f8f-9d7b-0692663127d0 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:44:29.503708 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-e191ea8d-d25f-4f8f-9d7b-0692663127d0 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:44:29.504229 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-e191ea8d-d25f-4f8f-9d7b-0692663127d0 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:44:29.673536 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-e191ea8d-d25f-4f8f-9d7b-0692663127d0 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:44:29.683029 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-e191ea8d-d25f-4f8f-9d7b-0692663127d0 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:44:29.684628 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-e191ea8d-d25f-4f8f-9d7b-0692663127d0 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:44:29.685848 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-e191ea8d-d25f-4f8f-9d7b-0692663127d0 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] 10.222.0.121 "GET /compute/v2.1/servers/b0d153c5-90d0-4814-92ec-6f237601def9" status: 200 len: 1725 microversion: 2.20 time: 0.196911 Aug 04 10:44:29.686504 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 480/964] 10.222.0.121 () {60 vars in 1282 bytes} [Thu Aug 4 10:44:29 2022] GET /compute/v2.1/servers/b0d153c5-90d0-4814-92ec-6f237601def9 => generated 1725 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:44:30.708991 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-4efd9a08-bac5-462c-9c46-f424d5fec85f tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:44:30.709616 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-4efd9a08-bac5-462c-9c46-f424d5fec85f tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] [instance: b0d153c5-90d0-4814-92ec-6f237601def9] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:44:30.717052 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-4efd9a08-bac5-462c-9c46-f424d5fec85f tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:44:30.717506 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-4efd9a08-bac5-462c-9c46-f424d5fec85f tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:44:30.718299 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-4efd9a08-bac5-462c-9c46-f424d5fec85f tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:44:30.718720 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-4efd9a08-bac5-462c-9c46-f424d5fec85f tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:44:30.871403 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-4efd9a08-bac5-462c-9c46-f424d5fec85f tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:44:30.887780 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-4efd9a08-bac5-462c-9c46-f424d5fec85f tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:44:30.889354 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-4efd9a08-bac5-462c-9c46-f424d5fec85f tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:44:30.890592 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-4efd9a08-bac5-462c-9c46-f424d5fec85f tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] 10.222.0.121 "GET /compute/v2.1/servers/b0d153c5-90d0-4814-92ec-6f237601def9" status: 200 len: 1725 microversion: 2.20 time: 0.185729 Aug 04 10:44:30.891173 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 485/965] 10.222.0.121 () {60 vars in 1282 bytes} [Thu Aug 4 10:44:30 2022] GET /compute/v2.1/servers/b0d153c5-90d0-4814-92ec-6f237601def9 => generated 1725 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:44:31.915448 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-03eb3dd8-e25e-4ccc-9c4b-a3670440706c tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:44:31.916142 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-03eb3dd8-e25e-4ccc-9c4b-a3670440706c tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] [instance: b0d153c5-90d0-4814-92ec-6f237601def9] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:44:31.923414 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-03eb3dd8-e25e-4ccc-9c4b-a3670440706c tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:44:31.923869 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-03eb3dd8-e25e-4ccc-9c4b-a3670440706c tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:44:31.924696 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-03eb3dd8-e25e-4ccc-9c4b-a3670440706c tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:44:31.925140 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-03eb3dd8-e25e-4ccc-9c4b-a3670440706c tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:44:32.074333 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-03eb3dd8-e25e-4ccc-9c4b-a3670440706c tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:44:32.082754 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-03eb3dd8-e25e-4ccc-9c4b-a3670440706c tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:44:32.084272 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-03eb3dd8-e25e-4ccc-9c4b-a3670440706c tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:44:32.085457 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-03eb3dd8-e25e-4ccc-9c4b-a3670440706c tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] 10.222.0.121 "GET /compute/v2.1/servers/b0d153c5-90d0-4814-92ec-6f237601def9" status: 200 len: 1725 microversion: 2.20 time: 0.174315 Aug 04 10:44:32.086040 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 481/966] 10.222.0.121 () {60 vars in 1282 bytes} [Thu Aug 4 10:44:31 2022] GET /compute/v2.1/servers/b0d153c5-90d0-4814-92ec-6f237601def9 => generated 1725 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:44:32.885856 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-e4d8a534-e1a4-48a2-ba7b-0e9cddbf3995 tempest-VolumesTestJSON-1890853679 tempest-VolumesTestJSON-1890853679-project] Calling method '.version_select at 0x7f6754d4cd30>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:44:32.945684 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-e4d8a534-e1a4-48a2-ba7b-0e9cddbf3995 tempest-VolumesTestJSON-1890853679 tempest-VolumesTestJSON-1890853679-project] 10.222.0.121 "GET /compute/v2.1/os-volumes/1d8d60f5-4bef-48e3-8849-9d22600b9996" status: 200 len: 351 microversion: 2.1 time: 0.063841 Aug 04 10:44:32.946315 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 486/967] 10.222.0.121 () {58 vars in 1250 bytes} [Thu Aug 4 10:44:32 2022] GET /compute/v2.1/os-volumes/1d8d60f5-4bef-48e3-8849-9d22600b9996 => generated 351 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:44:33.113631 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-9b54af76-96c2-4749-9d8f-28d902213f7f tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:44:33.114245 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-9b54af76-96c2-4749-9d8f-28d902213f7f tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] [instance: b0d153c5-90d0-4814-92ec-6f237601def9] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:44:33.121333 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-9b54af76-96c2-4749-9d8f-28d902213f7f tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:44:33.121787 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-9b54af76-96c2-4749-9d8f-28d902213f7f tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:44:33.122556 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-9b54af76-96c2-4749-9d8f-28d902213f7f tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:44:33.122991 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-9b54af76-96c2-4749-9d8f-28d902213f7f tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:44:33.266520 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-9b54af76-96c2-4749-9d8f-28d902213f7f tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:44:33.275245 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-9b54af76-96c2-4749-9d8f-28d902213f7f tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:44:33.276771 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-9b54af76-96c2-4749-9d8f-28d902213f7f tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:44:33.277980 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-9b54af76-96c2-4749-9d8f-28d902213f7f tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] 10.222.0.121 "GET /compute/v2.1/servers/b0d153c5-90d0-4814-92ec-6f237601def9" status: 200 len: 1725 microversion: 2.20 time: 0.168578 Aug 04 10:44:33.278538 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 482/968] 10.222.0.121 () {60 vars in 1282 bytes} [Thu Aug 4 10:44:33 2022] GET /compute/v2.1/servers/b0d153c5-90d0-4814-92ec-6f237601def9 => generated 1725 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:44:34.301355 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-09b880a1-9223-4f86-9b24-c2c1c3a3a958 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:44:34.301995 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-09b880a1-9223-4f86-9b24-c2c1c3a3a958 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] [instance: b0d153c5-90d0-4814-92ec-6f237601def9] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:44:34.304226 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-6a5db17e-8c93-45e8-810b-f4fdd18d4a39 tempest-VolumesTestJSON-1890853679 tempest-VolumesTestJSON-1890853679-project] Calling method '.version_select at 0x7f6754e8aaf0>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:44:34.309437 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-09b880a1-9223-4f86-9b24-c2c1c3a3a958 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:44:34.309903 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-09b880a1-9223-4f86-9b24-c2c1c3a3a958 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:44:34.310690 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-09b880a1-9223-4f86-9b24-c2c1c3a3a958 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:44:34.311131 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-09b880a1-9223-4f86-9b24-c2c1c3a3a958 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:44:34.356395 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-6a5db17e-8c93-45e8-810b-f4fdd18d4a39 tempest-VolumesTestJSON-1890853679 tempest-VolumesTestJSON-1890853679-project] 10.222.0.121 "GET /compute/v2.1/os-volumes/ad96eb8f-012a-4128-9515-24e7cc457b87" status: 200 len: 351 microversion: 2.1 time: 0.056001 Aug 04 10:44:34.364566 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 483/969] 10.222.0.121 () {58 vars in 1250 bytes} [Thu Aug 4 10:44:34 2022] GET /compute/v2.1/os-volumes/ad96eb8f-012a-4128-9515-24e7cc457b87 => generated 351 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:44:34.461692 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-09b880a1-9223-4f86-9b24-c2c1c3a3a958 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:44:34.471678 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-09b880a1-9223-4f86-9b24-c2c1c3a3a958 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:44:34.473867 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-09b880a1-9223-4f86-9b24-c2c1c3a3a958 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:44:34.475639 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-09b880a1-9223-4f86-9b24-c2c1c3a3a958 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] 10.222.0.121 "GET /compute/v2.1/servers/b0d153c5-90d0-4814-92ec-6f237601def9" status: 200 len: 1725 microversion: 2.20 time: 0.179075 Aug 04 10:44:34.476252 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 487/970] 10.222.0.121 () {60 vars in 1282 bytes} [Thu Aug 4 10:44:34 2022] GET /compute/v2.1/servers/b0d153c5-90d0-4814-92ec-6f237601def9 => generated 1725 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:44:35.506662 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-7ff61b95-6744-40ef-a250-da4663f06c90 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:44:35.507728 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-7ff61b95-6744-40ef-a250-da4663f06c90 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] [instance: b0d153c5-90d0-4814-92ec-6f237601def9] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:44:35.520304 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-7ff61b95-6744-40ef-a250-da4663f06c90 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:44:35.521060 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-7ff61b95-6744-40ef-a250-da4663f06c90 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:44:35.522441 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-7ff61b95-6744-40ef-a250-da4663f06c90 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:44:35.523181 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-7ff61b95-6744-40ef-a250-da4663f06c90 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:44:35.661014 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-7ff61b95-6744-40ef-a250-da4663f06c90 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:44:35.670157 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-7ff61b95-6744-40ef-a250-da4663f06c90 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:44:35.671749 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-7ff61b95-6744-40ef-a250-da4663f06c90 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:44:35.673062 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-7ff61b95-6744-40ef-a250-da4663f06c90 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] 10.222.0.121 "GET /compute/v2.1/servers/b0d153c5-90d0-4814-92ec-6f237601def9" status: 200 len: 1725 microversion: 2.20 time: 0.174387 Aug 04 10:44:35.674145 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 484/971] 10.222.0.121 () {60 vars in 1282 bytes} [Thu Aug 4 10:44:35 2022] GET /compute/v2.1/servers/b0d153c5-90d0-4814-92ec-6f237601def9 => generated 1725 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:44:35.718553 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-c1a1bfe7-6b15-4134-82b4-81ef48e91d7a tempest-VolumesTestJSON-1890853679 tempest-VolumesTestJSON-1890853679-project] Calling method '.version_select at 0x7f6754d4c8b0>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:44:35.774681 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-c1a1bfe7-6b15-4134-82b4-81ef48e91d7a tempest-VolumesTestJSON-1890853679 tempest-VolumesTestJSON-1890853679-project] 10.222.0.121 "GET /compute/v2.1/os-volumes/6d6e5787-820f-4c2d-a9a2-d2a114422588" status: 200 len: 350 microversion: 2.1 time: 0.059725 Aug 04 10:44:35.775499 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 488/972] 10.222.0.121 () {58 vars in 1250 bytes} [Thu Aug 4 10:44:35 2022] GET /compute/v2.1/os-volumes/6d6e5787-820f-4c2d-a9a2-d2a114422588 => generated 350 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:44:35.793359 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-5f60e219-3dde-4afa-8ba3-d110f1350eb7 tempest-VolumesTestJSON-1890853679 tempest-VolumesTestJSON-1890853679-project] Calling method '.version_select at 0x7f6754eee430>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:44:35.880481 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-5f60e219-3dde-4afa-8ba3-d110f1350eb7 tempest-VolumesTestJSON-1890853679 tempest-VolumesTestJSON-1890853679-project] 10.222.0.121 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.091060 Aug 04 10:44:35.881376 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 485/973] 10.222.0.121 () {58 vars in 1139 bytes} [Thu Aug 4 10:44:35 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:44:35.896372 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-63516ffd-16c8-494f-b8e7-5b5f84d46173 tempest-VolumesTestJSON-1890853679 tempest-VolumesTestJSON-1890853679-project] Calling method '.version_select at 0x7f675579c5e0>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:44:35.995478 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-63516ffd-16c8-494f-b8e7-5b5f84d46173 tempest-VolumesTestJSON-1890853679 tempest-VolumesTestJSON-1890853679-project] 10.222.0.121 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.103127 Aug 04 10:44:35.996402 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 489/974] 10.222.0.121 () {58 vars in 1154 bytes} [Thu Aug 4 10:44:35 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:44:36.010016 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-2fdde5a2-11c4-4639-bae3-47d2e08eae0a tempest-VolumesTestJSON-1890853679 tempest-VolumesTestJSON-1890853679-project] Calling method '.version_select at 0x7f6754ea0700>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:44:36.096329 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-2fdde5a2-11c4-4639-bae3-47d2e08eae0a tempest-VolumesTestJSON-1890853679 tempest-VolumesTestJSON-1890853679-project] 10.222.0.121 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.089790 Aug 04 10:44:36.097202 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 486/975] 10.222.0.121 () {58 vars in 1139 bytes} [Thu Aug 4 10:44:36 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:44:36.118459 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-bafb226a-6a67-471e-8d4e-9aeabb6df027 tempest-VolumesTestJSON-1890853679 tempest-VolumesTestJSON-1890853679-project] Calling method '.version_select at 0x7f675576c9d0>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:44:36.204727 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-bafb226a-6a67-471e-8d4e-9aeabb6df027 tempest-VolumesTestJSON-1890853679 tempest-VolumesTestJSON-1890853679-project] 10.222.0.121 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.092291 Aug 04 10:44:36.205343 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 490/976] 10.222.0.121 () {58 vars in 1172 bytes} [Thu Aug 4 10:44:36 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:44:36.219317 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-951f3965-b55f-4693-a140-2d714e2319e5 tempest-VolumesTestJSON-1890853679 tempest-VolumesTestJSON-1890853679-project] Calling method '.version_select at 0x7f6754d8adc0>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:44:36.305855 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-951f3965-b55f-4693-a140-2d714e2319e5 tempest-VolumesTestJSON-1890853679 tempest-VolumesTestJSON-1890853679-project] 10.222.0.121 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.090412 Aug 04 10:44:36.306463 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 487/977] 10.222.0.121 () {58 vars in 1175 bytes} [Thu Aug 4 10:44:36 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:44:36.322581 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-1331c607-a20c-425f-b0ad-10ed0106e94f tempest-VolumesTestJSON-1890853679 tempest-VolumesTestJSON-1890853679-project] Calling method '.version_select at 0x7f6755724a60>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:44:36.409249 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-1331c607-a20c-425f-b0ad-10ed0106e94f tempest-VolumesTestJSON-1890853679 tempest-VolumesTestJSON-1890853679-project] 10.222.0.121 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.090612 Aug 04 10:44:36.409886 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 491/978] 10.222.0.121 () {58 vars in 1160 bytes} [Thu Aug 4 10:44:36 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:44:36.423695 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-327d8604-4db7-4d9c-a808-43a821e14671 tempest-VolumesTestJSON-1890853679 tempest-VolumesTestJSON-1890853679-project] Calling method '.version_select at 0x7f67550aca60>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:44:36.509995 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-327d8604-4db7-4d9c-a808-43a821e14671 tempest-VolumesTestJSON-1890853679 tempest-VolumesTestJSON-1890853679-project] 10.222.0.121 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.090308 Aug 04 10:44:36.510599 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 488/979] 10.222.0.121 () {58 vars in 1193 bytes} [Thu Aug 4 10:44:36 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 10:44:36.512632 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-9eaae22c-d250-431b-a494-c8f76a73c0f6 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:44:36.513778 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-9eaae22c-d250-431b-a494-c8f76a73c0f6 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] [instance: 20c0019f-807e-4c55-9d6b-73288200060d] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:44:36.522422 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-9eaae22c-d250-431b-a494-c8f76a73c0f6 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:44:36.522881 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-9eaae22c-d250-431b-a494-c8f76a73c0f6 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:44:36.523675 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-9eaae22c-d250-431b-a494-c8f76a73c0f6 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:44:36.524157 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-9eaae22c-d250-431b-a494-c8f76a73c0f6 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:44:36.524762 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-11b8e382-7c8a-4732-bf74-286d5853c519 tempest-VolumesTestJSON-1890853679 tempest-VolumesTestJSON-1890853679-project] Calling method '.version_select at 0x7f6754d8ad30>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:44:36.549668 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-9eaae22c-d250-431b-a494-c8f76a73c0f6 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] 10.222.0.121 "GET /compute/v2.1/servers/20c0019f-807e-4c55-9d6b-73288200060d/ips" status: 200 len: 149 microversion: 2.1 time: 0.052688 Aug 04 10:44:36.550375 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 492/980] 10.222.0.121 () {58 vars in 1253 bytes} [Thu Aug 4 10:44:36 2022] GET /compute/v2.1/servers/20c0019f-807e-4c55-9d6b-73288200060d/ips => generated 149 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 10:44:36.612787 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-11b8e382-7c8a-4732-bf74-286d5853c519 tempest-VolumesTestJSON-1890853679 tempest-VolumesTestJSON-1890853679-project] 10.222.0.121 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.091870 Aug 04 10:44:36.620764 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 489/981] 10.222.0.121 () {58 vars in 1160 bytes} [Thu Aug 4 10:44:36 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:44:36.702926 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-a7326c09-cfbb-4c1e-9844-64d7e0fa47f2 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:44:36.703697 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-a7326c09-cfbb-4c1e-9844-64d7e0fa47f2 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] [instance: b0d153c5-90d0-4814-92ec-6f237601def9] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:44:36.711364 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-a7326c09-cfbb-4c1e-9844-64d7e0fa47f2 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:44:36.712021 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-a7326c09-cfbb-4c1e-9844-64d7e0fa47f2 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:44:36.713089 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-a7326c09-cfbb-4c1e-9844-64d7e0fa47f2 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:44:36.713668 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-a7326c09-cfbb-4c1e-9844-64d7e0fa47f2 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:44:36.871522 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-a7326c09-cfbb-4c1e-9844-64d7e0fa47f2 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:44:36.888894 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-a7326c09-cfbb-4c1e-9844-64d7e0fa47f2 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:44:36.888894 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-a7326c09-cfbb-4c1e-9844-64d7e0fa47f2 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:44:36.888894 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-a7326c09-cfbb-4c1e-9844-64d7e0fa47f2 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] 10.222.0.121 "GET /compute/v2.1/servers/b0d153c5-90d0-4814-92ec-6f237601def9" status: 200 len: 1746 microversion: 2.20 time: 0.193244 Aug 04 10:44:36.889667 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 493/982] 10.222.0.121 () {60 vars in 1282 bytes} [Thu Aug 4 10:44:36 2022] GET /compute/v2.1/servers/b0d153c5-90d0-4814-92ec-6f237601def9 => generated 1746 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:44:37.915885 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-c3ddeafa-f3ab-4ef5-83da-75f74e4b3234 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:44:37.916630 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-c3ddeafa-f3ab-4ef5-83da-75f74e4b3234 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] [instance: b0d153c5-90d0-4814-92ec-6f237601def9] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:44:37.923346 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-c3ddeafa-f3ab-4ef5-83da-75f74e4b3234 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:44:37.923786 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-c3ddeafa-f3ab-4ef5-83da-75f74e4b3234 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:44:37.924617 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-c3ddeafa-f3ab-4ef5-83da-75f74e4b3234 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:44:37.925054 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-c3ddeafa-f3ab-4ef5-83da-75f74e4b3234 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:44:37.961061 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-b74f3001-12c8-44b0-bff4-bf8a608bd153 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d588b60d-6de0-498d-8b0a-0de9053a7284"}} {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:44:37.963617 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-b74f3001-12c8-44b0-bff4-bf8a608bd153 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] [instance: 20c0019f-807e-4c55-9d6b-73288200060d] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:44:37.974907 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-b74f3001-12c8-44b0-bff4-bf8a608bd153 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:44:37.975421 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-b74f3001-12c8-44b0-bff4-bf8a608bd153 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:44:37.977641 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-b74f3001-12c8-44b0-bff4-bf8a608bd153 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:44:37.978171 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-b74f3001-12c8-44b0-bff4-bf8a608bd153 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:44:38.111915 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-c3ddeafa-f3ab-4ef5-83da-75f74e4b3234 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:44:38.129707 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-c3ddeafa-f3ab-4ef5-83da-75f74e4b3234 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:44:38.133172 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-c3ddeafa-f3ab-4ef5-83da-75f74e4b3234 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:44:38.135953 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-c3ddeafa-f3ab-4ef5-83da-75f74e4b3234 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] 10.222.0.121 "GET /compute/v2.1/servers/b0d153c5-90d0-4814-92ec-6f237601def9" status: 200 len: 1746 microversion: 2.20 time: 0.225690 Aug 04 10:44:38.137185 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 490/983] 10.222.0.121 () {60 vars in 1282 bytes} [Thu Aug 4 10:44:37 2022] GET /compute/v2.1/servers/b0d153c5-90d0-4814-92ec-6f237601def9 => generated 1746 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:44:38.347288 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-b74f3001-12c8-44b0-bff4-bf8a608bd153 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] 10.222.0.121 "POST /compute/v2.1/servers/20c0019f-807e-4c55-9d6b-73288200060d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.390666 Aug 04 10:44:38.347964 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 494/984] 10.222.0.121 () {60 vars in 1328 bytes} [Thu Aug 4 10:44:37 2022] POST /compute/v2.1/servers/20c0019f-807e-4c55-9d6b-73288200060d/os-volume_attachments => generated 194 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 10:44:39.169917 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-7041e9fc-0995-42f1-8e31-b880776edd1b tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:44:39.170690 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-7041e9fc-0995-42f1-8e31-b880776edd1b tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] [instance: b0d153c5-90d0-4814-92ec-6f237601def9] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:44:39.177727 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-7041e9fc-0995-42f1-8e31-b880776edd1b tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:44:39.178604 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-7041e9fc-0995-42f1-8e31-b880776edd1b tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:44:39.179397 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-7041e9fc-0995-42f1-8e31-b880776edd1b tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:44:39.180074 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-7041e9fc-0995-42f1-8e31-b880776edd1b tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:44:39.307401 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [req-d57e72ff-8317-419e-ada9-3a23edfbf68b req-56c317c3-20dc-40f9-9549-53619ef46f2c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0d153c5-90d0-4814-92ec-6f237601def9", "name": "network-vif-plugged", "status": "completed", "tag": "800ffaa9-8acb-4634-8260-3d89de6eccd5"}]} {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:44:39.317952 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [req-d57e72ff-8317-419e-ada9-3a23edfbf68b req-56c317c3-20dc-40f9-9549-53619ef46f2c service nova] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:44:39.318393 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [req-d57e72ff-8317-419e-ada9-3a23edfbf68b req-56c317c3-20dc-40f9-9549-53619ef46f2c service nova] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:44:39.332988 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.compute.server_external_events [req-d57e72ff-8317-419e-ada9-3a23edfbf68b req-56c317c3-20dc-40f9-9549-53619ef46f2c service nova] Creating event network-vif-plugged:800ffaa9-8acb-4634-8260-3d89de6eccd5 for instance b0d153c5-90d0-4814-92ec-6f237601def9 on hv-cinder-85200 Aug 04 10:44:39.339439 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [req-d57e72ff-8317-419e-ada9-3a23edfbf68b req-56c317c3-20dc-40f9-9549-53619ef46f2c service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.185917 Aug 04 10:44:39.340299 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 491/985] 10.222.0.121 () {64 vars in 1322 bytes} [Thu Aug 4 10:44:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 10:44:39.343131 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-7041e9fc-0995-42f1-8e31-b880776edd1b tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:44:39.352999 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-7041e9fc-0995-42f1-8e31-b880776edd1b tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:44:39.354604 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-7041e9fc-0995-42f1-8e31-b880776edd1b tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:44:39.355929 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-7041e9fc-0995-42f1-8e31-b880776edd1b tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] 10.222.0.121 "GET /compute/v2.1/servers/b0d153c5-90d0-4814-92ec-6f237601def9" status: 200 len: 1746 microversion: 2.20 time: 0.193636 Aug 04 10:44:39.356541 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 495/986] 10.222.0.121 () {60 vars in 1282 bytes} [Thu Aug 4 10:44:39 2022] GET /compute/v2.1/servers/b0d153c5-90d0-4814-92ec-6f237601def9 => generated 1746 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:44:40.381619 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-22596247-efba-4b64-90c6-4ca0635b14b7 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:44:40.382230 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-22596247-efba-4b64-90c6-4ca0635b14b7 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] [instance: b0d153c5-90d0-4814-92ec-6f237601def9] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:44:40.389769 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-22596247-efba-4b64-90c6-4ca0635b14b7 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:44:40.390245 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-22596247-efba-4b64-90c6-4ca0635b14b7 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:44:40.391039 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-22596247-efba-4b64-90c6-4ca0635b14b7 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:44:40.391493 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-22596247-efba-4b64-90c6-4ca0635b14b7 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:44:40.584902 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-22596247-efba-4b64-90c6-4ca0635b14b7 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:44:40.594323 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-22596247-efba-4b64-90c6-4ca0635b14b7 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:44:40.596439 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-22596247-efba-4b64-90c6-4ca0635b14b7 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:44:40.597747 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-22596247-efba-4b64-90c6-4ca0635b14b7 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] 10.222.0.121 "GET /compute/v2.1/servers/b0d153c5-90d0-4814-92ec-6f237601def9" status: 200 len: 1746 microversion: 2.20 time: 0.222284 Aug 04 10:44:40.598594 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 492/987] 10.222.0.121 () {60 vars in 1282 bytes} [Thu Aug 4 10:44:40 2022] GET /compute/v2.1/servers/b0d153c5-90d0-4814-92ec-6f237601def9 => generated 1746 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:44:41.632373 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-6246aef1-8166-474b-9c3e-97b67e63033e tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:44:41.633014 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-6246aef1-8166-474b-9c3e-97b67e63033e tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] [instance: b0d153c5-90d0-4814-92ec-6f237601def9] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:44:41.640484 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-6246aef1-8166-474b-9c3e-97b67e63033e tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:44:41.640949 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-6246aef1-8166-474b-9c3e-97b67e63033e tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:44:41.641757 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-6246aef1-8166-474b-9c3e-97b67e63033e tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:44:41.642204 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-6246aef1-8166-474b-9c3e-97b67e63033e tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:44:41.787186 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-6246aef1-8166-474b-9c3e-97b67e63033e tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:44:41.795787 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-6246aef1-8166-474b-9c3e-97b67e63033e tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:44:41.797371 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-6246aef1-8166-474b-9c3e-97b67e63033e tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:44:41.798583 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-6246aef1-8166-474b-9c3e-97b67e63033e tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] 10.222.0.121 "GET /compute/v2.1/servers/b0d153c5-90d0-4814-92ec-6f237601def9" status: 200 len: 1746 microversion: 2.20 time: 0.170494 Aug 04 10:44:41.799164 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 496/988] 10.222.0.121 () {60 vars in 1282 bytes} [Thu Aug 4 10:44:41 2022] GET /compute/v2.1/servers/b0d153c5-90d0-4814-92ec-6f237601def9 => generated 1746 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:44:42.822173 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-37b61f3c-6d7b-4906-bf6e-d0725ca3af2a tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:44:42.822797 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-37b61f3c-6d7b-4906-bf6e-d0725ca3af2a tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] [instance: b0d153c5-90d0-4814-92ec-6f237601def9] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:44:42.830039 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-37b61f3c-6d7b-4906-bf6e-d0725ca3af2a tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:44:42.830490 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-37b61f3c-6d7b-4906-bf6e-d0725ca3af2a tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:44:42.831267 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-37b61f3c-6d7b-4906-bf6e-d0725ca3af2a tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:44:42.831707 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-37b61f3c-6d7b-4906-bf6e-d0725ca3af2a tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:44:42.978297 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-37b61f3c-6d7b-4906-bf6e-d0725ca3af2a tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:44:42.986955 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-37b61f3c-6d7b-4906-bf6e-d0725ca3af2a tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:44:42.988503 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-37b61f3c-6d7b-4906-bf6e-d0725ca3af2a tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:44:42.989735 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-37b61f3c-6d7b-4906-bf6e-d0725ca3af2a tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] 10.222.0.121 "GET /compute/v2.1/servers/b0d153c5-90d0-4814-92ec-6f237601def9" status: 200 len: 1746 microversion: 2.20 time: 0.171942 Aug 04 10:44:42.990324 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 493/989] 10.222.0.121 () {60 vars in 1282 bytes} [Thu Aug 4 10:44:42 2022] GET /compute/v2.1/servers/b0d153c5-90d0-4814-92ec-6f237601def9 => generated 1746 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:44:44.012944 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-fc7069e2-e78f-4a71-a02d-963978d7ff7f tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:44:44.013733 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-fc7069e2-e78f-4a71-a02d-963978d7ff7f tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] [instance: b0d153c5-90d0-4814-92ec-6f237601def9] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:44:44.021564 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-fc7069e2-e78f-4a71-a02d-963978d7ff7f tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:44:44.022216 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-fc7069e2-e78f-4a71-a02d-963978d7ff7f tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:44:44.023273 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-fc7069e2-e78f-4a71-a02d-963978d7ff7f tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:44:44.023909 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-fc7069e2-e78f-4a71-a02d-963978d7ff7f tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:44:44.196900 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-fc7069e2-e78f-4a71-a02d-963978d7ff7f tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:44:44.220371 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-fc7069e2-e78f-4a71-a02d-963978d7ff7f tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:44:44.227182 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-fc7069e2-e78f-4a71-a02d-963978d7ff7f tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:44:44.230326 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-fc7069e2-e78f-4a71-a02d-963978d7ff7f tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] 10.222.0.121 "GET /compute/v2.1/servers/b0d153c5-90d0-4814-92ec-6f237601def9" status: 200 len: 1741 microversion: 2.20 time: 0.221650 Aug 04 10:44:44.249276 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 497/990] 10.222.0.121 () {60 vars in 1282 bytes} [Thu Aug 4 10:44:44 2022] GET /compute/v2.1/servers/b0d153c5-90d0-4814-92ec-6f237601def9 => generated 1741 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:44:45.269701 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-b39b4485-0b11-46d3-886a-d7f1426b4db6 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:44:45.271749 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-b39b4485-0b11-46d3-886a-d7f1426b4db6 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] [instance: b0d153c5-90d0-4814-92ec-6f237601def9] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:44:45.280343 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-b39b4485-0b11-46d3-886a-d7f1426b4db6 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:44:45.281232 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-b39b4485-0b11-46d3-886a-d7f1426b4db6 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:44:45.282245 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-b39b4485-0b11-46d3-886a-d7f1426b4db6 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:44:45.282859 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-b39b4485-0b11-46d3-886a-d7f1426b4db6 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:44:45.545316 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-b39b4485-0b11-46d3-886a-d7f1426b4db6 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:44:45.562073 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-b39b4485-0b11-46d3-886a-d7f1426b4db6 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:44:45.563666 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-b39b4485-0b11-46d3-886a-d7f1426b4db6 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:44:45.564960 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-b39b4485-0b11-46d3-886a-d7f1426b4db6 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] 10.222.0.121 "GET /compute/v2.1/servers/b0d153c5-90d0-4814-92ec-6f237601def9" status: 200 len: 1741 microversion: 2.20 time: 0.302287 Aug 04 10:44:45.565538 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 494/991] 10.222.0.121 () {60 vars in 1282 bytes} [Thu Aug 4 10:44:45 2022] GET /compute/v2.1/servers/b0d153c5-90d0-4814-92ec-6f237601def9 => generated 1741 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:44:46.188554 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-fdc539b1-f61e-4b02-bdcd-04710a0dcdd3 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:44:46.189275 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-fdc539b1-f61e-4b02-bdcd-04710a0dcdd3 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] [instance: 20c0019f-807e-4c55-9d6b-73288200060d] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:44:46.198268 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-fdc539b1-f61e-4b02-bdcd-04710a0dcdd3 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:44:46.199117 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-fdc539b1-f61e-4b02-bdcd-04710a0dcdd3 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:44:46.200192 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-fdc539b1-f61e-4b02-bdcd-04710a0dcdd3 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:44:46.200863 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-fdc539b1-f61e-4b02-bdcd-04710a0dcdd3 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:44:46.384286 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.objects.instance [None req-fdc539b1-f61e-4b02-bdcd-04710a0dcdd3 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lazy-loading 'services' on Instance uuid 20c0019f-807e-4c55-9d6b-73288200060d {{(pid=124457) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 10:44:46.500705 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-fdc539b1-f61e-4b02-bdcd-04710a0dcdd3 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] 10.222.0.121 "DELETE /compute/v2.1/servers/20c0019f-807e-4c55-9d6b-73288200060d/os-volume_attachments/d588b60d-6de0-498d-8b0a-0de9053a7284" status: 202 len: 0 microversion: 2.1 time: 0.316071 Aug 04 10:44:46.502212 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 498/992] 10.222.0.121 () {58 vars in 1421 bytes} [Thu Aug 4 10:44:46 2022] DELETE /compute/v2.1/servers/20c0019f-807e-4c55-9d6b-73288200060d/os-volume_attachments/d588b60d-6de0-498d-8b0a-0de9053a7284 => generated 0 bytes in 319 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 10:44:46.523605 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-ced7da28-597e-433b-9b08-53ee4ac65c7c tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:44:46.529550 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-ced7da28-597e-433b-9b08-53ee4ac65c7c tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] [instance: 20c0019f-807e-4c55-9d6b-73288200060d] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:44:46.542465 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-ced7da28-597e-433b-9b08-53ee4ac65c7c tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:44:46.543498 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-ced7da28-597e-433b-9b08-53ee4ac65c7c tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:44:46.545092 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-ced7da28-597e-433b-9b08-53ee4ac65c7c tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:44:46.545972 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-ced7da28-597e-433b-9b08-53ee4ac65c7c tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:44:46.602793 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-f6b6fd91-1058-41e7-9e80-c52f4fd852e2 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:44:46.603723 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-f6b6fd91-1058-41e7-9e80-c52f4fd852e2 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] [instance: b0d153c5-90d0-4814-92ec-6f237601def9] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:44:46.624769 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-f6b6fd91-1058-41e7-9e80-c52f4fd852e2 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:44:46.626015 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-f6b6fd91-1058-41e7-9e80-c52f4fd852e2 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:44:46.628041 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-f6b6fd91-1058-41e7-9e80-c52f4fd852e2 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:44:46.630737 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-ced7da28-597e-433b-9b08-53ee4ac65c7c tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] 10.222.0.121 "GET /compute/v2.1/servers/20c0019f-807e-4c55-9d6b-73288200060d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.117825 Aug 04 10:44:46.630737 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 495/993] 10.222.0.121 () {58 vars in 1307 bytes} [Thu Aug 4 10:44:46 2022] GET /compute/v2.1/servers/20c0019f-807e-4c55-9d6b-73288200060d/os-volume_attachments => generated 197 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:44:46.633167 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-f6b6fd91-1058-41e7-9e80-c52f4fd852e2 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:44:46.928421 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-f6b6fd91-1058-41e7-9e80-c52f4fd852e2 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:44:46.941757 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-f6b6fd91-1058-41e7-9e80-c52f4fd852e2 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:44:46.943646 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-f6b6fd91-1058-41e7-9e80-c52f4fd852e2 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:44:46.945256 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-f6b6fd91-1058-41e7-9e80-c52f4fd852e2 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] 10.222.0.121 "GET /compute/v2.1/servers/b0d153c5-90d0-4814-92ec-6f237601def9" status: 200 len: 1741 microversion: 2.20 time: 0.356852 Aug 04 10:44:46.945847 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 499/994] 10.222.0.121 () {60 vars in 1282 bytes} [Thu Aug 4 10:44:46 2022] GET /compute/v2.1/servers/b0d153c5-90d0-4814-92ec-6f237601def9 => generated 1741 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:44:47.652398 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-0d02779b-1b10-44e4-9bba-863b7d4a43a7 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:44:47.656056 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-0d02779b-1b10-44e4-9bba-863b7d4a43a7 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] [instance: 20c0019f-807e-4c55-9d6b-73288200060d] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:44:47.665185 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-0d02779b-1b10-44e4-9bba-863b7d4a43a7 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:44:47.666046 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-0d02779b-1b10-44e4-9bba-863b7d4a43a7 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:44:47.667137 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-0d02779b-1b10-44e4-9bba-863b7d4a43a7 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:44:47.667759 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-0d02779b-1b10-44e4-9bba-863b7d4a43a7 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:44:47.704991 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-0d02779b-1b10-44e4-9bba-863b7d4a43a7 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] 10.222.0.121 "GET /compute/v2.1/servers/20c0019f-807e-4c55-9d6b-73288200060d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057777 Aug 04 10:44:47.709564 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 496/995] 10.222.0.121 () {58 vars in 1307 bytes} [Thu Aug 4 10:44:47 2022] GET /compute/v2.1/servers/20c0019f-807e-4c55-9d6b-73288200060d/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:44:47.979241 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-62662a20-01ba-4950-b52c-4276434f1a62 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:44:47.985085 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-62662a20-01ba-4950-b52c-4276434f1a62 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] [instance: b0d153c5-90d0-4814-92ec-6f237601def9] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:44:48.001865 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-62662a20-01ba-4950-b52c-4276434f1a62 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:44:48.004784 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-62662a20-01ba-4950-b52c-4276434f1a62 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:44:48.006799 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-62662a20-01ba-4950-b52c-4276434f1a62 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:44:48.008544 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-62662a20-01ba-4950-b52c-4276434f1a62 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:44:48.226804 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-62662a20-01ba-4950-b52c-4276434f1a62 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:44:48.231074 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG dbcounter [-] [124457] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:44:48.238409 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-62662a20-01ba-4950-b52c-4276434f1a62 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:44:48.241862 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-62662a20-01ba-4950-b52c-4276434f1a62 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:44:48.241862 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-62662a20-01ba-4950-b52c-4276434f1a62 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] 10.222.0.121 "GET /compute/v2.1/servers/b0d153c5-90d0-4814-92ec-6f237601def9" status: 200 len: 1741 microversion: 2.20 time: 0.271767 Aug 04 10:44:48.248267 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 500/996] 10.222.0.121 () {60 vars in 1282 bytes} [Thu Aug 4 10:44:47 2022] GET /compute/v2.1/servers/b0d153c5-90d0-4814-92ec-6f237601def9 => generated 1741 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:44:48.719333 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-27ab92fa-763b-4c8d-9307-cc61e5ac4786 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:44:48.722127 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-27ab92fa-763b-4c8d-9307-cc61e5ac4786 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] [instance: 20c0019f-807e-4c55-9d6b-73288200060d] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:44:48.731041 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-27ab92fa-763b-4c8d-9307-cc61e5ac4786 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:44:48.731899 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-27ab92fa-763b-4c8d-9307-cc61e5ac4786 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:44:48.733014 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-27ab92fa-763b-4c8d-9307-cc61e5ac4786 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:44:48.733453 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-27ab92fa-763b-4c8d-9307-cc61e5ac4786 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:44:48.765191 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG dbcounter [-] [124456] Writing DB stats nova_cell1:SELECT=100 {{(pid=124456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:44:48.772505 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-27ab92fa-763b-4c8d-9307-cc61e5ac4786 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] 10.222.0.121 "GET /compute/v2.1/servers/20c0019f-807e-4c55-9d6b-73288200060d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057962 Aug 04 10:44:48.773564 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 497/997] 10.222.0.121 () {58 vars in 1307 bytes} [Thu Aug 4 10:44:48 2022] GET /compute/v2.1/servers/20c0019f-807e-4c55-9d6b-73288200060d/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:44:49.274330 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-4238a6c4-eed5-45ec-9e8b-263212eccfa9 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:44:49.279575 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-4238a6c4-eed5-45ec-9e8b-263212eccfa9 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] [instance: b0d153c5-90d0-4814-92ec-6f237601def9] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:44:49.296898 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-4238a6c4-eed5-45ec-9e8b-263212eccfa9 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:44:49.297534 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-4238a6c4-eed5-45ec-9e8b-263212eccfa9 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:44:49.298618 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-4238a6c4-eed5-45ec-9e8b-263212eccfa9 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:44:49.299342 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-4238a6c4-eed5-45ec-9e8b-263212eccfa9 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:44:49.487933 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-4238a6c4-eed5-45ec-9e8b-263212eccfa9 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:44:49.502491 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-4238a6c4-eed5-45ec-9e8b-263212eccfa9 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:44:49.506074 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-4238a6c4-eed5-45ec-9e8b-263212eccfa9 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:44:49.507703 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-4238a6c4-eed5-45ec-9e8b-263212eccfa9 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] 10.222.0.121 "GET /compute/v2.1/servers/b0d153c5-90d0-4814-92ec-6f237601def9" status: 200 len: 1741 microversion: 2.20 time: 0.245760 Aug 04 10:44:49.508834 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 501/998] 10.222.0.121 () {60 vars in 1282 bytes} [Thu Aug 4 10:44:49 2022] GET /compute/v2.1/servers/b0d153c5-90d0-4814-92ec-6f237601def9 => generated 1741 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:44:49.789535 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-5c906386-4236-4c54-9ba1-9fa92e2b37ee tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:44:49.792205 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-5c906386-4236-4c54-9ba1-9fa92e2b37ee tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] [instance: 20c0019f-807e-4c55-9d6b-73288200060d] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:44:49.800539 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-5c906386-4236-4c54-9ba1-9fa92e2b37ee tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:44:49.800973 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-5c906386-4236-4c54-9ba1-9fa92e2b37ee tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:44:49.802106 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-5c906386-4236-4c54-9ba1-9fa92e2b37ee tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:44:49.802574 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-5c906386-4236-4c54-9ba1-9fa92e2b37ee tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:44:49.843540 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-5c906386-4236-4c54-9ba1-9fa92e2b37ee tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] 10.222.0.121 "GET /compute/v2.1/servers/20c0019f-807e-4c55-9d6b-73288200060d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058916 Aug 04 10:44:49.844114 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 498/999] 10.222.0.121 () {58 vars in 1307 bytes} [Thu Aug 4 10:44:49 2022] GET /compute/v2.1/servers/20c0019f-807e-4c55-9d6b-73288200060d/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:44:50.534821 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-8973aea5-e287-406b-984e-daab83479268 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:44:50.535889 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-8973aea5-e287-406b-984e-daab83479268 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] [instance: b0d153c5-90d0-4814-92ec-6f237601def9] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:44:50.545861 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-8973aea5-e287-406b-984e-daab83479268 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:44:50.546820 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-8973aea5-e287-406b-984e-daab83479268 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:44:50.548047 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-8973aea5-e287-406b-984e-daab83479268 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:44:50.548643 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-8973aea5-e287-406b-984e-daab83479268 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:44:50.731534 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-8973aea5-e287-406b-984e-daab83479268 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:44:50.744197 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-8973aea5-e287-406b-984e-daab83479268 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:44:50.746396 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-8973aea5-e287-406b-984e-daab83479268 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:44:50.749190 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-8973aea5-e287-406b-984e-daab83479268 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] 10.222.0.121 "GET /compute/v2.1/servers/b0d153c5-90d0-4814-92ec-6f237601def9" status: 200 len: 1741 microversion: 2.20 time: 0.219587 Aug 04 10:44:50.750070 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 502/1000] 10.222.0.121 () {60 vars in 1282 bytes} [Thu Aug 4 10:44:50 2022] GET /compute/v2.1/servers/b0d153c5-90d0-4814-92ec-6f237601def9 => generated 1741 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 10:44:50.858024 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-decaa93a-7737-47b0-9f47-70d37a09d74b tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:44:50.862007 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-decaa93a-7737-47b0-9f47-70d37a09d74b tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] [instance: 20c0019f-807e-4c55-9d6b-73288200060d] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:44:50.872810 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-decaa93a-7737-47b0-9f47-70d37a09d74b tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:44:50.873972 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-decaa93a-7737-47b0-9f47-70d37a09d74b tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:44:50.875026 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-decaa93a-7737-47b0-9f47-70d37a09d74b tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:44:50.875651 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-decaa93a-7737-47b0-9f47-70d37a09d74b tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:44:50.947311 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-decaa93a-7737-47b0-9f47-70d37a09d74b tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] 10.222.0.121 "GET /compute/v2.1/servers/20c0019f-807e-4c55-9d6b-73288200060d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.093718 Aug 04 10:44:50.948460 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 499/1001] 10.222.0.121 () {58 vars in 1307 bytes} [Thu Aug 4 10:44:50 2022] GET /compute/v2.1/servers/20c0019f-807e-4c55-9d6b-73288200060d/os-volume_attachments => generated 25 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 04 10:44:51.083186 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-d933d8a4-e155-46e7-891c-c274eb32450f tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:44:51.083844 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-d933d8a4-e155-46e7-891c-c274eb32450f tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] [instance: 20c0019f-807e-4c55-9d6b-73288200060d] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:44:51.099645 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-d933d8a4-e155-46e7-891c-c274eb32450f tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:44:51.100051 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-d933d8a4-e155-46e7-891c-c274eb32450f tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:44:51.100909 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-d933d8a4-e155-46e7-891c-c274eb32450f tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:44:51.101575 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-d933d8a4-e155-46e7-891c-c274eb32450f tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:44:51.137049 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-d933d8a4-e155-46e7-891c-c274eb32450f tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] [instance: 20c0019f-807e-4c55-9d6b-73288200060d] Going to try to terminate instance {{(pid=124457) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 10:44:51.254864 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-d933d8a4-e155-46e7-891c-c274eb32450f tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] 10.222.0.121 "DELETE /compute/v2.1/servers/20c0019f-807e-4c55-9d6b-73288200060d" status: 204 len: 0 microversion: 2.1 time: 0.176553 Aug 04 10:44:51.256011 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 503/1002] 10.222.0.121 () {58 vars in 1244 bytes} [Thu Aug 4 10:44:51 2022] DELETE /compute/v2.1/servers/20c0019f-807e-4c55-9d6b-73288200060d => generated 0 bytes in 180 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 10:44:51.269782 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-9d21e0e7-a99c-4f5e-b1c8-9702b8980aea tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:44:51.270422 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-9d21e0e7-a99c-4f5e-b1c8-9702b8980aea tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] [instance: 20c0019f-807e-4c55-9d6b-73288200060d] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:44:51.278973 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-9d21e0e7-a99c-4f5e-b1c8-9702b8980aea tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:44:51.279838 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-9d21e0e7-a99c-4f5e-b1c8-9702b8980aea tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:44:51.280840 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-9d21e0e7-a99c-4f5e-b1c8-9702b8980aea tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:44:51.281538 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-9d21e0e7-a99c-4f5e-b1c8-9702b8980aea tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:44:51.459266 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-9d21e0e7-a99c-4f5e-b1c8-9702b8980aea tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a38b5af1654f44bc6cb5832c2e8e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051b6a3defca48d7b4f8bb6705f89f20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:44:51.470911 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-9d21e0e7-a99c-4f5e-b1c8-9702b8980aea tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] 10.222.0.121 "GET /compute/v2.1/servers/20c0019f-807e-4c55-9d6b-73288200060d" status: 200 len: 1684 microversion: 2.1 time: 0.208480 Aug 04 10:44:51.485517 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 500/1003] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:44:51 2022] GET /compute/v2.1/servers/20c0019f-807e-4c55-9d6b-73288200060d => generated 1684 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:44:51.778432 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-ad0592c6-d1b2-4c04-a641-cfb9e24e2f2c tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:44:51.780733 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-ad0592c6-d1b2-4c04-a641-cfb9e24e2f2c tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] [instance: b0d153c5-90d0-4814-92ec-6f237601def9] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:44:51.790088 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-ad0592c6-d1b2-4c04-a641-cfb9e24e2f2c tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:44:51.790998 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-ad0592c6-d1b2-4c04-a641-cfb9e24e2f2c tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:44:51.792208 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-ad0592c6-d1b2-4c04-a641-cfb9e24e2f2c tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:44:51.793056 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-ad0592c6-d1b2-4c04-a641-cfb9e24e2f2c tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:44:51.991251 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-ad0592c6-d1b2-4c04-a641-cfb9e24e2f2c tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:44:52.003066 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-ad0592c6-d1b2-4c04-a641-cfb9e24e2f2c tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:44:52.005337 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-ad0592c6-d1b2-4c04-a641-cfb9e24e2f2c tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:44:52.006727 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-ad0592c6-d1b2-4c04-a641-cfb9e24e2f2c tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] 10.222.0.121 "GET /compute/v2.1/servers/b0d153c5-90d0-4814-92ec-6f237601def9" status: 200 len: 1741 microversion: 2.20 time: 0.234545 Aug 04 10:44:52.007760 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 504/1004] 10.222.0.121 () {60 vars in 1282 bytes} [Thu Aug 4 10:44:51 2022] GET /compute/v2.1/servers/b0d153c5-90d0-4814-92ec-6f237601def9 => generated 1741 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:44:52.497478 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-402ea825-b92d-47e5-b010-099839e7f407 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:44:52.498890 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-402ea825-b92d-47e5-b010-099839e7f407 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] [instance: 20c0019f-807e-4c55-9d6b-73288200060d] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:44:52.506818 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-402ea825-b92d-47e5-b010-099839e7f407 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:44:52.507669 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-402ea825-b92d-47e5-b010-099839e7f407 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:44:52.508712 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-402ea825-b92d-47e5-b010-099839e7f407 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:44:52.509148 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-402ea825-b92d-47e5-b010-099839e7f407 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:44:52.688257 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-402ea825-b92d-47e5-b010-099839e7f407 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a38b5af1654f44bc6cb5832c2e8e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051b6a3defca48d7b4f8bb6705f89f20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:44:52.697883 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-402ea825-b92d-47e5-b010-099839e7f407 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] 10.222.0.121 "GET /compute/v2.1/servers/20c0019f-807e-4c55-9d6b-73288200060d" status: 200 len: 1684 microversion: 2.1 time: 0.205661 Aug 04 10:44:52.698497 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 501/1005] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:44:52 2022] GET /compute/v2.1/servers/20c0019f-807e-4c55-9d6b-73288200060d => generated 1684 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:44:53.039306 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-fb446e28-1b86-4913-80d9-12623c3f090d tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:44:53.040203 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-fb446e28-1b86-4913-80d9-12623c3f090d tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] [instance: b0d153c5-90d0-4814-92ec-6f237601def9] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:44:53.047287 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-fb446e28-1b86-4913-80d9-12623c3f090d tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:44:53.047752 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-fb446e28-1b86-4913-80d9-12623c3f090d tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:44:53.048652 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-fb446e28-1b86-4913-80d9-12623c3f090d tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:44:53.049043 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-fb446e28-1b86-4913-80d9-12623c3f090d tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:44:53.261858 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-fb446e28-1b86-4913-80d9-12623c3f090d tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:44:53.276890 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-fb446e28-1b86-4913-80d9-12623c3f090d tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:44:53.278486 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-fb446e28-1b86-4913-80d9-12623c3f090d tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:44:53.279717 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-fb446e28-1b86-4913-80d9-12623c3f090d tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] 10.222.0.121 "GET /compute/v2.1/servers/b0d153c5-90d0-4814-92ec-6f237601def9" status: 200 len: 1741 microversion: 2.20 time: 0.244816 Aug 04 10:44:53.280608 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 505/1006] 10.222.0.121 () {60 vars in 1282 bytes} [Thu Aug 4 10:44:53 2022] GET /compute/v2.1/servers/b0d153c5-90d0-4814-92ec-6f237601def9 => generated 1741 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:44:53.725244 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-e4e86c27-ac54-4649-b6f9-ae1be8992ebb tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:44:53.726846 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-e4e86c27-ac54-4649-b6f9-ae1be8992ebb tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] [instance: 20c0019f-807e-4c55-9d6b-73288200060d] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:44:53.736530 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-e4e86c27-ac54-4649-b6f9-ae1be8992ebb tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:44:53.737059 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-e4e86c27-ac54-4649-b6f9-ae1be8992ebb tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:44:53.737972 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-e4e86c27-ac54-4649-b6f9-ae1be8992ebb tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:44:53.738534 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-e4e86c27-ac54-4649-b6f9-ae1be8992ebb tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:44:53.996282 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-e4e86c27-ac54-4649-b6f9-ae1be8992ebb tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a38b5af1654f44bc6cb5832c2e8e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051b6a3defca48d7b4f8bb6705f89f20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:44:54.004290 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-e4e86c27-ac54-4649-b6f9-ae1be8992ebb tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] 10.222.0.121 "GET /compute/v2.1/servers/20c0019f-807e-4c55-9d6b-73288200060d" status: 200 len: 1684 microversion: 2.1 time: 0.284719 Aug 04 10:44:54.004994 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 502/1007] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:44:53 2022] GET /compute/v2.1/servers/20c0019f-807e-4c55-9d6b-73288200060d => generated 1684 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:44:54.312494 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-f40fed10-6d02-4d56-acfd-91c104702944 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:44:54.313700 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-f40fed10-6d02-4d56-acfd-91c104702944 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] [instance: b0d153c5-90d0-4814-92ec-6f237601def9] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:44:54.317173 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG dbcounter [-] [124457] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1 {{(pid=124457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:44:54.324703 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-f40fed10-6d02-4d56-acfd-91c104702944 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:44:54.325485 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-f40fed10-6d02-4d56-acfd-91c104702944 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:44:54.326727 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-f40fed10-6d02-4d56-acfd-91c104702944 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:44:54.327473 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-f40fed10-6d02-4d56-acfd-91c104702944 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:44:54.550420 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-f40fed10-6d02-4d56-acfd-91c104702944 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:44:54.559362 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-f40fed10-6d02-4d56-acfd-91c104702944 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:44:54.561019 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-f40fed10-6d02-4d56-acfd-91c104702944 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:44:54.562514 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-f40fed10-6d02-4d56-acfd-91c104702944 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] 10.222.0.121 "GET /compute/v2.1/servers/b0d153c5-90d0-4814-92ec-6f237601def9" status: 200 len: 1741 microversion: 2.20 time: 0.255462 Aug 04 10:44:54.563133 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 506/1008] 10.222.0.121 () {60 vars in 1282 bytes} [Thu Aug 4 10:44:54 2022] GET /compute/v2.1/servers/b0d153c5-90d0-4814-92ec-6f237601def9 => generated 1741 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:44:54.735915 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [req-84a967eb-45d7-438a-b08d-06e61bbd52f1 req-80041d96-aba1-4691-a3fa-852d43f03d52 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20c0019f-807e-4c55-9d6b-73288200060d", "name": "network-vif-deleted", "tag": "ad4eaf65-e247-4b79-8096-76de3ec430d4"}]} {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:44:54.757079 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [req-84a967eb-45d7-438a-b08d-06e61bbd52f1 req-80041d96-aba1-4691-a3fa-852d43f03d52 service nova] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:44:54.757735 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [req-84a967eb-45d7-438a-b08d-06e61bbd52f1 req-80041d96-aba1-4691-a3fa-852d43f03d52 service nova] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:44:54.792524 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.compute.server_external_events [req-84a967eb-45d7-438a-b08d-06e61bbd52f1 req-80041d96-aba1-4691-a3fa-852d43f03d52 service nova] Creating event network-vif-deleted:ad4eaf65-e247-4b79-8096-76de3ec430d4 for instance 20c0019f-807e-4c55-9d6b-73288200060d on hv-cinder-85200 Aug 04 10:44:54.800376 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [req-84a967eb-45d7-438a-b08d-06e61bbd52f1 req-80041d96-aba1-4691-a3fa-852d43f03d52 service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069867 Aug 04 10:44:54.801632 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 503/1009] 10.222.0.121 () {64 vars in 1322 bytes} [Thu Aug 4 10:44:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 10:44:55.027375 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-78543ec3-5c16-4d5b-95f0-ea43d9a5e06d tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:44:55.028139 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-78543ec3-5c16-4d5b-95f0-ea43d9a5e06d tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] [instance: 20c0019f-807e-4c55-9d6b-73288200060d] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:44:55.037549 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-78543ec3-5c16-4d5b-95f0-ea43d9a5e06d tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:44:55.038102 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-78543ec3-5c16-4d5b-95f0-ea43d9a5e06d tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:44:55.039098 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-78543ec3-5c16-4d5b-95f0-ea43d9a5e06d tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:44:55.039784 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-78543ec3-5c16-4d5b-95f0-ea43d9a5e06d tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:44:55.131111 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-78543ec3-5c16-4d5b-95f0-ea43d9a5e06d tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41a38b5af1654f44bc6cb5832c2e8e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051b6a3defca48d7b4f8bb6705f89f20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:44:55.139375 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-78543ec3-5c16-4d5b-95f0-ea43d9a5e06d tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] 10.222.0.121 "GET /compute/v2.1/servers/20c0019f-807e-4c55-9d6b-73288200060d" status: 200 len: 1330 microversion: 2.1 time: 0.116677 Aug 04 10:44:55.140005 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 507/1010] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:44:55 2022] GET /compute/v2.1/servers/20c0019f-807e-4c55-9d6b-73288200060d => generated 1330 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:44:55.591913 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-29fd08e8-24bb-4df1-a882-f0b718ae6bc6 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:44:55.592844 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-29fd08e8-24bb-4df1-a882-f0b718ae6bc6 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] [instance: b0d153c5-90d0-4814-92ec-6f237601def9] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:44:55.600512 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-29fd08e8-24bb-4df1-a882-f0b718ae6bc6 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:44:55.600963 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-29fd08e8-24bb-4df1-a882-f0b718ae6bc6 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:44:55.601762 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-29fd08e8-24bb-4df1-a882-f0b718ae6bc6 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:44:55.602201 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-29fd08e8-24bb-4df1-a882-f0b718ae6bc6 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:44:55.751174 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-29fd08e8-24bb-4df1-a882-f0b718ae6bc6 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:44:55.760588 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-29fd08e8-24bb-4df1-a882-f0b718ae6bc6 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:44:55.762184 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-29fd08e8-24bb-4df1-a882-f0b718ae6bc6 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:44:55.763383 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-29fd08e8-24bb-4df1-a882-f0b718ae6bc6 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] 10.222.0.121 "GET /compute/v2.1/servers/b0d153c5-90d0-4814-92ec-6f237601def9" status: 200 len: 1723 microversion: 2.20 time: 0.178151 Aug 04 10:44:55.764037 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 504/1011] 10.222.0.121 () {60 vars in 1282 bytes} [Thu Aug 4 10:44:55 2022] GET /compute/v2.1/servers/b0d153c5-90d0-4814-92ec-6f237601def9 => generated 1723 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:44:56.162685 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-1a6cfba9-9e5d-4c4b-85e3-d9522b66e120 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:44:56.163323 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-1a6cfba9-9e5d-4c4b-85e3-d9522b66e120 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] [instance: 20c0019f-807e-4c55-9d6b-73288200060d] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:44:56.170959 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-1a6cfba9-9e5d-4c4b-85e3-d9522b66e120 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:44:56.171422 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-1a6cfba9-9e5d-4c4b-85e3-d9522b66e120 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:44:56.172464 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-1a6cfba9-9e5d-4c4b-85e3-d9522b66e120 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:44:56.172899 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-1a6cfba9-9e5d-4c4b-85e3-d9522b66e120 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:44:56.187879 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.wsgi [None req-1a6cfba9-9e5d-4c4b-85e3-d9522b66e120 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] HTTP exception thrown: Instance 20c0019f-807e-4c55-9d6b-73288200060d could not be found. Aug 04 10:44:56.189674 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-1a6cfba9-9e5d-4c4b-85e3-d9522b66e120 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Request method failure captured: Aug 04 10:44:56.189674 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: request: GET /compute/v2.1/servers/20c0019f-807e-4c55-9d6b-73288200060d HTTP/1.1 Aug 04 10:44:56.189674 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: Accept: application/json Aug 04 10:44:56.189674 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: Accept-Encoding: identity Aug 04 10:44:56.189674 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: Connection: close Aug 04 10:44:56.189674 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: Content-Length: 0 Aug 04 10:44:56.189674 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: Content-Type: application/json Aug 04 10:44:56.189674 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: Host: 10.222.0.121 Aug 04 10:44:56.189674 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: Openstack-System-Scope: None Aug 04 10:44:56.189674 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: User-Agent: python-urllib3/1.26.11 Aug 04 10:44:56.189674 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Auth-Token: gAAAAABi66BYmE2gBqIXhQG24OFFWzVprzGeGbZ6oWrpD9juFQnTdf9ST5LtrG_tq8UPT6UiMvXECGt7-Rb5xRfm_FUvpCA0aMeQcAwPVFfAZaKkKC5hs5ouvidzrTVo1nH2TD4SvjZYb98NZaHzipnkuU-vQFrG4wdkP89b_O5rLKaczIbRvag Aug 04 10:44:56.189674 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Domain-Id: None Aug 04 10:44:56.189674 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Domain-Name: None Aug 04 10:44:56.189674 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Identity-Status: Confirmed Aug 04 10:44:56.189674 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Is-Admin-Project: True Aug 04 10:44:56.189674 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Project-Domain-Id: default Aug 04 10:44:56.189674 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Project-Domain-Name: Default Aug 04 10:44:56.189674 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Project-Id: 051b6a3defca48d7b4f8bb6705f89f20 Aug 04 10:44:56.189674 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Project-Name: tempest-AttachVolumeNegativeTest-18806726 Aug 04 10:44:56.189674 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Role: reader,member Aug 04 10:44:56.189674 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Roles: reader,member Aug 04 10:44:56.191362 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/051b6a3defca48d7b4f8bb6705f89f20"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/051b6a3defca48d7b4f8bb6705f89f20"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.121:8080", "publicURL": "http://10.222.0.121:8080/v1/AUTH_051b6a3defca48d7b4f8bb6705f89f20"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2/051b6a3defca48d7b4f8bb6705f89f20"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:9696/networking"}]}] Aug 04 10:44:56.191362 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Tenant: tempest-AttachVolumeNegativeTest-18806726 Aug 04 10:44:56.191362 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Tenant-Id: 051b6a3defca48d7b4f8bb6705f89f20 Aug 04 10:44:56.191362 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-18806726 Aug 04 10:44:56.191362 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-User: tempest-AttachVolumeNegativeTest-18806726-project Aug 04 10:44:56.191362 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-User-Domain-Id: default Aug 04 10:44:56.191362 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-User-Domain-Name: Default Aug 04 10:44:56.191362 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-User-Id: 41a38b5af1654f44bc6cb5832c2e8e87 Aug 04 10:44:56.191362 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-User-Name: tempest-AttachVolumeNegativeTest-18806726-project Aug 04 10:44:56.191362 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: method: > Aug 04 10:44:56.191362 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: exception: Instance 20c0019f-807e-4c55-9d6b-73288200060d could not be found. Aug 04 10:44:56.191362 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: action_args: {'id': '20c0019f-807e-4c55-9d6b-73288200060d'} Aug 04 10:44:56.192258 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 10:44:56.192258 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:44:56.192258 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 10:44:56.192258 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 10:44:56.192258 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 10:44:56.192258 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 10:44:56.192258 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 10:44:56.192258 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 10:44:56.192258 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 10:44:56.192258 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 10:44:56.192258 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 20c0019f-807e-4c55-9d6b-73288200060d could not be found. Aug 04 10:44:56.192258 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Aug 04 10:44:56.192258 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:44:56.192258 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Aug 04 10:44:56.192258 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:44:56.192258 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:44:56.192258 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:44:56.192258 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 10:44:56.192258 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 10:44:56.192258 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 10:44:56.193639 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 10:44:56.193639 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 10:44:56.193639 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 10:44:56.193639 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 10:44:56.193639 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 10:44:56.193639 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 10:44:56.193639 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 10:44:56.193639 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 20c0019f-807e-4c55-9d6b-73288200060d could not be found. Aug 04 10:44:56.193639 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Aug 04 10:44:56.193639 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:44:56.193639 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Aug 04 10:44:56.193639 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:44:56.193639 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:44:56.193639 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:44:56.193639 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 10:44:56.193639 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 10:44:56.193639 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 20c0019f-807e-4c55-9d6b-73288200060d could not be found. Aug 04 10:44:56.193639 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Aug 04 10:44:56.194947 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-1a6cfba9-9e5d-4c4b-85e3-d9522b66e120 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Returning 404 to user: Instance 20c0019f-807e-4c55-9d6b-73288200060d could not be found. {{(pid=124457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 10:44:56.194947 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-1a6cfba9-9e5d-4c4b-85e3-d9522b66e120 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] 10.222.0.121 "GET /compute/v2.1/servers/20c0019f-807e-4c55-9d6b-73288200060d" status: 404 len: 111 microversion: 2.1 time: 0.033095 Aug 04 10:44:56.194947 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 508/1012] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:44:56 2022] GET /compute/v2.1/servers/20c0019f-807e-4c55-9d6b-73288200060d => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 10:44:56.204774 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-2c4e2d33-d22d-4838-bf05-8de74011b58b tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Calling method '.version_select at 0x7f6754d8a5e0>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:44:56.227792 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-2c4e2d33-d22d-4838-bf05-8de74011b58b tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] 10.222.0.121 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-442889244" status: 202 len: 0 microversion: 2.1 time: 0.030765 Aug 04 10:44:56.228791 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 505/1013] 10.222.0.121 () {58 vars in 1223 bytes} [Thu Aug 4 10:44:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-442889244 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 10:44:56.787329 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-9932682c-5900-45e8-8bd7-de43a437c1fc tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:44:56.788032 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-9932682c-5900-45e8-8bd7-de43a437c1fc tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] [instance: b0d153c5-90d0-4814-92ec-6f237601def9] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:44:56.795487 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-9932682c-5900-45e8-8bd7-de43a437c1fc tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:44:56.796171 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-9932682c-5900-45e8-8bd7-de43a437c1fc tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:44:56.797484 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-9932682c-5900-45e8-8bd7-de43a437c1fc tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:44:56.798051 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-9932682c-5900-45e8-8bd7-de43a437c1fc tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:44:57.005744 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-9932682c-5900-45e8-8bd7-de43a437c1fc tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:44:57.015497 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-9932682c-5900-45e8-8bd7-de43a437c1fc tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:44:57.017119 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-9932682c-5900-45e8-8bd7-de43a437c1fc tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:44:57.018349 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-9932682c-5900-45e8-8bd7-de43a437c1fc tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] 10.222.0.121 "GET /compute/v2.1/servers/b0d153c5-90d0-4814-92ec-6f237601def9" status: 200 len: 1723 microversion: 2.20 time: 0.235265 Aug 04 10:44:57.018932 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 509/1014] 10.222.0.121 () {60 vars in 1282 bytes} [Thu Aug 4 10:44:56 2022] GET /compute/v2.1/servers/b0d153c5-90d0-4814-92ec-6f237601def9 => generated 1723 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:44:57.172648 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [req-64a0287b-90de-4d1d-90fc-ee7c27ea62c1 req-9cdce204-c61f-44ce-aad2-b5b86c75bf07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0d153c5-90d0-4814-92ec-6f237601def9", "name": "network-vif-unplugged", "status": "completed", "tag": "800ffaa9-8acb-4634-8260-3d89de6eccd5"}]} {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:44:57.178102 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG dbcounter [-] [124456] Writing DB stats nova_api:SELECT=45,nova_api:DELETE=1 {{(pid=124456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:44:57.186631 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [req-64a0287b-90de-4d1d-90fc-ee7c27ea62c1 req-9cdce204-c61f-44ce-aad2-b5b86c75bf07 service nova] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:44:57.187179 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [req-64a0287b-90de-4d1d-90fc-ee7c27ea62c1 req-9cdce204-c61f-44ce-aad2-b5b86c75bf07 service nova] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:44:57.199249 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.compute.server_external_events [req-64a0287b-90de-4d1d-90fc-ee7c27ea62c1 req-9cdce204-c61f-44ce-aad2-b5b86c75bf07 service nova] Creating event network-vif-unplugged:800ffaa9-8acb-4634-8260-3d89de6eccd5 for instance b0d153c5-90d0-4814-92ec-6f237601def9 on hv-cinder-85200 Aug 04 10:44:57.208262 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [req-64a0287b-90de-4d1d-90fc-ee7c27ea62c1 req-9cdce204-c61f-44ce-aad2-b5b86c75bf07 service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.039917 Aug 04 10:44:57.209287 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 506/1015] 10.222.0.121 () {64 vars in 1322 bytes} [Thu Aug 4 10:44:57 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:44:58.043729 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-1df42316-b74e-40fa-ad81-12334da76051 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:44:58.044677 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-1df42316-b74e-40fa-ad81-12334da76051 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] [instance: b0d153c5-90d0-4814-92ec-6f237601def9] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:44:58.052066 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-1df42316-b74e-40fa-ad81-12334da76051 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:44:58.052717 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-1df42316-b74e-40fa-ad81-12334da76051 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:44:58.053381 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-1df42316-b74e-40fa-ad81-12334da76051 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:44:58.053792 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-1df42316-b74e-40fa-ad81-12334da76051 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:44:58.116942 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-e3691396-845b-470f-9369-12158c1322e0 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:44:58.117721 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-e3691396-845b-470f-9369-12158c1322e0 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] [instance: 20c0019f-807e-4c55-9d6b-73288200060d] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:44:58.124574 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-e3691396-845b-470f-9369-12158c1322e0 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:44:58.125036 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-e3691396-845b-470f-9369-12158c1322e0 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:44:58.125954 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-e3691396-845b-470f-9369-12158c1322e0 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:44:58.126410 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-e3691396-845b-470f-9369-12158c1322e0 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:44:58.141301 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.wsgi [None req-e3691396-845b-470f-9369-12158c1322e0 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] HTTP exception thrown: Instance 20c0019f-807e-4c55-9d6b-73288200060d could not be found. Aug 04 10:44:58.143023 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-e3691396-845b-470f-9369-12158c1322e0 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Request method failure captured: Aug 04 10:44:58.143023 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: request: DELETE /compute/v2.1/servers/20c0019f-807e-4c55-9d6b-73288200060d HTTP/1.1 Aug 04 10:44:58.143023 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: Accept: application/json Aug 04 10:44:58.143023 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: Accept-Encoding: identity Aug 04 10:44:58.143023 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: Connection: close Aug 04 10:44:58.143023 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: Content-Length: 0 Aug 04 10:44:58.143023 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: Content-Type: application/json Aug 04 10:44:58.143023 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: Host: 10.222.0.121 Aug 04 10:44:58.143023 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: Openstack-System-Scope: None Aug 04 10:44:58.143023 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: User-Agent: python-urllib3/1.26.11 Aug 04 10:44:58.143023 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Auth-Token: gAAAAABi66BYmE2gBqIXhQG24OFFWzVprzGeGbZ6oWrpD9juFQnTdf9ST5LtrG_tq8UPT6UiMvXECGt7-Rb5xRfm_FUvpCA0aMeQcAwPVFfAZaKkKC5hs5ouvidzrTVo1nH2TD4SvjZYb98NZaHzipnkuU-vQFrG4wdkP89b_O5rLKaczIbRvag Aug 04 10:44:58.143023 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Domain-Id: None Aug 04 10:44:58.143023 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Domain-Name: None Aug 04 10:44:58.143023 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Identity-Status: Confirmed Aug 04 10:44:58.143023 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Is-Admin-Project: True Aug 04 10:44:58.143023 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Project-Domain-Id: default Aug 04 10:44:58.143023 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Project-Domain-Name: Default Aug 04 10:44:58.143023 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Project-Id: 051b6a3defca48d7b4f8bb6705f89f20 Aug 04 10:44:58.143023 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Project-Name: tempest-AttachVolumeNegativeTest-18806726 Aug 04 10:44:58.143023 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Role: reader,member Aug 04 10:44:58.143023 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Roles: reader,member Aug 04 10:44:58.144801 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/051b6a3defca48d7b4f8bb6705f89f20"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/051b6a3defca48d7b4f8bb6705f89f20"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.121:8080", "publicURL": "http://10.222.0.121:8080/v1/AUTH_051b6a3defca48d7b4f8bb6705f89f20"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2/051b6a3defca48d7b4f8bb6705f89f20"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:9696/networking"}]}] Aug 04 10:44:58.144801 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Tenant: tempest-AttachVolumeNegativeTest-18806726 Aug 04 10:44:58.144801 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Tenant-Id: 051b6a3defca48d7b4f8bb6705f89f20 Aug 04 10:44:58.144801 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-18806726 Aug 04 10:44:58.144801 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-User: tempest-AttachVolumeNegativeTest-18806726-project Aug 04 10:44:58.144801 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-User-Domain-Id: default Aug 04 10:44:58.144801 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-User-Domain-Name: Default Aug 04 10:44:58.144801 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-User-Id: 41a38b5af1654f44bc6cb5832c2e8e87 Aug 04 10:44:58.144801 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-User-Name: tempest-AttachVolumeNegativeTest-18806726-project Aug 04 10:44:58.144801 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: method: > Aug 04 10:44:58.144801 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: exception: Instance 20c0019f-807e-4c55-9d6b-73288200060d could not be found. Aug 04 10:44:58.144801 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: action_args: {'id': '20c0019f-807e-4c55-9d6b-73288200060d'} Aug 04 10:44:58.145722 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 10:44:58.145722 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:44:58.145722 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 10:44:58.145722 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 10:44:58.145722 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 10:44:58.145722 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 10:44:58.145722 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 10:44:58.145722 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 10:44:58.145722 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 10:44:58.145722 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 10:44:58.145722 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 20c0019f-807e-4c55-9d6b-73288200060d could not be found. Aug 04 10:44:58.145722 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi Aug 04 10:44:58.145722 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:44:58.145722 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi Aug 04 10:44:58.145722 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:44:58.145722 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:44:58.145722 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:44:58.145722 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 10:44:58.145722 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 10:44:58.145722 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 10:44:58.147063 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 10:44:58.147063 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 10:44:58.147063 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 10:44:58.147063 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 10:44:58.147063 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 10:44:58.147063 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 10:44:58.147063 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 10:44:58.147063 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 10:44:58.147063 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 10:44:58.147063 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 20c0019f-807e-4c55-9d6b-73288200060d could not be found. Aug 04 10:44:58.147063 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi Aug 04 10:44:58.147063 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:44:58.147063 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi Aug 04 10:44:58.147063 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:44:58.147063 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:44:58.147063 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:44:58.147063 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 10:44:58.147063 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 10:44:58.147063 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 20c0019f-807e-4c55-9d6b-73288200060d could not be found. Aug 04 10:44:58.147063 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi Aug 04 10:44:58.148426 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-e3691396-845b-470f-9369-12158c1322e0 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Returning 404 to user: Instance 20c0019f-807e-4c55-9d6b-73288200060d could not be found. {{(pid=124456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 10:44:58.149325 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-e3691396-845b-470f-9369-12158c1322e0 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] 10.222.0.121 "DELETE /compute/v2.1/servers/20c0019f-807e-4c55-9d6b-73288200060d" status: 404 len: 111 microversion: 2.1 time: 0.036859 Aug 04 10:44:58.149874 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 507/1016] 10.222.0.121 () {58 vars in 1244 bytes} [Thu Aug 4 10:44:58 2022] DELETE /compute/v2.1/servers/20c0019f-807e-4c55-9d6b-73288200060d => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 10:44:58.158598 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-0979cea2-bac4-4ecd-b7e9-a604eb1aaa77 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:44:58.159243 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-0979cea2-bac4-4ecd-b7e9-a604eb1aaa77 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] [instance: 20c0019f-807e-4c55-9d6b-73288200060d] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:44:58.165632 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-0979cea2-bac4-4ecd-b7e9-a604eb1aaa77 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:44:58.166091 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-0979cea2-bac4-4ecd-b7e9-a604eb1aaa77 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:44:58.166878 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-0979cea2-bac4-4ecd-b7e9-a604eb1aaa77 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:44:58.167353 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-0979cea2-bac4-4ecd-b7e9-a604eb1aaa77 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:44:58.182858 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.wsgi [None req-0979cea2-bac4-4ecd-b7e9-a604eb1aaa77 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] HTTP exception thrown: Instance 20c0019f-807e-4c55-9d6b-73288200060d could not be found. Aug 04 10:44:58.184516 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-0979cea2-bac4-4ecd-b7e9-a604eb1aaa77 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Request method failure captured: Aug 04 10:44:58.184516 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: request: GET /compute/v2.1/servers/20c0019f-807e-4c55-9d6b-73288200060d HTTP/1.1 Aug 04 10:44:58.184516 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: Accept: application/json Aug 04 10:44:58.184516 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: Accept-Encoding: identity Aug 04 10:44:58.184516 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: Connection: close Aug 04 10:44:58.184516 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: Content-Length: 0 Aug 04 10:44:58.184516 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: Content-Type: application/json Aug 04 10:44:58.184516 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: Host: 10.222.0.121 Aug 04 10:44:58.184516 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: Openstack-System-Scope: None Aug 04 10:44:58.184516 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: User-Agent: python-urllib3/1.26.11 Aug 04 10:44:58.184516 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Auth-Token: gAAAAABi66BYmE2gBqIXhQG24OFFWzVprzGeGbZ6oWrpD9juFQnTdf9ST5LtrG_tq8UPT6UiMvXECGt7-Rb5xRfm_FUvpCA0aMeQcAwPVFfAZaKkKC5hs5ouvidzrTVo1nH2TD4SvjZYb98NZaHzipnkuU-vQFrG4wdkP89b_O5rLKaczIbRvag Aug 04 10:44:58.184516 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Domain-Id: None Aug 04 10:44:58.184516 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Domain-Name: None Aug 04 10:44:58.184516 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Identity-Status: Confirmed Aug 04 10:44:58.184516 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Is-Admin-Project: True Aug 04 10:44:58.184516 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Project-Domain-Id: default Aug 04 10:44:58.184516 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Project-Domain-Name: Default Aug 04 10:44:58.184516 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Project-Id: 051b6a3defca48d7b4f8bb6705f89f20 Aug 04 10:44:58.184516 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Project-Name: tempest-AttachVolumeNegativeTest-18806726 Aug 04 10:44:58.184516 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Role: reader,member Aug 04 10:44:58.184516 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Roles: reader,member Aug 04 10:44:58.185934 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/051b6a3defca48d7b4f8bb6705f89f20"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/051b6a3defca48d7b4f8bb6705f89f20"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.121:8080", "publicURL": "http://10.222.0.121:8080/v1/AUTH_051b6a3defca48d7b4f8bb6705f89f20"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2/051b6a3defca48d7b4f8bb6705f89f20"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:9696/networking"}]}] Aug 04 10:44:58.185934 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Tenant: tempest-AttachVolumeNegativeTest-18806726 Aug 04 10:44:58.185934 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Tenant-Id: 051b6a3defca48d7b4f8bb6705f89f20 Aug 04 10:44:58.185934 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-18806726 Aug 04 10:44:58.185934 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-User: tempest-AttachVolumeNegativeTest-18806726-project Aug 04 10:44:58.185934 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-User-Domain-Id: default Aug 04 10:44:58.185934 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-User-Domain-Name: Default Aug 04 10:44:58.185934 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-User-Id: 41a38b5af1654f44bc6cb5832c2e8e87 Aug 04 10:44:58.185934 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-User-Name: tempest-AttachVolumeNegativeTest-18806726-project Aug 04 10:44:58.185934 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: method: > Aug 04 10:44:58.185934 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: exception: Instance 20c0019f-807e-4c55-9d6b-73288200060d could not be found. Aug 04 10:44:58.185934 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: action_args: {'id': '20c0019f-807e-4c55-9d6b-73288200060d'} Aug 04 10:44:58.186823 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 10:44:58.186823 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:44:58.186823 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 10:44:58.186823 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 10:44:58.186823 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 10:44:58.186823 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 10:44:58.186823 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 10:44:58.186823 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 10:44:58.186823 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 10:44:58.186823 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 10:44:58.186823 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 20c0019f-807e-4c55-9d6b-73288200060d could not be found. Aug 04 10:44:58.186823 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi Aug 04 10:44:58.186823 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:44:58.186823 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi Aug 04 10:44:58.186823 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:44:58.186823 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:44:58.186823 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:44:58.186823 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 10:44:58.186823 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 10:44:58.186823 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 10:44:58.188201 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 10:44:58.188201 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 10:44:58.188201 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 10:44:58.188201 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 10:44:58.188201 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 10:44:58.188201 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 10:44:58.188201 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 10:44:58.188201 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 20c0019f-807e-4c55-9d6b-73288200060d could not be found. Aug 04 10:44:58.188201 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi Aug 04 10:44:58.188201 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:44:58.188201 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi Aug 04 10:44:58.188201 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:44:58.188201 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:44:58.188201 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:44:58.188201 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 10:44:58.188201 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 10:44:58.188201 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 20c0019f-807e-4c55-9d6b-73288200060d could not be found. Aug 04 10:44:58.188201 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi Aug 04 10:44:58.189356 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-0979cea2-bac4-4ecd-b7e9-a604eb1aaa77 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Returning 404 to user: Instance 20c0019f-807e-4c55-9d6b-73288200060d could not be found. {{(pid=124456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 10:44:58.189356 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-0979cea2-bac4-4ecd-b7e9-a604eb1aaa77 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] 10.222.0.121 "GET /compute/v2.1/servers/20c0019f-807e-4c55-9d6b-73288200060d" status: 404 len: 111 microversion: 2.1 time: 0.031653 Aug 04 10:44:58.189356 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 508/1017] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:44:58 2022] GET /compute/v2.1/servers/20c0019f-807e-4c55-9d6b-73288200060d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 10:44:58.199588 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-1df42316-b74e-40fa-ad81-12334da76051 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:44:58.207824 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-1df42316-b74e-40fa-ad81-12334da76051 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:44:58.209420 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-1df42316-b74e-40fa-ad81-12334da76051 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:44:58.210871 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-1df42316-b74e-40fa-ad81-12334da76051 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] 10.222.0.121 "GET /compute/v2.1/servers/b0d153c5-90d0-4814-92ec-6f237601def9" status: 200 len: 1726 microversion: 2.20 time: 0.171960 Aug 04 10:44:58.211628 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 510/1018] 10.222.0.121 () {60 vars in 1282 bytes} [Thu Aug 4 10:44:58 2022] GET /compute/v2.1/servers/b0d153c5-90d0-4814-92ec-6f237601def9 => generated 1726 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:44:58.234870 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-0dcd8ee6-ecad-4d19-a8f7-f305a7ea3be9 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "439ed172-de22-43fa-91d9-34e38d801754"}} {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:44:58.237360 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-0dcd8ee6-ecad-4d19-a8f7-f305a7ea3be9 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] [instance: b0d153c5-90d0-4814-92ec-6f237601def9] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:44:58.244086 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-0dcd8ee6-ecad-4d19-a8f7-f305a7ea3be9 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:44:58.244481 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-0dcd8ee6-ecad-4d19-a8f7-f305a7ea3be9 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:44:58.245263 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-0dcd8ee6-ecad-4d19-a8f7-f305a7ea3be9 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:44:58.245711 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-0dcd8ee6-ecad-4d19-a8f7-f305a7ea3be9 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:44:58.763634 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-0dcd8ee6-ecad-4d19-a8f7-f305a7ea3be9 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] 10.222.0.121 "POST /compute/v2.1/servers/b0d153c5-90d0-4814-92ec-6f237601def9/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.533025 Aug 04 10:44:58.765331 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 509/1019] 10.222.0.121 () {62 vars in 1369 bytes} [Thu Aug 4 10:44:58 2022] POST /compute/v2.1/servers/b0d153c5-90d0-4814-92ec-6f237601def9/os-volume_attachments => generated 188 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 10:44:58.901023 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-8d98158c-8118-43fd-b126-35f8841e5438 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:44:58.901641 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-8d98158c-8118-43fd-b126-35f8841e5438 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] [instance: b0d153c5-90d0-4814-92ec-6f237601def9] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:44:58.909707 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-8d98158c-8118-43fd-b126-35f8841e5438 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:44:58.910268 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-8d98158c-8118-43fd-b126-35f8841e5438 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:44:58.911273 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-8d98158c-8118-43fd-b126-35f8841e5438 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:44:58.912004 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-8d98158c-8118-43fd-b126-35f8841e5438 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:44:59.076111 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-8d98158c-8118-43fd-b126-35f8841e5438 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] [instance: b0d153c5-90d0-4814-92ec-6f237601def9] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=124457) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 04 10:44:59.152503 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-8d98158c-8118-43fd-b126-35f8841e5438 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] 10.222.0.121 "POST /compute/v2.1/servers/b0d153c5-90d0-4814-92ec-6f237601def9/action" status: 202 len: 0 microversion: 2.20 time: 0.255622 Aug 04 10:44:59.153367 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 511/1020] 10.222.0.121 () {62 vars in 1324 bytes} [Thu Aug 4 10:44:58 2022] POST /compute/v2.1/servers/b0d153c5-90d0-4814-92ec-6f237601def9/action => generated 0 bytes in 257 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 04 10:44:59.162970 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-dfeff374-2a59-4aae-b1ae-1edda09a5892 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:44:59.163596 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-dfeff374-2a59-4aae-b1ae-1edda09a5892 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] [instance: b0d153c5-90d0-4814-92ec-6f237601def9] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:44:59.170475 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-dfeff374-2a59-4aae-b1ae-1edda09a5892 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:44:59.170961 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-dfeff374-2a59-4aae-b1ae-1edda09a5892 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:44:59.171853 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-dfeff374-2a59-4aae-b1ae-1edda09a5892 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:44:59.172354 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-dfeff374-2a59-4aae-b1ae-1edda09a5892 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:44:59.319340 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-dfeff374-2a59-4aae-b1ae-1edda09a5892 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:44:59.329052 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-dfeff374-2a59-4aae-b1ae-1edda09a5892 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:44:59.330650 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-dfeff374-2a59-4aae-b1ae-1edda09a5892 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:44:59.332359 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-dfeff374-2a59-4aae-b1ae-1edda09a5892 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] 10.222.0.121 "GET /compute/v2.1/servers/b0d153c5-90d0-4814-92ec-6f237601def9" status: 200 len: 1752 microversion: 2.20 time: 0.174305 Aug 04 10:44:59.333393 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 510/1021] 10.222.0.121 () {60 vars in 1282 bytes} [Thu Aug 4 10:44:59 2022] GET /compute/v2.1/servers/b0d153c5-90d0-4814-92ec-6f237601def9 => generated 1752 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 10:44:59.354744 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-462d83b7-8497-480b-814d-51f78b774aea tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:44:59.355284 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-462d83b7-8497-480b-814d-51f78b774aea tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] [instance: aca71cfb-26a8-4881-af52-7a1c370fee28] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:44:59.361898 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-462d83b7-8497-480b-814d-51f78b774aea tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:44:59.362346 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-462d83b7-8497-480b-814d-51f78b774aea tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:44:59.363138 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-462d83b7-8497-480b-814d-51f78b774aea tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:44:59.363577 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-462d83b7-8497-480b-814d-51f78b774aea tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:44:59.383094 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.wsgi [None req-462d83b7-8497-480b-814d-51f78b774aea tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] HTTP exception thrown: Instance aca71cfb-26a8-4881-af52-7a1c370fee28 could not be found. Aug 04 10:44:59.384912 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-462d83b7-8497-480b-814d-51f78b774aea tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Request method failure captured: Aug 04 10:44:59.384912 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: request: DELETE /compute/v2.1/servers/aca71cfb-26a8-4881-af52-7a1c370fee28 HTTP/1.1 Aug 04 10:44:59.384912 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: Accept: application/json Aug 04 10:44:59.384912 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: Accept-Encoding: identity Aug 04 10:44:59.384912 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: Connection: close Aug 04 10:44:59.384912 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: Content-Length: 0 Aug 04 10:44:59.384912 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: Content-Type: application/json Aug 04 10:44:59.384912 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: Host: 10.222.0.121 Aug 04 10:44:59.384912 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: Openstack-System-Scope: None Aug 04 10:44:59.384912 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: User-Agent: python-urllib3/1.26.11 Aug 04 10:44:59.384912 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Auth-Token: gAAAAABi66BYmE2gBqIXhQG24OFFWzVprzGeGbZ6oWrpD9juFQnTdf9ST5LtrG_tq8UPT6UiMvXECGt7-Rb5xRfm_FUvpCA0aMeQcAwPVFfAZaKkKC5hs5ouvidzrTVo1nH2TD4SvjZYb98NZaHzipnkuU-vQFrG4wdkP89b_O5rLKaczIbRvag Aug 04 10:44:59.384912 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Domain-Id: None Aug 04 10:44:59.384912 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Domain-Name: None Aug 04 10:44:59.384912 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Identity-Status: Confirmed Aug 04 10:44:59.384912 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Is-Admin-Project: True Aug 04 10:44:59.384912 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Project-Domain-Id: default Aug 04 10:44:59.384912 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Project-Domain-Name: Default Aug 04 10:44:59.384912 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Project-Id: 051b6a3defca48d7b4f8bb6705f89f20 Aug 04 10:44:59.384912 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Project-Name: tempest-AttachVolumeNegativeTest-18806726 Aug 04 10:44:59.384912 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Role: reader,member Aug 04 10:44:59.384912 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Roles: reader,member Aug 04 10:44:59.386659 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/051b6a3defca48d7b4f8bb6705f89f20"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/051b6a3defca48d7b4f8bb6705f89f20"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.121:8080", "publicURL": "http://10.222.0.121:8080/v1/AUTH_051b6a3defca48d7b4f8bb6705f89f20"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2/051b6a3defca48d7b4f8bb6705f89f20"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:9696/networking"}]}] Aug 04 10:44:59.386659 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Tenant: tempest-AttachVolumeNegativeTest-18806726 Aug 04 10:44:59.386659 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Tenant-Id: 051b6a3defca48d7b4f8bb6705f89f20 Aug 04 10:44:59.386659 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-18806726 Aug 04 10:44:59.386659 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-User: tempest-AttachVolumeNegativeTest-18806726-project Aug 04 10:44:59.386659 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-User-Domain-Id: default Aug 04 10:44:59.386659 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-User-Domain-Name: Default Aug 04 10:44:59.386659 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-User-Id: 41a38b5af1654f44bc6cb5832c2e8e87 Aug 04 10:44:59.386659 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-User-Name: tempest-AttachVolumeNegativeTest-18806726-project Aug 04 10:44:59.386659 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: method: > Aug 04 10:44:59.386659 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: exception: Instance aca71cfb-26a8-4881-af52-7a1c370fee28 could not be found. Aug 04 10:44:59.386659 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: action_args: {'id': 'aca71cfb-26a8-4881-af52-7a1c370fee28'} Aug 04 10:44:59.387559 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 10:44:59.387559 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:44:59.387559 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 10:44:59.387559 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 10:44:59.387559 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 10:44:59.387559 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 10:44:59.387559 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 10:44:59.387559 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 10:44:59.387559 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 10:44:59.387559 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 10:44:59.387559 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aca71cfb-26a8-4881-af52-7a1c370fee28 could not be found. Aug 04 10:44:59.387559 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Aug 04 10:44:59.387559 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:44:59.387559 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Aug 04 10:44:59.387559 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:44:59.387559 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:44:59.387559 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:44:59.387559 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 10:44:59.387559 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 10:44:59.387559 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 10:44:59.388968 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 10:44:59.388968 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 10:44:59.388968 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 10:44:59.388968 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 10:44:59.388968 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 10:44:59.388968 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 10:44:59.388968 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 10:44:59.388968 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 10:44:59.388968 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 10:44:59.388968 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aca71cfb-26a8-4881-af52-7a1c370fee28 could not be found. Aug 04 10:44:59.388968 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Aug 04 10:44:59.388968 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:44:59.388968 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Aug 04 10:44:59.388968 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:44:59.388968 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:44:59.388968 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:44:59.388968 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 10:44:59.388968 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 10:44:59.388968 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aca71cfb-26a8-4881-af52-7a1c370fee28 could not be found. Aug 04 10:44:59.388968 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Aug 04 10:44:59.390481 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-462d83b7-8497-480b-814d-51f78b774aea tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Returning 404 to user: Instance aca71cfb-26a8-4881-af52-7a1c370fee28 could not be found. {{(pid=124457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 10:44:59.390481 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-462d83b7-8497-480b-814d-51f78b774aea tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] 10.222.0.121 "DELETE /compute/v2.1/servers/aca71cfb-26a8-4881-af52-7a1c370fee28" status: 404 len: 111 microversion: 2.1 time: 0.036688 Aug 04 10:44:59.390481 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 512/1022] 10.222.0.121 () {58 vars in 1244 bytes} [Thu Aug 4 10:44:59 2022] DELETE /compute/v2.1/servers/aca71cfb-26a8-4881-af52-7a1c370fee28 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 10:44:59.399974 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-a7f3a154-5220-4a5c-9dac-dcb5ce0a9d1c tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:44:59.400961 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-a7f3a154-5220-4a5c-9dac-dcb5ce0a9d1c tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] [instance: aca71cfb-26a8-4881-af52-7a1c370fee28] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:44:59.407690 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-a7f3a154-5220-4a5c-9dac-dcb5ce0a9d1c tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:44:59.408205 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-a7f3a154-5220-4a5c-9dac-dcb5ce0a9d1c tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:44:59.408985 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-a7f3a154-5220-4a5c-9dac-dcb5ce0a9d1c tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:44:59.409424 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-a7f3a154-5220-4a5c-9dac-dcb5ce0a9d1c tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:44:59.423725 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.wsgi [None req-a7f3a154-5220-4a5c-9dac-dcb5ce0a9d1c tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] HTTP exception thrown: Instance aca71cfb-26a8-4881-af52-7a1c370fee28 could not be found. Aug 04 10:44:59.425473 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-a7f3a154-5220-4a5c-9dac-dcb5ce0a9d1c tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Request method failure captured: Aug 04 10:44:59.425473 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: request: GET /compute/v2.1/servers/aca71cfb-26a8-4881-af52-7a1c370fee28 HTTP/1.1 Aug 04 10:44:59.425473 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: Accept: application/json Aug 04 10:44:59.425473 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: Accept-Encoding: identity Aug 04 10:44:59.425473 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: Connection: close Aug 04 10:44:59.425473 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: Content-Length: 0 Aug 04 10:44:59.425473 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: Content-Type: application/json Aug 04 10:44:59.425473 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: Host: 10.222.0.121 Aug 04 10:44:59.425473 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: Openstack-System-Scope: None Aug 04 10:44:59.425473 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: User-Agent: python-urllib3/1.26.11 Aug 04 10:44:59.425473 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Auth-Token: gAAAAABi66BYmE2gBqIXhQG24OFFWzVprzGeGbZ6oWrpD9juFQnTdf9ST5LtrG_tq8UPT6UiMvXECGt7-Rb5xRfm_FUvpCA0aMeQcAwPVFfAZaKkKC5hs5ouvidzrTVo1nH2TD4SvjZYb98NZaHzipnkuU-vQFrG4wdkP89b_O5rLKaczIbRvag Aug 04 10:44:59.425473 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Domain-Id: None Aug 04 10:44:59.425473 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Domain-Name: None Aug 04 10:44:59.425473 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Identity-Status: Confirmed Aug 04 10:44:59.425473 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Is-Admin-Project: True Aug 04 10:44:59.425473 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Project-Domain-Id: default Aug 04 10:44:59.425473 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Project-Domain-Name: Default Aug 04 10:44:59.425473 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Project-Id: 051b6a3defca48d7b4f8bb6705f89f20 Aug 04 10:44:59.425473 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Project-Name: tempest-AttachVolumeNegativeTest-18806726 Aug 04 10:44:59.425473 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Role: reader,member Aug 04 10:44:59.425473 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Roles: reader,member Aug 04 10:44:59.427350 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/051b6a3defca48d7b4f8bb6705f89f20"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/051b6a3defca48d7b4f8bb6705f89f20"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.121:8080", "publicURL": "http://10.222.0.121:8080/v1/AUTH_051b6a3defca48d7b4f8bb6705f89f20"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2/051b6a3defca48d7b4f8bb6705f89f20"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:9696/networking"}]}] Aug 04 10:44:59.427350 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Tenant: tempest-AttachVolumeNegativeTest-18806726 Aug 04 10:44:59.427350 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Tenant-Id: 051b6a3defca48d7b4f8bb6705f89f20 Aug 04 10:44:59.427350 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-18806726 Aug 04 10:44:59.427350 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-User: tempest-AttachVolumeNegativeTest-18806726-project Aug 04 10:44:59.427350 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-User-Domain-Id: default Aug 04 10:44:59.427350 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-User-Domain-Name: Default Aug 04 10:44:59.427350 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-User-Id: 41a38b5af1654f44bc6cb5832c2e8e87 Aug 04 10:44:59.427350 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-User-Name: tempest-AttachVolumeNegativeTest-18806726-project Aug 04 10:44:59.427350 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: method: > Aug 04 10:44:59.427350 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: exception: Instance aca71cfb-26a8-4881-af52-7a1c370fee28 could not be found. Aug 04 10:44:59.427350 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: action_args: {'id': 'aca71cfb-26a8-4881-af52-7a1c370fee28'} Aug 04 10:44:59.431695 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 10:44:59.431695 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:44:59.431695 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 10:44:59.431695 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 10:44:59.431695 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 10:44:59.431695 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 10:44:59.431695 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 10:44:59.431695 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 10:44:59.431695 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 10:44:59.431695 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 10:44:59.431695 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aca71cfb-26a8-4881-af52-7a1c370fee28 could not be found. Aug 04 10:44:59.431695 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi Aug 04 10:44:59.431695 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:44:59.431695 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi Aug 04 10:44:59.431695 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:44:59.431695 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:44:59.431695 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:44:59.431695 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 10:44:59.431695 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 10:44:59.431695 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 10:44:59.434054 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 10:44:59.434054 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 10:44:59.434054 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 10:44:59.434054 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 10:44:59.434054 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 10:44:59.434054 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 10:44:59.434054 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 10:44:59.434054 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aca71cfb-26a8-4881-af52-7a1c370fee28 could not be found. Aug 04 10:44:59.434054 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi Aug 04 10:44:59.434054 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:44:59.434054 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi Aug 04 10:44:59.434054 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:44:59.434054 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:44:59.434054 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:44:59.434054 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 10:44:59.434054 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 10:44:59.434054 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aca71cfb-26a8-4881-af52-7a1c370fee28 could not be found. Aug 04 10:44:59.434054 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi Aug 04 10:44:59.435448 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-a7f3a154-5220-4a5c-9dac-dcb5ce0a9d1c tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Returning 404 to user: Instance aca71cfb-26a8-4881-af52-7a1c370fee28 could not be found. {{(pid=124456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 10:44:59.435448 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-a7f3a154-5220-4a5c-9dac-dcb5ce0a9d1c tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] 10.222.0.121 "GET /compute/v2.1/servers/aca71cfb-26a8-4881-af52-7a1c370fee28" status: 404 len: 111 microversion: 2.1 time: 0.031269 Aug 04 10:44:59.435448 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 511/1023] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:44:59 2022] GET /compute/v2.1/servers/aca71cfb-26a8-4881-af52-7a1c370fee28 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 10:44:59.436121 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-0e4e4301-2384-4b07-9f43-b54a452b0b59 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:44:59.436646 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-0e4e4301-2384-4b07-9f43-b54a452b0b59 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] [instance: 8534737c-8a94-4755-ba3c-021132edace6] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:44:59.443201 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-0e4e4301-2384-4b07-9f43-b54a452b0b59 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:44:59.443664 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-0e4e4301-2384-4b07-9f43-b54a452b0b59 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:44:59.444492 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-0e4e4301-2384-4b07-9f43-b54a452b0b59 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:44:59.444942 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-0e4e4301-2384-4b07-9f43-b54a452b0b59 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:44:59.459224 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.wsgi [None req-0e4e4301-2384-4b07-9f43-b54a452b0b59 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] HTTP exception thrown: Instance 8534737c-8a94-4755-ba3c-021132edace6 could not be found. Aug 04 10:44:59.460870 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-0e4e4301-2384-4b07-9f43-b54a452b0b59 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Request method failure captured: Aug 04 10:44:59.460870 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: request: DELETE /compute/v2.1/servers/8534737c-8a94-4755-ba3c-021132edace6 HTTP/1.1 Aug 04 10:44:59.460870 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: Accept: application/json Aug 04 10:44:59.460870 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: Accept-Encoding: identity Aug 04 10:44:59.460870 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: Connection: close Aug 04 10:44:59.460870 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: Content-Length: 0 Aug 04 10:44:59.460870 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: Content-Type: application/json Aug 04 10:44:59.460870 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: Host: 10.222.0.121 Aug 04 10:44:59.460870 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: Openstack-System-Scope: None Aug 04 10:44:59.460870 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: User-Agent: python-urllib3/1.26.11 Aug 04 10:44:59.460870 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Auth-Token: gAAAAABi66BYmE2gBqIXhQG24OFFWzVprzGeGbZ6oWrpD9juFQnTdf9ST5LtrG_tq8UPT6UiMvXECGt7-Rb5xRfm_FUvpCA0aMeQcAwPVFfAZaKkKC5hs5ouvidzrTVo1nH2TD4SvjZYb98NZaHzipnkuU-vQFrG4wdkP89b_O5rLKaczIbRvag Aug 04 10:44:59.460870 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Domain-Id: None Aug 04 10:44:59.460870 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Domain-Name: None Aug 04 10:44:59.460870 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Identity-Status: Confirmed Aug 04 10:44:59.460870 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Is-Admin-Project: True Aug 04 10:44:59.460870 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Project-Domain-Id: default Aug 04 10:44:59.460870 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Project-Domain-Name: Default Aug 04 10:44:59.460870 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Project-Id: 051b6a3defca48d7b4f8bb6705f89f20 Aug 04 10:44:59.460870 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Project-Name: tempest-AttachVolumeNegativeTest-18806726 Aug 04 10:44:59.460870 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Role: reader,member Aug 04 10:44:59.460870 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Roles: reader,member Aug 04 10:44:59.462680 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/051b6a3defca48d7b4f8bb6705f89f20"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/051b6a3defca48d7b4f8bb6705f89f20"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.121:8080", "publicURL": "http://10.222.0.121:8080/v1/AUTH_051b6a3defca48d7b4f8bb6705f89f20"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2/051b6a3defca48d7b4f8bb6705f89f20"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:9696/networking"}]}] Aug 04 10:44:59.462680 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Tenant: tempest-AttachVolumeNegativeTest-18806726 Aug 04 10:44:59.462680 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Tenant-Id: 051b6a3defca48d7b4f8bb6705f89f20 Aug 04 10:44:59.462680 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-18806726 Aug 04 10:44:59.462680 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-User: tempest-AttachVolumeNegativeTest-18806726-project Aug 04 10:44:59.462680 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-User-Domain-Id: default Aug 04 10:44:59.462680 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-User-Domain-Name: Default Aug 04 10:44:59.462680 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-User-Id: 41a38b5af1654f44bc6cb5832c2e8e87 Aug 04 10:44:59.462680 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-User-Name: tempest-AttachVolumeNegativeTest-18806726-project Aug 04 10:44:59.462680 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: method: > Aug 04 10:44:59.462680 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: exception: Instance 8534737c-8a94-4755-ba3c-021132edace6 could not be found. Aug 04 10:44:59.462680 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: action_args: {'id': '8534737c-8a94-4755-ba3c-021132edace6'} Aug 04 10:44:59.463584 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 10:44:59.463584 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:44:59.463584 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 10:44:59.463584 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 10:44:59.463584 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 10:44:59.463584 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 10:44:59.463584 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 10:44:59.463584 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 10:44:59.463584 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 10:44:59.463584 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 10:44:59.463584 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8534737c-8a94-4755-ba3c-021132edace6 could not be found. Aug 04 10:44:59.463584 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Aug 04 10:44:59.463584 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:44:59.463584 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Aug 04 10:44:59.463584 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:44:59.463584 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:44:59.463584 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:44:59.463584 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 10:44:59.463584 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 10:44:59.463584 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 10:44:59.465161 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 10:44:59.465161 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 10:44:59.465161 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 10:44:59.465161 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 10:44:59.465161 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 10:44:59.465161 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 10:44:59.465161 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 10:44:59.465161 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 10:44:59.465161 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 10:44:59.465161 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8534737c-8a94-4755-ba3c-021132edace6 could not be found. Aug 04 10:44:59.465161 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Aug 04 10:44:59.465161 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:44:59.465161 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Aug 04 10:44:59.465161 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:44:59.465161 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:44:59.465161 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:44:59.465161 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 10:44:59.465161 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 10:44:59.465161 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8534737c-8a94-4755-ba3c-021132edace6 could not be found. Aug 04 10:44:59.465161 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Aug 04 10:44:59.466795 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-0e4e4301-2384-4b07-9f43-b54a452b0b59 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Returning 404 to user: Instance 8534737c-8a94-4755-ba3c-021132edace6 could not be found. {{(pid=124457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 10:44:59.466795 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-0e4e4301-2384-4b07-9f43-b54a452b0b59 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] 10.222.0.121 "DELETE /compute/v2.1/servers/8534737c-8a94-4755-ba3c-021132edace6" status: 404 len: 111 microversion: 2.1 time: 0.030450 Aug 04 10:44:59.466795 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 513/1024] 10.222.0.121 () {58 vars in 1244 bytes} [Thu Aug 4 10:44:59 2022] DELETE /compute/v2.1/servers/8534737c-8a94-4755-ba3c-021132edace6 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 10:44:59.472643 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-fa1f45c6-bc0a-4b00-97fe-a2d26fcfc0f0 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:44:59.473405 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-fa1f45c6-bc0a-4b00-97fe-a2d26fcfc0f0 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] [instance: 8534737c-8a94-4755-ba3c-021132edace6] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:44:59.480191 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-fa1f45c6-bc0a-4b00-97fe-a2d26fcfc0f0 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:44:59.480648 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-fa1f45c6-bc0a-4b00-97fe-a2d26fcfc0f0 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:44:59.481426 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-fa1f45c6-bc0a-4b00-97fe-a2d26fcfc0f0 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:44:59.481867 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-fa1f45c6-bc0a-4b00-97fe-a2d26fcfc0f0 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:44:59.496206 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.wsgi [None req-fa1f45c6-bc0a-4b00-97fe-a2d26fcfc0f0 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] HTTP exception thrown: Instance 8534737c-8a94-4755-ba3c-021132edace6 could not be found. Aug 04 10:44:59.497951 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-fa1f45c6-bc0a-4b00-97fe-a2d26fcfc0f0 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Request method failure captured: Aug 04 10:44:59.497951 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: request: GET /compute/v2.1/servers/8534737c-8a94-4755-ba3c-021132edace6 HTTP/1.1 Aug 04 10:44:59.497951 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: Accept: application/json Aug 04 10:44:59.497951 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: Accept-Encoding: identity Aug 04 10:44:59.497951 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: Connection: close Aug 04 10:44:59.497951 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: Content-Length: 0 Aug 04 10:44:59.497951 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: Content-Type: application/json Aug 04 10:44:59.497951 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: Host: 10.222.0.121 Aug 04 10:44:59.497951 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: Openstack-System-Scope: None Aug 04 10:44:59.497951 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: User-Agent: python-urllib3/1.26.11 Aug 04 10:44:59.497951 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Auth-Token: gAAAAABi66BYmE2gBqIXhQG24OFFWzVprzGeGbZ6oWrpD9juFQnTdf9ST5LtrG_tq8UPT6UiMvXECGt7-Rb5xRfm_FUvpCA0aMeQcAwPVFfAZaKkKC5hs5ouvidzrTVo1nH2TD4SvjZYb98NZaHzipnkuU-vQFrG4wdkP89b_O5rLKaczIbRvag Aug 04 10:44:59.497951 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Domain-Id: None Aug 04 10:44:59.497951 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Domain-Name: None Aug 04 10:44:59.497951 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Identity-Status: Confirmed Aug 04 10:44:59.497951 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Is-Admin-Project: True Aug 04 10:44:59.497951 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Project-Domain-Id: default Aug 04 10:44:59.497951 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Project-Domain-Name: Default Aug 04 10:44:59.497951 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Project-Id: 051b6a3defca48d7b4f8bb6705f89f20 Aug 04 10:44:59.497951 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Project-Name: tempest-AttachVolumeNegativeTest-18806726 Aug 04 10:44:59.497951 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Role: reader,member Aug 04 10:44:59.497951 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Roles: reader,member Aug 04 10:44:59.499632 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/051b6a3defca48d7b4f8bb6705f89f20"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/051b6a3defca48d7b4f8bb6705f89f20"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.121:8080", "publicURL": "http://10.222.0.121:8080/v1/AUTH_051b6a3defca48d7b4f8bb6705f89f20"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2/051b6a3defca48d7b4f8bb6705f89f20"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:9696/networking"}]}] Aug 04 10:44:59.499632 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Tenant: tempest-AttachVolumeNegativeTest-18806726 Aug 04 10:44:59.499632 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Tenant-Id: 051b6a3defca48d7b4f8bb6705f89f20 Aug 04 10:44:59.499632 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-18806726 Aug 04 10:44:59.499632 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-User: tempest-AttachVolumeNegativeTest-18806726-project Aug 04 10:44:59.499632 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-User-Domain-Id: default Aug 04 10:44:59.499632 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-User-Domain-Name: Default Aug 04 10:44:59.499632 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-User-Id: 41a38b5af1654f44bc6cb5832c2e8e87 Aug 04 10:44:59.499632 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-User-Name: tempest-AttachVolumeNegativeTest-18806726-project Aug 04 10:44:59.499632 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: method: > Aug 04 10:44:59.499632 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: exception: Instance 8534737c-8a94-4755-ba3c-021132edace6 could not be found. Aug 04 10:44:59.499632 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: action_args: {'id': '8534737c-8a94-4755-ba3c-021132edace6'} Aug 04 10:44:59.500544 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 10:44:59.500544 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:44:59.500544 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 10:44:59.500544 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 10:44:59.500544 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 10:44:59.500544 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 10:44:59.500544 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 10:44:59.500544 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 10:44:59.500544 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 10:44:59.500544 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 10:44:59.500544 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8534737c-8a94-4755-ba3c-021132edace6 could not be found. Aug 04 10:44:59.500544 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi Aug 04 10:44:59.500544 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:44:59.500544 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi Aug 04 10:44:59.500544 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:44:59.500544 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:44:59.500544 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:44:59.500544 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 10:44:59.500544 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 10:44:59.500544 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 10:44:59.502101 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 10:44:59.502101 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 10:44:59.502101 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 10:44:59.502101 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 10:44:59.502101 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 10:44:59.502101 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 10:44:59.502101 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 10:44:59.502101 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8534737c-8a94-4755-ba3c-021132edace6 could not be found. Aug 04 10:44:59.502101 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi Aug 04 10:44:59.502101 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:44:59.502101 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi Aug 04 10:44:59.502101 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:44:59.502101 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:44:59.502101 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:44:59.502101 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 10:44:59.502101 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 10:44:59.502101 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8534737c-8a94-4755-ba3c-021132edace6 could not be found. Aug 04 10:44:59.502101 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi Aug 04 10:44:59.503789 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-fa1f45c6-bc0a-4b00-97fe-a2d26fcfc0f0 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Returning 404 to user: Instance 8534737c-8a94-4755-ba3c-021132edace6 could not be found. {{(pid=124456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 10:44:59.503789 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-fa1f45c6-bc0a-4b00-97fe-a2d26fcfc0f0 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] 10.222.0.121 "GET /compute/v2.1/servers/8534737c-8a94-4755-ba3c-021132edace6" status: 404 len: 111 microversion: 2.1 time: 0.031236 Aug 04 10:44:59.503789 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 512/1025] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:44:59 2022] GET /compute/v2.1/servers/8534737c-8a94-4755-ba3c-021132edace6 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 10:45:00.360639 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-8387fb2b-5f84-45a4-914e-9db2d70704d0 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:45:00.361482 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-8387fb2b-5f84-45a4-914e-9db2d70704d0 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] [instance: b0d153c5-90d0-4814-92ec-6f237601def9] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:45:00.369642 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-8387fb2b-5f84-45a4-914e-9db2d70704d0 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:45:00.370300 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-8387fb2b-5f84-45a4-914e-9db2d70704d0 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:45:00.371516 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-8387fb2b-5f84-45a4-914e-9db2d70704d0 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:45:00.372129 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-8387fb2b-5f84-45a4-914e-9db2d70704d0 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:45:00.515253 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-8387fb2b-5f84-45a4-914e-9db2d70704d0 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:45:00.534876 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-8387fb2b-5f84-45a4-914e-9db2d70704d0 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:45:00.536490 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-8387fb2b-5f84-45a4-914e-9db2d70704d0 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:45:00.537922 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-8387fb2b-5f84-45a4-914e-9db2d70704d0 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] 10.222.0.121 "GET /compute/v2.1/servers/b0d153c5-90d0-4814-92ec-6f237601def9" status: 200 len: 1754 microversion: 2.20 time: 0.184254 Aug 04 10:45:00.538640 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 514/1026] 10.222.0.121 () {60 vars in 1282 bytes} [Thu Aug 4 10:45:00 2022] GET /compute/v2.1/servers/b0d153c5-90d0-4814-92ec-6f237601def9 => generated 1754 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:45:00.649332 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-e402af3f-6636-4156-b9d7-1da85c6ebf18 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:45:00.650026 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-e402af3f-6636-4156-b9d7-1da85c6ebf18 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] [instance: c6dec6e8-e2f9-4c57-8326-19fc989b5c6e] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:45:00.657197 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-e402af3f-6636-4156-b9d7-1da85c6ebf18 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:45:00.657656 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-e402af3f-6636-4156-b9d7-1da85c6ebf18 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:45:00.658501 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-e402af3f-6636-4156-b9d7-1da85c6ebf18 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:45:00.658894 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-e402af3f-6636-4156-b9d7-1da85c6ebf18 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:45:00.673036 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.wsgi [None req-e402af3f-6636-4156-b9d7-1da85c6ebf18 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] HTTP exception thrown: Instance c6dec6e8-e2f9-4c57-8326-19fc989b5c6e could not be found. Aug 04 10:45:00.674629 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-e402af3f-6636-4156-b9d7-1da85c6ebf18 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Request method failure captured: Aug 04 10:45:00.674629 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: request: DELETE /compute/v2.1/servers/c6dec6e8-e2f9-4c57-8326-19fc989b5c6e HTTP/1.1 Aug 04 10:45:00.674629 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: Accept: application/json Aug 04 10:45:00.674629 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: Accept-Encoding: identity Aug 04 10:45:00.674629 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: Connection: close Aug 04 10:45:00.674629 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: Content-Length: 0 Aug 04 10:45:00.674629 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: Content-Type: application/json Aug 04 10:45:00.674629 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: Host: 10.222.0.121 Aug 04 10:45:00.674629 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: Openstack-System-Scope: None Aug 04 10:45:00.674629 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: User-Agent: python-urllib3/1.26.11 Aug 04 10:45:00.674629 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Auth-Token: gAAAAABi66BYmE2gBqIXhQG24OFFWzVprzGeGbZ6oWrpD9juFQnTdf9ST5LtrG_tq8UPT6UiMvXECGt7-Rb5xRfm_FUvpCA0aMeQcAwPVFfAZaKkKC5hs5ouvidzrTVo1nH2TD4SvjZYb98NZaHzipnkuU-vQFrG4wdkP89b_O5rLKaczIbRvag Aug 04 10:45:00.674629 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Domain-Id: None Aug 04 10:45:00.674629 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Domain-Name: None Aug 04 10:45:00.674629 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Identity-Status: Confirmed Aug 04 10:45:00.674629 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Is-Admin-Project: True Aug 04 10:45:00.674629 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Project-Domain-Id: default Aug 04 10:45:00.674629 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Project-Domain-Name: Default Aug 04 10:45:00.674629 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Project-Id: 051b6a3defca48d7b4f8bb6705f89f20 Aug 04 10:45:00.674629 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Project-Name: tempest-AttachVolumeNegativeTest-18806726 Aug 04 10:45:00.674629 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Role: reader,member Aug 04 10:45:00.674629 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Roles: reader,member Aug 04 10:45:00.676357 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/051b6a3defca48d7b4f8bb6705f89f20"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/051b6a3defca48d7b4f8bb6705f89f20"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.121:8080", "publicURL": "http://10.222.0.121:8080/v1/AUTH_051b6a3defca48d7b4f8bb6705f89f20"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2/051b6a3defca48d7b4f8bb6705f89f20"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:9696/networking"}]}] Aug 04 10:45:00.676357 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Tenant: tempest-AttachVolumeNegativeTest-18806726 Aug 04 10:45:00.676357 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Tenant-Id: 051b6a3defca48d7b4f8bb6705f89f20 Aug 04 10:45:00.676357 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-18806726 Aug 04 10:45:00.676357 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-User: tempest-AttachVolumeNegativeTest-18806726-project Aug 04 10:45:00.676357 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-User-Domain-Id: default Aug 04 10:45:00.676357 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-User-Domain-Name: Default Aug 04 10:45:00.676357 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-User-Id: 41a38b5af1654f44bc6cb5832c2e8e87 Aug 04 10:45:00.676357 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-User-Name: tempest-AttachVolumeNegativeTest-18806726-project Aug 04 10:45:00.676357 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: method: > Aug 04 10:45:00.676357 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: exception: Instance c6dec6e8-e2f9-4c57-8326-19fc989b5c6e could not be found. Aug 04 10:45:00.676357 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: action_args: {'id': 'c6dec6e8-e2f9-4c57-8326-19fc989b5c6e'} Aug 04 10:45:00.677240 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 10:45:00.677240 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:45:00.677240 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 10:45:00.677240 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 10:45:00.677240 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 10:45:00.677240 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 10:45:00.677240 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 10:45:00.677240 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 10:45:00.677240 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 10:45:00.677240 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 10:45:00.677240 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c6dec6e8-e2f9-4c57-8326-19fc989b5c6e could not be found. Aug 04 10:45:00.677240 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi Aug 04 10:45:00.677240 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:45:00.677240 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi Aug 04 10:45:00.677240 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:45:00.677240 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:45:00.677240 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:45:00.677240 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 10:45:00.677240 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 10:45:00.677240 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 10:45:00.678548 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 10:45:00.678548 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 10:45:00.678548 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 10:45:00.678548 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 10:45:00.678548 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 10:45:00.678548 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 10:45:00.678548 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 10:45:00.678548 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 10:45:00.678548 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 10:45:00.678548 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c6dec6e8-e2f9-4c57-8326-19fc989b5c6e could not be found. Aug 04 10:45:00.678548 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi Aug 04 10:45:00.678548 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:45:00.678548 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi Aug 04 10:45:00.678548 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:45:00.678548 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:45:00.678548 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:45:00.678548 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 10:45:00.678548 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 10:45:00.678548 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c6dec6e8-e2f9-4c57-8326-19fc989b5c6e could not be found. Aug 04 10:45:00.678548 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi Aug 04 10:45:00.679877 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-e402af3f-6636-4156-b9d7-1da85c6ebf18 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Returning 404 to user: Instance c6dec6e8-e2f9-4c57-8326-19fc989b5c6e could not be found. {{(pid=124456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 10:45:00.679877 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-e402af3f-6636-4156-b9d7-1da85c6ebf18 tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] 10.222.0.121 "DELETE /compute/v2.1/servers/c6dec6e8-e2f9-4c57-8326-19fc989b5c6e" status: 404 len: 111 microversion: 2.1 time: 0.031210 Aug 04 10:45:00.679877 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 513/1027] 10.222.0.121 () {58 vars in 1244 bytes} [Thu Aug 4 10:45:00 2022] DELETE /compute/v2.1/servers/c6dec6e8-e2f9-4c57-8326-19fc989b5c6e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 10:45:00.685260 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-95697762-3767-410e-8a9c-c918733d3c4e tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:45:00.685890 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-95697762-3767-410e-8a9c-c918733d3c4e tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] [instance: c6dec6e8-e2f9-4c57-8326-19fc989b5c6e] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:45:00.693071 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-95697762-3767-410e-8a9c-c918733d3c4e tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:45:00.693576 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-95697762-3767-410e-8a9c-c918733d3c4e tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:45:00.694400 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-95697762-3767-410e-8a9c-c918733d3c4e tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:45:00.694848 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-95697762-3767-410e-8a9c-c918733d3c4e tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:45:00.709031 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.wsgi [None req-95697762-3767-410e-8a9c-c918733d3c4e tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] HTTP exception thrown: Instance c6dec6e8-e2f9-4c57-8326-19fc989b5c6e could not be found. Aug 04 10:45:00.711497 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-95697762-3767-410e-8a9c-c918733d3c4e tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Request method failure captured: Aug 04 10:45:00.711497 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: request: GET /compute/v2.1/servers/c6dec6e8-e2f9-4c57-8326-19fc989b5c6e HTTP/1.1 Aug 04 10:45:00.711497 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: Accept: application/json Aug 04 10:45:00.711497 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: Accept-Encoding: identity Aug 04 10:45:00.711497 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: Connection: close Aug 04 10:45:00.711497 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: Content-Length: 0 Aug 04 10:45:00.711497 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: Content-Type: application/json Aug 04 10:45:00.711497 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: Host: 10.222.0.121 Aug 04 10:45:00.711497 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: Openstack-System-Scope: None Aug 04 10:45:00.711497 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: User-Agent: python-urllib3/1.26.11 Aug 04 10:45:00.711497 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Auth-Token: gAAAAABi66BYmE2gBqIXhQG24OFFWzVprzGeGbZ6oWrpD9juFQnTdf9ST5LtrG_tq8UPT6UiMvXECGt7-Rb5xRfm_FUvpCA0aMeQcAwPVFfAZaKkKC5hs5ouvidzrTVo1nH2TD4SvjZYb98NZaHzipnkuU-vQFrG4wdkP89b_O5rLKaczIbRvag Aug 04 10:45:00.711497 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Domain-Id: None Aug 04 10:45:00.711497 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Domain-Name: None Aug 04 10:45:00.711497 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Identity-Status: Confirmed Aug 04 10:45:00.711497 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Is-Admin-Project: True Aug 04 10:45:00.711497 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Project-Domain-Id: default Aug 04 10:45:00.711497 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Project-Domain-Name: Default Aug 04 10:45:00.711497 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Project-Id: 051b6a3defca48d7b4f8bb6705f89f20 Aug 04 10:45:00.711497 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Project-Name: tempest-AttachVolumeNegativeTest-18806726 Aug 04 10:45:00.711497 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Role: reader,member Aug 04 10:45:00.711497 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Roles: reader,member Aug 04 10:45:00.713981 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/051b6a3defca48d7b4f8bb6705f89f20"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/051b6a3defca48d7b4f8bb6705f89f20"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.121:8080", "publicURL": "http://10.222.0.121:8080/v1/AUTH_051b6a3defca48d7b4f8bb6705f89f20"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2/051b6a3defca48d7b4f8bb6705f89f20"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:9696/networking"}]}] Aug 04 10:45:00.713981 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Tenant: tempest-AttachVolumeNegativeTest-18806726 Aug 04 10:45:00.713981 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Tenant-Id: 051b6a3defca48d7b4f8bb6705f89f20 Aug 04 10:45:00.713981 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-18806726 Aug 04 10:45:00.713981 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-User: tempest-AttachVolumeNegativeTest-18806726-project Aug 04 10:45:00.713981 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-User-Domain-Id: default Aug 04 10:45:00.713981 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-User-Domain-Name: Default Aug 04 10:45:00.713981 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-User-Id: 41a38b5af1654f44bc6cb5832c2e8e87 Aug 04 10:45:00.713981 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-User-Name: tempest-AttachVolumeNegativeTest-18806726-project Aug 04 10:45:00.713981 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: method: > Aug 04 10:45:00.713981 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: exception: Instance c6dec6e8-e2f9-4c57-8326-19fc989b5c6e could not be found. Aug 04 10:45:00.713981 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: action_args: {'id': 'c6dec6e8-e2f9-4c57-8326-19fc989b5c6e'} Aug 04 10:45:00.714834 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 10:45:00.714834 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:45:00.714834 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 10:45:00.714834 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 10:45:00.714834 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 10:45:00.714834 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 10:45:00.714834 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 10:45:00.714834 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 10:45:00.714834 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 10:45:00.714834 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 10:45:00.714834 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c6dec6e8-e2f9-4c57-8326-19fc989b5c6e could not be found. Aug 04 10:45:00.714834 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Aug 04 10:45:00.714834 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:45:00.714834 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Aug 04 10:45:00.714834 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:45:00.714834 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:45:00.714834 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:45:00.714834 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 10:45:00.714834 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 10:45:00.714834 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 10:45:00.716289 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 10:45:00.716289 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 10:45:00.716289 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 10:45:00.716289 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 10:45:00.716289 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 10:45:00.716289 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 10:45:00.716289 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 10:45:00.716289 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c6dec6e8-e2f9-4c57-8326-19fc989b5c6e could not be found. Aug 04 10:45:00.716289 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Aug 04 10:45:00.716289 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:45:00.716289 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Aug 04 10:45:00.716289 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:45:00.716289 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:45:00.716289 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:45:00.716289 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 10:45:00.716289 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 10:45:00.716289 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c6dec6e8-e2f9-4c57-8326-19fc989b5c6e could not be found. Aug 04 10:45:00.716289 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Aug 04 10:45:00.717635 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-95697762-3767-410e-8a9c-c918733d3c4e tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] Returning 404 to user: Instance c6dec6e8-e2f9-4c57-8326-19fc989b5c6e could not be found. {{(pid=124457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 10:45:00.717635 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-95697762-3767-410e-8a9c-c918733d3c4e tempest-AttachVolumeNegativeTest-18806726 tempest-AttachVolumeNegativeTest-18806726-project] 10.222.0.121 "GET /compute/v2.1/servers/c6dec6e8-e2f9-4c57-8326-19fc989b5c6e" status: 404 len: 111 microversion: 2.1 time: 0.031817 Aug 04 10:45:00.717635 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 515/1028] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:45:00 2022] GET /compute/v2.1/servers/c6dec6e8-e2f9-4c57-8326-19fc989b5c6e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 10:45:01.563243 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-c8ae2df6-74cc-482b-9076-147416213828 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:45:01.564221 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-c8ae2df6-74cc-482b-9076-147416213828 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] [instance: b0d153c5-90d0-4814-92ec-6f237601def9] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:45:01.571491 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-c8ae2df6-74cc-482b-9076-147416213828 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:45:01.571978 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-c8ae2df6-74cc-482b-9076-147416213828 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:45:01.572775 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-c8ae2df6-74cc-482b-9076-147416213828 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:45:01.573218 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-c8ae2df6-74cc-482b-9076-147416213828 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:45:01.819991 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-c8ae2df6-74cc-482b-9076-147416213828 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:45:01.831762 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-c8ae2df6-74cc-482b-9076-147416213828 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:45:01.833869 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-c8ae2df6-74cc-482b-9076-147416213828 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:45:01.835186 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-c8ae2df6-74cc-482b-9076-147416213828 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] 10.222.0.121 "GET /compute/v2.1/servers/b0d153c5-90d0-4814-92ec-6f237601def9" status: 200 len: 1810 microversion: 2.20 time: 0.278466 Aug 04 10:45:01.836176 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 514/1029] 10.222.0.121 () {60 vars in 1282 bytes} [Thu Aug 4 10:45:01 2022] GET /compute/v2.1/servers/b0d153c5-90d0-4814-92ec-6f237601def9 => generated 1810 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:45:02.860549 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-bc09d462-4047-49cd-af4f-910718e2d0eb tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:45:02.861557 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-bc09d462-4047-49cd-af4f-910718e2d0eb tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] [instance: b0d153c5-90d0-4814-92ec-6f237601def9] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:45:02.881129 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-bc09d462-4047-49cd-af4f-910718e2d0eb tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:45:02.882815 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-bc09d462-4047-49cd-af4f-910718e2d0eb tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:45:02.886448 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-bc09d462-4047-49cd-af4f-910718e2d0eb tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:45:02.890718 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-bc09d462-4047-49cd-af4f-910718e2d0eb tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:45:03.224040 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-bc09d462-4047-49cd-af4f-910718e2d0eb tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:45:03.247153 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-bc09d462-4047-49cd-af4f-910718e2d0eb tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:45:03.262353 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-bc09d462-4047-49cd-af4f-910718e2d0eb tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:45:03.264077 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-bc09d462-4047-49cd-af4f-910718e2d0eb tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] 10.222.0.121 "GET /compute/v2.1/servers/b0d153c5-90d0-4814-92ec-6f237601def9" status: 200 len: 1810 microversion: 2.20 time: 0.408637 Aug 04 10:45:03.264755 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 516/1030] 10.222.0.121 () {60 vars in 1282 bytes} [Thu Aug 4 10:45:02 2022] GET /compute/v2.1/servers/b0d153c5-90d0-4814-92ec-6f237601def9 => generated 1810 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:45:04.293557 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-52cdb785-97f0-4de1-881a-96f5d7afb684 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:45:04.295064 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-52cdb785-97f0-4de1-881a-96f5d7afb684 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] [instance: b0d153c5-90d0-4814-92ec-6f237601def9] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:45:04.308486 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-52cdb785-97f0-4de1-881a-96f5d7afb684 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:45:04.311286 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-52cdb785-97f0-4de1-881a-96f5d7afb684 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:45:04.319845 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-52cdb785-97f0-4de1-881a-96f5d7afb684 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:45:04.321632 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-52cdb785-97f0-4de1-881a-96f5d7afb684 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:45:04.663469 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-52cdb785-97f0-4de1-881a-96f5d7afb684 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:45:04.681337 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-52cdb785-97f0-4de1-881a-96f5d7afb684 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:45:04.682670 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-52cdb785-97f0-4de1-881a-96f5d7afb684 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:45:04.685267 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-52cdb785-97f0-4de1-881a-96f5d7afb684 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] 10.222.0.121 "GET /compute/v2.1/servers/b0d153c5-90d0-4814-92ec-6f237601def9" status: 200 len: 1810 microversion: 2.20 time: 0.397710 Aug 04 10:45:04.693247 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 515/1031] 10.222.0.121 () {60 vars in 1282 bytes} [Thu Aug 4 10:45:04 2022] GET /compute/v2.1/servers/b0d153c5-90d0-4814-92ec-6f237601def9 => generated 1810 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:45:05.717860 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-568a86c7-4f59-4d55-a01c-d09cf2f9575f tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:45:05.718659 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-568a86c7-4f59-4d55-a01c-d09cf2f9575f tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] [instance: b0d153c5-90d0-4814-92ec-6f237601def9] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:45:05.731138 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-568a86c7-4f59-4d55-a01c-d09cf2f9575f tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:45:05.732500 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-568a86c7-4f59-4d55-a01c-d09cf2f9575f tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:45:05.733417 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-568a86c7-4f59-4d55-a01c-d09cf2f9575f tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:45:05.734075 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-568a86c7-4f59-4d55-a01c-d09cf2f9575f tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:45:05.768594 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG dbcounter [-] [124457] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:45:05.948517 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-568a86c7-4f59-4d55-a01c-d09cf2f9575f tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:45:05.967844 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-568a86c7-4f59-4d55-a01c-d09cf2f9575f tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:45:05.978478 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-568a86c7-4f59-4d55-a01c-d09cf2f9575f tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:45:05.988937 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-568a86c7-4f59-4d55-a01c-d09cf2f9575f tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] 10.222.0.121 "GET /compute/v2.1/servers/b0d153c5-90d0-4814-92ec-6f237601def9" status: 200 len: 1810 microversion: 2.20 time: 0.269266 Aug 04 10:45:05.996383 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 517/1032] 10.222.0.121 () {60 vars in 1282 bytes} [Thu Aug 4 10:45:05 2022] GET /compute/v2.1/servers/b0d153c5-90d0-4814-92ec-6f237601def9 => generated 1810 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:45:07.022400 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-44d775a6-0954-49af-aff7-fbf8b5c799ee tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:45:07.025145 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-44d775a6-0954-49af-aff7-fbf8b5c799ee tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] [instance: b0d153c5-90d0-4814-92ec-6f237601def9] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:45:07.033331 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-44d775a6-0954-49af-aff7-fbf8b5c799ee tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:45:07.034123 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-44d775a6-0954-49af-aff7-fbf8b5c799ee tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:45:07.035095 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-44d775a6-0954-49af-aff7-fbf8b5c799ee tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:45:07.035710 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-44d775a6-0954-49af-aff7-fbf8b5c799ee tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:45:07.231358 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-44d775a6-0954-49af-aff7-fbf8b5c799ee tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:45:07.247297 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-44d775a6-0954-49af-aff7-fbf8b5c799ee tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:45:07.249050 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-44d775a6-0954-49af-aff7-fbf8b5c799ee tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:45:07.251233 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-44d775a6-0954-49af-aff7-fbf8b5c799ee tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] 10.222.0.121 "GET /compute/v2.1/servers/b0d153c5-90d0-4814-92ec-6f237601def9" status: 200 len: 1810 microversion: 2.20 time: 0.236000 Aug 04 10:45:07.252471 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 516/1033] 10.222.0.121 () {60 vars in 1282 bytes} [Thu Aug 4 10:45:07 2022] GET /compute/v2.1/servers/b0d153c5-90d0-4814-92ec-6f237601def9 => generated 1810 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:45:08.292724 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-72d68e5a-e1fa-4c54-a611-c8667a9b471d tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:45:08.293453 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-72d68e5a-e1fa-4c54-a611-c8667a9b471d tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] [instance: b0d153c5-90d0-4814-92ec-6f237601def9] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:45:08.300823 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-72d68e5a-e1fa-4c54-a611-c8667a9b471d tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:45:08.301528 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-72d68e5a-e1fa-4c54-a611-c8667a9b471d tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:45:08.302510 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-72d68e5a-e1fa-4c54-a611-c8667a9b471d tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:45:08.303037 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-72d68e5a-e1fa-4c54-a611-c8667a9b471d tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:45:08.494347 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-72d68e5a-e1fa-4c54-a611-c8667a9b471d tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:45:08.509061 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-72d68e5a-e1fa-4c54-a611-c8667a9b471d tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:45:08.512388 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-72d68e5a-e1fa-4c54-a611-c8667a9b471d tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:45:08.514208 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-72d68e5a-e1fa-4c54-a611-c8667a9b471d tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] 10.222.0.121 "GET /compute/v2.1/servers/b0d153c5-90d0-4814-92ec-6f237601def9" status: 200 len: 1810 microversion: 2.20 time: 0.225901 Aug 04 10:45:08.534910 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 518/1034] 10.222.0.121 () {60 vars in 1282 bytes} [Thu Aug 4 10:45:08 2022] GET /compute/v2.1/servers/b0d153c5-90d0-4814-92ec-6f237601def9 => generated 1810 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:45:09.543927 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-5271398f-f1a3-4baa-b333-e32623fc580c tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:45:09.544651 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-5271398f-f1a3-4baa-b333-e32623fc580c tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] [instance: b0d153c5-90d0-4814-92ec-6f237601def9] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:45:09.552043 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-5271398f-f1a3-4baa-b333-e32623fc580c tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:45:09.552492 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-5271398f-f1a3-4baa-b333-e32623fc580c tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:45:09.553308 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-5271398f-f1a3-4baa-b333-e32623fc580c tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:45:09.553751 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-5271398f-f1a3-4baa-b333-e32623fc580c tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:45:09.573112 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG dbcounter [-] [124456] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=124456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:45:09.705711 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-5271398f-f1a3-4baa-b333-e32623fc580c tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:45:09.715905 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-5271398f-f1a3-4baa-b333-e32623fc580c tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:45:09.717614 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-5271398f-f1a3-4baa-b333-e32623fc580c tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:45:09.718849 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-5271398f-f1a3-4baa-b333-e32623fc580c tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] 10.222.0.121 "GET /compute/v2.1/servers/b0d153c5-90d0-4814-92ec-6f237601def9" status: 200 len: 1810 microversion: 2.20 time: 0.179425 Aug 04 10:45:09.719848 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 517/1035] 10.222.0.121 () {60 vars in 1282 bytes} [Thu Aug 4 10:45:09 2022] GET /compute/v2.1/servers/b0d153c5-90d0-4814-92ec-6f237601def9 => generated 1810 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:45:10.743240 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-3285d313-4256-42c6-83be-8efa52cd2fb2 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:45:10.743926 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-3285d313-4256-42c6-83be-8efa52cd2fb2 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] [instance: b0d153c5-90d0-4814-92ec-6f237601def9] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:45:10.751415 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-3285d313-4256-42c6-83be-8efa52cd2fb2 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:45:10.751866 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-3285d313-4256-42c6-83be-8efa52cd2fb2 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:45:10.752689 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-3285d313-4256-42c6-83be-8efa52cd2fb2 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:45:10.753136 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-3285d313-4256-42c6-83be-8efa52cd2fb2 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:45:10.896301 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-3285d313-4256-42c6-83be-8efa52cd2fb2 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:45:10.910731 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-3285d313-4256-42c6-83be-8efa52cd2fb2 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:45:10.912391 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-3285d313-4256-42c6-83be-8efa52cd2fb2 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:45:10.913702 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-3285d313-4256-42c6-83be-8efa52cd2fb2 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] 10.222.0.121 "GET /compute/v2.1/servers/b0d153c5-90d0-4814-92ec-6f237601def9" status: 200 len: 1810 microversion: 2.20 time: 0.174644 Aug 04 10:45:10.914407 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 519/1036] 10.222.0.121 () {60 vars in 1282 bytes} [Thu Aug 4 10:45:10 2022] GET /compute/v2.1/servers/b0d153c5-90d0-4814-92ec-6f237601def9 => generated 1810 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:45:11.939714 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-5b7df9bc-7def-40b1-959b-4209f5428fa0 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:45:11.940510 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-5b7df9bc-7def-40b1-959b-4209f5428fa0 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] [instance: b0d153c5-90d0-4814-92ec-6f237601def9] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:45:11.948390 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-5b7df9bc-7def-40b1-959b-4209f5428fa0 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:45:11.948835 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-5b7df9bc-7def-40b1-959b-4209f5428fa0 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:45:11.949645 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-5b7df9bc-7def-40b1-959b-4209f5428fa0 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:45:11.950095 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-5b7df9bc-7def-40b1-959b-4209f5428fa0 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:45:12.093654 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-5b7df9bc-7def-40b1-959b-4209f5428fa0 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:45:12.103795 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-5b7df9bc-7def-40b1-959b-4209f5428fa0 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:45:12.105346 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-5b7df9bc-7def-40b1-959b-4209f5428fa0 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:45:12.106604 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-5b7df9bc-7def-40b1-959b-4209f5428fa0 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] 10.222.0.121 "GET /compute/v2.1/servers/b0d153c5-90d0-4814-92ec-6f237601def9" status: 200 len: 1810 microversion: 2.20 time: 0.171453 Aug 04 10:45:12.107173 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 518/1037] 10.222.0.121 () {60 vars in 1282 bytes} [Thu Aug 4 10:45:11 2022] GET /compute/v2.1/servers/b0d153c5-90d0-4814-92ec-6f237601def9 => generated 1810 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:45:13.132084 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-56a9e80c-86a9-4f44-a7e1-037f68e07509 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:45:13.133724 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-56a9e80c-86a9-4f44-a7e1-037f68e07509 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] [instance: b0d153c5-90d0-4814-92ec-6f237601def9] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:45:13.143885 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-56a9e80c-86a9-4f44-a7e1-037f68e07509 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:45:13.144372 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-56a9e80c-86a9-4f44-a7e1-037f68e07509 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:45:13.145575 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-56a9e80c-86a9-4f44-a7e1-037f68e07509 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:45:13.145972 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-56a9e80c-86a9-4f44-a7e1-037f68e07509 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:45:13.327423 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-56a9e80c-86a9-4f44-a7e1-037f68e07509 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:45:13.339463 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-56a9e80c-86a9-4f44-a7e1-037f68e07509 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:45:13.341104 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-56a9e80c-86a9-4f44-a7e1-037f68e07509 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:45:13.342686 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-56a9e80c-86a9-4f44-a7e1-037f68e07509 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] 10.222.0.121 "GET /compute/v2.1/servers/b0d153c5-90d0-4814-92ec-6f237601def9" status: 200 len: 1810 microversion: 2.20 time: 0.216051 Aug 04 10:45:13.343221 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 520/1038] 10.222.0.121 () {60 vars in 1282 bytes} [Thu Aug 4 10:45:13 2022] GET /compute/v2.1/servers/b0d153c5-90d0-4814-92ec-6f237601def9 => generated 1810 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:45:14.369185 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-de661aa8-98d1-42ad-88f2-ac63b37a41db tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:45:14.369960 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-de661aa8-98d1-42ad-88f2-ac63b37a41db tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] [instance: b0d153c5-90d0-4814-92ec-6f237601def9] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:45:14.377112 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-de661aa8-98d1-42ad-88f2-ac63b37a41db tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:45:14.377575 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-de661aa8-98d1-42ad-88f2-ac63b37a41db tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:45:14.378364 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-de661aa8-98d1-42ad-88f2-ac63b37a41db tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:45:14.378812 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-de661aa8-98d1-42ad-88f2-ac63b37a41db tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:45:14.521081 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-de661aa8-98d1-42ad-88f2-ac63b37a41db tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:45:14.534232 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-de661aa8-98d1-42ad-88f2-ac63b37a41db tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:45:14.536010 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-de661aa8-98d1-42ad-88f2-ac63b37a41db tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:45:14.537603 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-de661aa8-98d1-42ad-88f2-ac63b37a41db tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] 10.222.0.121 "GET /compute/v2.1/servers/b0d153c5-90d0-4814-92ec-6f237601def9" status: 200 len: 1810 microversion: 2.20 time: 0.172842 Aug 04 10:45:14.538819 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 519/1039] 10.222.0.121 () {60 vars in 1282 bytes} [Thu Aug 4 10:45:14 2022] GET /compute/v2.1/servers/b0d153c5-90d0-4814-92ec-6f237601def9 => generated 1810 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:45:15.561937 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-732fc907-8ed1-43e8-9ce4-0ead7a604fac tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:45:15.562657 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-732fc907-8ed1-43e8-9ce4-0ead7a604fac tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] [instance: b0d153c5-90d0-4814-92ec-6f237601def9] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:45:15.569889 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-732fc907-8ed1-43e8-9ce4-0ead7a604fac tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:45:15.570268 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-732fc907-8ed1-43e8-9ce4-0ead7a604fac tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:45:15.571116 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-732fc907-8ed1-43e8-9ce4-0ead7a604fac tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:45:15.571573 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-732fc907-8ed1-43e8-9ce4-0ead7a604fac tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:45:15.718870 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-732fc907-8ed1-43e8-9ce4-0ead7a604fac tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:45:15.729206 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-732fc907-8ed1-43e8-9ce4-0ead7a604fac tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:45:15.730738 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-732fc907-8ed1-43e8-9ce4-0ead7a604fac tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:45:15.731967 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-732fc907-8ed1-43e8-9ce4-0ead7a604fac tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] 10.222.0.121 "GET /compute/v2.1/servers/b0d153c5-90d0-4814-92ec-6f237601def9" status: 200 len: 1810 microversion: 2.20 time: 0.174237 Aug 04 10:45:15.732580 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 521/1040] 10.222.0.121 () {60 vars in 1282 bytes} [Thu Aug 4 10:45:15 2022] GET /compute/v2.1/servers/b0d153c5-90d0-4814-92ec-6f237601def9 => generated 1810 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:45:16.756378 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-dfb5f04b-98c1-4c0e-b62f-f3ce20cf7062 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:45:16.757105 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-dfb5f04b-98c1-4c0e-b62f-f3ce20cf7062 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] [instance: b0d153c5-90d0-4814-92ec-6f237601def9] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:45:16.764620 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-dfb5f04b-98c1-4c0e-b62f-f3ce20cf7062 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:45:16.765087 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-dfb5f04b-98c1-4c0e-b62f-f3ce20cf7062 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:45:16.765891 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-dfb5f04b-98c1-4c0e-b62f-f3ce20cf7062 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:45:16.766416 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-dfb5f04b-98c1-4c0e-b62f-f3ce20cf7062 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:45:16.910364 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-dfb5f04b-98c1-4c0e-b62f-f3ce20cf7062 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:45:16.919811 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-dfb5f04b-98c1-4c0e-b62f-f3ce20cf7062 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:45:16.921415 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-dfb5f04b-98c1-4c0e-b62f-f3ce20cf7062 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:45:16.922623 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-dfb5f04b-98c1-4c0e-b62f-f3ce20cf7062 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] 10.222.0.121 "GET /compute/v2.1/servers/b0d153c5-90d0-4814-92ec-6f237601def9" status: 200 len: 1810 microversion: 2.20 time: 0.170561 Aug 04 10:45:16.923207 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 520/1041] 10.222.0.121 () {60 vars in 1282 bytes} [Thu Aug 4 10:45:16 2022] GET /compute/v2.1/servers/b0d153c5-90d0-4814-92ec-6f237601def9 => generated 1810 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:45:17.947044 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-60017968-b2ee-4817-ad05-5bb4c6aed038 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:45:17.947761 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-60017968-b2ee-4817-ad05-5bb4c6aed038 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] [instance: b0d153c5-90d0-4814-92ec-6f237601def9] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:45:17.955217 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-60017968-b2ee-4817-ad05-5bb4c6aed038 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:45:17.955671 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-60017968-b2ee-4817-ad05-5bb4c6aed038 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:45:17.956522 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-60017968-b2ee-4817-ad05-5bb4c6aed038 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:45:17.956975 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-60017968-b2ee-4817-ad05-5bb4c6aed038 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:45:18.122743 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-60017968-b2ee-4817-ad05-5bb4c6aed038 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:45:18.131629 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-60017968-b2ee-4817-ad05-5bb4c6aed038 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:45:18.133301 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-60017968-b2ee-4817-ad05-5bb4c6aed038 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:45:18.134695 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-60017968-b2ee-4817-ad05-5bb4c6aed038 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] 10.222.0.121 "GET /compute/v2.1/servers/b0d153c5-90d0-4814-92ec-6f237601def9" status: 200 len: 1810 microversion: 2.20 time: 0.191893 Aug 04 10:45:18.135270 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 522/1042] 10.222.0.121 () {60 vars in 1282 bytes} [Thu Aug 4 10:45:17 2022] GET /compute/v2.1/servers/b0d153c5-90d0-4814-92ec-6f237601def9 => generated 1810 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:45:19.158729 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-59160eb9-b9af-4b77-8f39-dae5a2bc6b21 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:45:19.159441 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-59160eb9-b9af-4b77-8f39-dae5a2bc6b21 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] [instance: b0d153c5-90d0-4814-92ec-6f237601def9] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:45:19.167772 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-59160eb9-b9af-4b77-8f39-dae5a2bc6b21 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:45:19.168298 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-59160eb9-b9af-4b77-8f39-dae5a2bc6b21 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:45:19.169113 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-59160eb9-b9af-4b77-8f39-dae5a2bc6b21 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:45:19.169784 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-59160eb9-b9af-4b77-8f39-dae5a2bc6b21 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:45:19.324300 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-59160eb9-b9af-4b77-8f39-dae5a2bc6b21 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:45:19.333692 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-59160eb9-b9af-4b77-8f39-dae5a2bc6b21 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:45:19.335198 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-59160eb9-b9af-4b77-8f39-dae5a2bc6b21 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:45:19.336581 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-59160eb9-b9af-4b77-8f39-dae5a2bc6b21 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] 10.222.0.121 "GET /compute/v2.1/servers/b0d153c5-90d0-4814-92ec-6f237601def9" status: 200 len: 1810 microversion: 2.20 time: 0.182233 Aug 04 10:45:19.337144 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 521/1043] 10.222.0.121 () {60 vars in 1282 bytes} [Thu Aug 4 10:45:19 2022] GET /compute/v2.1/servers/b0d153c5-90d0-4814-92ec-6f237601def9 => generated 1810 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:45:20.364483 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-46dc6c46-b76a-4425-a39d-7ec111a41aca tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:45:20.365473 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-46dc6c46-b76a-4425-a39d-7ec111a41aca tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] [instance: b0d153c5-90d0-4814-92ec-6f237601def9] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:45:20.376856 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-46dc6c46-b76a-4425-a39d-7ec111a41aca tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:45:20.377594 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-46dc6c46-b76a-4425-a39d-7ec111a41aca tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:45:20.378773 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-46dc6c46-b76a-4425-a39d-7ec111a41aca tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:45:20.379524 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-46dc6c46-b76a-4425-a39d-7ec111a41aca tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:45:20.520884 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-46dc6c46-b76a-4425-a39d-7ec111a41aca tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:45:20.529747 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-46dc6c46-b76a-4425-a39d-7ec111a41aca tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:45:20.531278 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-46dc6c46-b76a-4425-a39d-7ec111a41aca tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:45:20.532537 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-46dc6c46-b76a-4425-a39d-7ec111a41aca tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] 10.222.0.121 "GET /compute/v2.1/servers/b0d153c5-90d0-4814-92ec-6f237601def9" status: 200 len: 1810 microversion: 2.20 time: 0.175144 Aug 04 10:45:20.533110 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 523/1044] 10.222.0.121 () {60 vars in 1282 bytes} [Thu Aug 4 10:45:20 2022] GET /compute/v2.1/servers/b0d153c5-90d0-4814-92ec-6f237601def9 => generated 1810 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:45:21.562526 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-ea88abd8-4a1e-454e-9427-b2033f1184aa tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:45:21.563255 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-ea88abd8-4a1e-454e-9427-b2033f1184aa tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] [instance: b0d153c5-90d0-4814-92ec-6f237601def9] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:45:21.571168 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-ea88abd8-4a1e-454e-9427-b2033f1184aa tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:45:21.571636 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-ea88abd8-4a1e-454e-9427-b2033f1184aa tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:45:21.572569 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-ea88abd8-4a1e-454e-9427-b2033f1184aa tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:45:21.573023 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-ea88abd8-4a1e-454e-9427-b2033f1184aa tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:45:21.723355 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-ea88abd8-4a1e-454e-9427-b2033f1184aa tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:45:21.732397 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-ea88abd8-4a1e-454e-9427-b2033f1184aa tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:45:21.733941 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-ea88abd8-4a1e-454e-9427-b2033f1184aa tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:45:21.735225 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-ea88abd8-4a1e-454e-9427-b2033f1184aa tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] 10.222.0.121 "GET /compute/v2.1/servers/b0d153c5-90d0-4814-92ec-6f237601def9" status: 200 len: 1810 microversion: 2.20 time: 0.177692 Aug 04 10:45:21.735805 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 522/1045] 10.222.0.121 () {60 vars in 1282 bytes} [Thu Aug 4 10:45:21 2022] GET /compute/v2.1/servers/b0d153c5-90d0-4814-92ec-6f237601def9 => generated 1810 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:45:22.760769 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-045a383a-cfab-4ed0-84d7-26db3c92330b tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:45:22.761424 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-045a383a-cfab-4ed0-84d7-26db3c92330b tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] [instance: b0d153c5-90d0-4814-92ec-6f237601def9] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:45:22.768313 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-045a383a-cfab-4ed0-84d7-26db3c92330b tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:45:22.768799 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-045a383a-cfab-4ed0-84d7-26db3c92330b tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:45:22.769647 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-045a383a-cfab-4ed0-84d7-26db3c92330b tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:45:22.770099 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-045a383a-cfab-4ed0-84d7-26db3c92330b tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:45:22.913178 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-045a383a-cfab-4ed0-84d7-26db3c92330b tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:45:22.922572 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-045a383a-cfab-4ed0-84d7-26db3c92330b tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:45:22.924785 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-045a383a-cfab-4ed0-84d7-26db3c92330b tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:45:22.926338 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-045a383a-cfab-4ed0-84d7-26db3c92330b tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] 10.222.0.121 "GET /compute/v2.1/servers/b0d153c5-90d0-4814-92ec-6f237601def9" status: 200 len: 1810 microversion: 2.20 time: 0.171263 Aug 04 10:45:22.927626 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 524/1046] 10.222.0.121 () {60 vars in 1282 bytes} [Thu Aug 4 10:45:22 2022] GET /compute/v2.1/servers/b0d153c5-90d0-4814-92ec-6f237601def9 => generated 1810 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:45:23.953820 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-b195ecd7-8fb6-4f23-b45f-3f6b60e4fd84 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:45:23.954531 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-b195ecd7-8fb6-4f23-b45f-3f6b60e4fd84 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] [instance: b0d153c5-90d0-4814-92ec-6f237601def9] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:45:23.964167 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-b195ecd7-8fb6-4f23-b45f-3f6b60e4fd84 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:45:23.964636 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-b195ecd7-8fb6-4f23-b45f-3f6b60e4fd84 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:45:23.965429 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-b195ecd7-8fb6-4f23-b45f-3f6b60e4fd84 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:45:23.965878 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-b195ecd7-8fb6-4f23-b45f-3f6b60e4fd84 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:45:24.107996 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-b195ecd7-8fb6-4f23-b45f-3f6b60e4fd84 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:45:24.119129 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-b195ecd7-8fb6-4f23-b45f-3f6b60e4fd84 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:45:24.121398 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-b195ecd7-8fb6-4f23-b45f-3f6b60e4fd84 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:45:24.123283 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-b195ecd7-8fb6-4f23-b45f-3f6b60e4fd84 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] 10.222.0.121 "GET /compute/v2.1/servers/b0d153c5-90d0-4814-92ec-6f237601def9" status: 200 len: 1810 microversion: 2.20 time: 0.174715 Aug 04 10:45:24.124157 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 523/1047] 10.222.0.121 () {60 vars in 1282 bytes} [Thu Aug 4 10:45:23 2022] GET /compute/v2.1/servers/b0d153c5-90d0-4814-92ec-6f237601def9 => generated 1810 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:45:25.153498 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-281b0c4f-be00-4f64-b89a-ea273f21bf3d tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:45:25.155451 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-281b0c4f-be00-4f64-b89a-ea273f21bf3d tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] [instance: b0d153c5-90d0-4814-92ec-6f237601def9] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:45:25.163840 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG dbcounter [-] [124457] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1 {{(pid=124457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:45:25.165923 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-281b0c4f-be00-4f64-b89a-ea273f21bf3d tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:45:25.166662 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-281b0c4f-be00-4f64-b89a-ea273f21bf3d tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:45:25.167772 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-281b0c4f-be00-4f64-b89a-ea273f21bf3d tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:45:25.168769 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-281b0c4f-be00-4f64-b89a-ea273f21bf3d tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:45:25.345354 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-281b0c4f-be00-4f64-b89a-ea273f21bf3d tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:45:25.354418 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-281b0c4f-be00-4f64-b89a-ea273f21bf3d tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:45:25.356037 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-281b0c4f-be00-4f64-b89a-ea273f21bf3d tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:45:25.357196 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-281b0c4f-be00-4f64-b89a-ea273f21bf3d tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] 10.222.0.121 "GET /compute/v2.1/servers/b0d153c5-90d0-4814-92ec-6f237601def9" status: 200 len: 1810 microversion: 2.20 time: 0.210733 Aug 04 10:45:25.357790 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 525/1048] 10.222.0.121 () {60 vars in 1282 bytes} [Thu Aug 4 10:45:25 2022] GET /compute/v2.1/servers/b0d153c5-90d0-4814-92ec-6f237601def9 => generated 1810 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:45:26.381471 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-bade80d4-165f-47e1-b9bc-e3af7eac86ff tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:45:26.382123 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-bade80d4-165f-47e1-b9bc-e3af7eac86ff tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] [instance: b0d153c5-90d0-4814-92ec-6f237601def9] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:45:26.389712 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-bade80d4-165f-47e1-b9bc-e3af7eac86ff tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:45:26.390088 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-bade80d4-165f-47e1-b9bc-e3af7eac86ff tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:45:26.390994 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-bade80d4-165f-47e1-b9bc-e3af7eac86ff tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:45:26.391452 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-bade80d4-165f-47e1-b9bc-e3af7eac86ff tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:45:26.537451 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-bade80d4-165f-47e1-b9bc-e3af7eac86ff tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:45:26.550500 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-bade80d4-165f-47e1-b9bc-e3af7eac86ff tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:45:26.552278 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-bade80d4-165f-47e1-b9bc-e3af7eac86ff tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:45:26.553643 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-bade80d4-165f-47e1-b9bc-e3af7eac86ff tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] 10.222.0.121 "GET /compute/v2.1/servers/b0d153c5-90d0-4814-92ec-6f237601def9" status: 200 len: 1810 microversion: 2.20 time: 0.176300 Aug 04 10:45:26.569116 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 524/1049] 10.222.0.121 () {60 vars in 1282 bytes} [Thu Aug 4 10:45:26 2022] GET /compute/v2.1/servers/b0d153c5-90d0-4814-92ec-6f237601def9 => generated 1810 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:45:27.578532 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-2eca8b51-da9c-4c53-be84-3fae7d23b853 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:45:27.579284 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-2eca8b51-da9c-4c53-be84-3fae7d23b853 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] [instance: b0d153c5-90d0-4814-92ec-6f237601def9] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:45:27.586109 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-2eca8b51-da9c-4c53-be84-3fae7d23b853 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:45:27.586680 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-2eca8b51-da9c-4c53-be84-3fae7d23b853 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:45:27.587586 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-2eca8b51-da9c-4c53-be84-3fae7d23b853 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:45:27.588136 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-2eca8b51-da9c-4c53-be84-3fae7d23b853 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:45:27.740851 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-2eca8b51-da9c-4c53-be84-3fae7d23b853 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:45:27.752202 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-2eca8b51-da9c-4c53-be84-3fae7d23b853 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:45:27.753717 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-2eca8b51-da9c-4c53-be84-3fae7d23b853 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:45:27.754925 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-2eca8b51-da9c-4c53-be84-3fae7d23b853 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] 10.222.0.121 "GET /compute/v2.1/servers/b0d153c5-90d0-4814-92ec-6f237601def9" status: 200 len: 1810 microversion: 2.20 time: 0.180684 Aug 04 10:45:27.759712 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 526/1050] 10.222.0.121 () {60 vars in 1282 bytes} [Thu Aug 4 10:45:27 2022] GET /compute/v2.1/servers/b0d153c5-90d0-4814-92ec-6f237601def9 => generated 1810 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:45:28.780429 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-8f30f202-b7ef-4dcb-8f0a-1ef6246a0bbc tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:45:28.781152 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-8f30f202-b7ef-4dcb-8f0a-1ef6246a0bbc tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] [instance: b0d153c5-90d0-4814-92ec-6f237601def9] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:45:28.783568 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG dbcounter [-] [124456] Writing DB stats nova_api:SELECT=38 {{(pid=124456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:45:28.789702 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-8f30f202-b7ef-4dcb-8f0a-1ef6246a0bbc tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:45:28.790163 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-8f30f202-b7ef-4dcb-8f0a-1ef6246a0bbc tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:45:28.791976 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-8f30f202-b7ef-4dcb-8f0a-1ef6246a0bbc tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:45:28.792517 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-8f30f202-b7ef-4dcb-8f0a-1ef6246a0bbc tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:45:28.945111 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-8f30f202-b7ef-4dcb-8f0a-1ef6246a0bbc tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:45:28.954540 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-8f30f202-b7ef-4dcb-8f0a-1ef6246a0bbc tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:45:28.956136 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-8f30f202-b7ef-4dcb-8f0a-1ef6246a0bbc tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:45:28.957392 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-8f30f202-b7ef-4dcb-8f0a-1ef6246a0bbc tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] 10.222.0.121 "GET /compute/v2.1/servers/b0d153c5-90d0-4814-92ec-6f237601def9" status: 200 len: 1810 microversion: 2.20 time: 0.181390 Aug 04 10:45:28.958197 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 525/1051] 10.222.0.121 () {60 vars in 1282 bytes} [Thu Aug 4 10:45:28 2022] GET /compute/v2.1/servers/b0d153c5-90d0-4814-92ec-6f237601def9 => generated 1810 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:45:29.984517 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-ba97b489-2bf5-4fb7-9dca-280687e916f5 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:45:29.985165 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-ba97b489-2bf5-4fb7-9dca-280687e916f5 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] [instance: b0d153c5-90d0-4814-92ec-6f237601def9] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:45:29.992653 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-ba97b489-2bf5-4fb7-9dca-280687e916f5 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:45:29.993115 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-ba97b489-2bf5-4fb7-9dca-280687e916f5 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:45:29.993906 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-ba97b489-2bf5-4fb7-9dca-280687e916f5 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:45:29.994358 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-ba97b489-2bf5-4fb7-9dca-280687e916f5 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:45:30.145290 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-ba97b489-2bf5-4fb7-9dca-280687e916f5 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:45:30.154567 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-ba97b489-2bf5-4fb7-9dca-280687e916f5 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:45:30.155995 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-ba97b489-2bf5-4fb7-9dca-280687e916f5 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:45:30.157225 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-ba97b489-2bf5-4fb7-9dca-280687e916f5 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] 10.222.0.121 "GET /compute/v2.1/servers/b0d153c5-90d0-4814-92ec-6f237601def9" status: 200 len: 1810 microversion: 2.20 time: 0.177496 Aug 04 10:45:30.157798 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 527/1052] 10.222.0.121 () {60 vars in 1282 bytes} [Thu Aug 4 10:45:29 2022] GET /compute/v2.1/servers/b0d153c5-90d0-4814-92ec-6f237601def9 => generated 1810 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:45:31.181822 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-0320326d-71f5-456c-9768-baa8a12dc635 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:45:31.182539 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-0320326d-71f5-456c-9768-baa8a12dc635 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] [instance: b0d153c5-90d0-4814-92ec-6f237601def9] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:45:31.189866 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-0320326d-71f5-456c-9768-baa8a12dc635 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:45:31.190324 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-0320326d-71f5-456c-9768-baa8a12dc635 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:45:31.191096 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-0320326d-71f5-456c-9768-baa8a12dc635 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:45:31.191570 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-0320326d-71f5-456c-9768-baa8a12dc635 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:45:31.332311 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-0320326d-71f5-456c-9768-baa8a12dc635 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:45:31.341587 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-0320326d-71f5-456c-9768-baa8a12dc635 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:45:31.343085 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-0320326d-71f5-456c-9768-baa8a12dc635 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:45:31.344689 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-0320326d-71f5-456c-9768-baa8a12dc635 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] 10.222.0.121 "GET /compute/v2.1/servers/b0d153c5-90d0-4814-92ec-6f237601def9" status: 200 len: 1810 microversion: 2.20 time: 0.166752 Aug 04 10:45:31.345279 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 526/1053] 10.222.0.121 () {60 vars in 1282 bytes} [Thu Aug 4 10:45:31 2022] GET /compute/v2.1/servers/b0d153c5-90d0-4814-92ec-6f237601def9 => generated 1810 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:45:32.368480 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-58bafc3a-75d3-40ec-bebc-7fa91857cf58 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:45:32.369158 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-58bafc3a-75d3-40ec-bebc-7fa91857cf58 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] [instance: b0d153c5-90d0-4814-92ec-6f237601def9] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:45:32.376548 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-58bafc3a-75d3-40ec-bebc-7fa91857cf58 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:45:32.377008 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-58bafc3a-75d3-40ec-bebc-7fa91857cf58 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:45:32.377857 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-58bafc3a-75d3-40ec-bebc-7fa91857cf58 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:45:32.378292 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-58bafc3a-75d3-40ec-bebc-7fa91857cf58 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:45:32.522407 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [req-5242e0f6-59f8-4a09-b0bc-ca10f2475c4f req-890c6684-429d-460d-942c-de96e4a90cee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0d153c5-90d0-4814-92ec-6f237601def9", "name": "network-vif-plugged", "status": "completed", "tag": "800ffaa9-8acb-4634-8260-3d89de6eccd5"}]} {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:45:32.529623 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-58bafc3a-75d3-40ec-bebc-7fa91857cf58 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:45:32.535101 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [req-5242e0f6-59f8-4a09-b0bc-ca10f2475c4f req-890c6684-429d-460d-942c-de96e4a90cee service nova] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:45:32.535558 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [req-5242e0f6-59f8-4a09-b0bc-ca10f2475c4f req-890c6684-429d-460d-942c-de96e4a90cee service nova] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:45:32.541582 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-58bafc3a-75d3-40ec-bebc-7fa91857cf58 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:45:32.543378 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-58bafc3a-75d3-40ec-bebc-7fa91857cf58 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:45:32.544815 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-58bafc3a-75d3-40ec-bebc-7fa91857cf58 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] 10.222.0.121 "GET /compute/v2.1/servers/b0d153c5-90d0-4814-92ec-6f237601def9" status: 200 len: 1810 microversion: 2.20 time: 0.180611 Aug 04 10:45:32.545514 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 528/1054] 10.222.0.121 () {60 vars in 1282 bytes} [Thu Aug 4 10:45:32 2022] GET /compute/v2.1/servers/b0d153c5-90d0-4814-92ec-6f237601def9 => generated 1810 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:45:32.550675 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.compute.server_external_events [req-5242e0f6-59f8-4a09-b0bc-ca10f2475c4f req-890c6684-429d-460d-942c-de96e4a90cee service nova] Creating event network-vif-plugged:800ffaa9-8acb-4634-8260-3d89de6eccd5 for instance b0d153c5-90d0-4814-92ec-6f237601def9 on hv-cinder-85200 Aug 04 10:45:32.563626 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [req-5242e0f6-59f8-4a09-b0bc-ca10f2475c4f req-890c6684-429d-460d-942c-de96e4a90cee service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048495 Aug 04 10:45:32.564370 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 527/1055] 10.222.0.121 () {64 vars in 1322 bytes} [Thu Aug 4 10:45:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:45:33.570162 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-2b514cc2-fd70-43ba-beec-66efd467edbc tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:45:33.570862 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-2b514cc2-fd70-43ba-beec-66efd467edbc tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] [instance: b0d153c5-90d0-4814-92ec-6f237601def9] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:45:33.578063 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-2b514cc2-fd70-43ba-beec-66efd467edbc tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:45:33.583628 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-2b514cc2-fd70-43ba-beec-66efd467edbc tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:45:33.584576 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-2b514cc2-fd70-43ba-beec-66efd467edbc tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:45:33.585050 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-2b514cc2-fd70-43ba-beec-66efd467edbc tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:45:33.731189 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-2b514cc2-fd70-43ba-beec-66efd467edbc tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:45:33.742347 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-2b514cc2-fd70-43ba-beec-66efd467edbc tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:45:33.744366 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-2b514cc2-fd70-43ba-beec-66efd467edbc tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:45:33.745696 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-2b514cc2-fd70-43ba-beec-66efd467edbc tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] 10.222.0.121 "GET /compute/v2.1/servers/b0d153c5-90d0-4814-92ec-6f237601def9" status: 200 len: 1810 microversion: 2.20 time: 0.179836 Aug 04 10:45:33.746238 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 529/1056] 10.222.0.121 () {60 vars in 1282 bytes} [Thu Aug 4 10:45:33 2022] GET /compute/v2.1/servers/b0d153c5-90d0-4814-92ec-6f237601def9 => generated 1810 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:45:34.771032 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-77559c0b-8204-4a09-b717-10ea033ad046 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:45:34.771795 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-77559c0b-8204-4a09-b717-10ea033ad046 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] [instance: b0d153c5-90d0-4814-92ec-6f237601def9] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:45:34.779380 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-77559c0b-8204-4a09-b717-10ea033ad046 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:45:34.779838 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-77559c0b-8204-4a09-b717-10ea033ad046 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:45:34.780910 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-77559c0b-8204-4a09-b717-10ea033ad046 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:45:34.781283 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-77559c0b-8204-4a09-b717-10ea033ad046 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:45:34.935455 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-77559c0b-8204-4a09-b717-10ea033ad046 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:45:34.944811 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-77559c0b-8204-4a09-b717-10ea033ad046 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:45:34.946304 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-77559c0b-8204-4a09-b717-10ea033ad046 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:45:34.947565 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-77559c0b-8204-4a09-b717-10ea033ad046 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] 10.222.0.121 "GET /compute/v2.1/servers/b0d153c5-90d0-4814-92ec-6f237601def9" status: 200 len: 1810 microversion: 2.20 time: 0.181666 Aug 04 10:45:34.948233 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 528/1057] 10.222.0.121 () {60 vars in 1282 bytes} [Thu Aug 4 10:45:34 2022] GET /compute/v2.1/servers/b0d153c5-90d0-4814-92ec-6f237601def9 => generated 1810 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:45:35.971540 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-eae9c1cf-327e-44c0-a4cd-2fee087b93c4 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:45:35.972243 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-eae9c1cf-327e-44c0-a4cd-2fee087b93c4 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] [instance: b0d153c5-90d0-4814-92ec-6f237601def9] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:45:35.984260 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-eae9c1cf-327e-44c0-a4cd-2fee087b93c4 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:45:35.984260 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-eae9c1cf-327e-44c0-a4cd-2fee087b93c4 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:45:35.984260 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-eae9c1cf-327e-44c0-a4cd-2fee087b93c4 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:45:35.984260 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-eae9c1cf-327e-44c0-a4cd-2fee087b93c4 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:45:35.989235 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG dbcounter [-] [124457] Writing DB stats nova_cell1:SELECT=75 {{(pid=124457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:45:36.134084 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-eae9c1cf-327e-44c0-a4cd-2fee087b93c4 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:45:36.143417 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-eae9c1cf-327e-44c0-a4cd-2fee087b93c4 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:45:36.145012 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-eae9c1cf-327e-44c0-a4cd-2fee087b93c4 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:45:36.146217 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-eae9c1cf-327e-44c0-a4cd-2fee087b93c4 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] 10.222.0.121 "GET /compute/v2.1/servers/b0d153c5-90d0-4814-92ec-6f237601def9" status: 200 len: 1797 microversion: 2.20 time: 0.179464 Aug 04 10:45:36.146809 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 530/1058] 10.222.0.121 () {60 vars in 1282 bytes} [Thu Aug 4 10:45:35 2022] GET /compute/v2.1/servers/b0d153c5-90d0-4814-92ec-6f237601def9 => generated 1797 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:46:31.492344 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-c0e7730d-37cb-409c-9560-ccbb1b2b8d6d tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:46:31.493215 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-c0e7730d-37cb-409c-9560-ccbb1b2b8d6d tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] [instance: b0d153c5-90d0-4814-92ec-6f237601def9] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:46:31.495057 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG dbcounter [-] [124456] Writing DB stats nova_api:SELECT=7 {{(pid=124456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:46:31.495751 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG dbcounter [-] [124456] Writing DB stats nova_cell1:SELECT=64 {{(pid=124456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:46:31.502207 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-c0e7730d-37cb-409c-9560-ccbb1b2b8d6d tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:46:31.502651 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-c0e7730d-37cb-409c-9560-ccbb1b2b8d6d tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:46:31.503450 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-c0e7730d-37cb-409c-9560-ccbb1b2b8d6d tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:46:31.503889 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-c0e7730d-37cb-409c-9560-ccbb1b2b8d6d tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:46:31.538881 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-c0e7730d-37cb-409c-9560-ccbb1b2b8d6d tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] 10.222.0.121 "GET /compute/v2.1/servers/b0d153c5-90d0-4814-92ec-6f237601def9/os-volume_attachments/439ed172-de22-43fa-91d9-34e38d801754" status: 200 len: 194 microversion: 2.20 time: 0.050890 Aug 04 10:46:31.539510 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 529/1059] 10.222.0.121 () {60 vars in 1459 bytes} [Thu Aug 4 10:46:31 2022] GET /compute/v2.1/servers/b0d153c5-90d0-4814-92ec-6f237601def9/os-volume_attachments/439ed172-de22-43fa-91d9-34e38d801754 => generated 194 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 10:46:31.613475 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-03643438-149f-4610-a1bc-c2c4401078f2 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:46:31.614175 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-03643438-149f-4610-a1bc-c2c4401078f2 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] [instance: b0d153c5-90d0-4814-92ec-6f237601def9] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:46:31.616399 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG dbcounter [-] [124457] Writing DB stats nova_api:SELECT=11 {{(pid=124457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:46:31.617068 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG dbcounter [-] [124457] Writing DB stats nova_cell1:SELECT=5 {{(pid=124457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:46:31.623643 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-03643438-149f-4610-a1bc-c2c4401078f2 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:46:31.624142 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-03643438-149f-4610-a1bc-c2c4401078f2 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:46:31.624958 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-03643438-149f-4610-a1bc-c2c4401078f2 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:46:31.625436 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-03643438-149f-4610-a1bc-c2c4401078f2 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:46:31.710919 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.objects.instance [None req-03643438-149f-4610-a1bc-c2c4401078f2 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lazy-loading 'services' on Instance uuid b0d153c5-90d0-4814-92ec-6f237601def9 {{(pid=124457) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 10:46:31.796256 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-03643438-149f-4610-a1bc-c2c4401078f2 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] 10.222.0.121 "DELETE /compute/v2.1/servers/b0d153c5-90d0-4814-92ec-6f237601def9/os-volume_attachments/439ed172-de22-43fa-91d9-34e38d801754" status: 202 len: 0 microversion: 2.20 time: 0.186835 Aug 04 10:46:31.796940 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 531/1060] 10.222.0.121 () {60 vars in 1462 bytes} [Thu Aug 4 10:46:31 2022] DELETE /compute/v2.1/servers/b0d153c5-90d0-4814-92ec-6f237601def9/os-volume_attachments/439ed172-de22-43fa-91d9-34e38d801754 => generated 0 bytes in 189 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 04 10:46:31.806677 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-eeca064f-a259-40f6-a66c-c90588530cfb tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:46:31.809009 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-eeca064f-a259-40f6-a66c-c90588530cfb tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] [instance: b0d153c5-90d0-4814-92ec-6f237601def9] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:46:31.815842 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-eeca064f-a259-40f6-a66c-c90588530cfb tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:46:31.816435 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-eeca064f-a259-40f6-a66c-c90588530cfb tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:46:31.817407 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-eeca064f-a259-40f6-a66c-c90588530cfb tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:46:31.817849 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-eeca064f-a259-40f6-a66c-c90588530cfb tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:46:31.851437 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-eeca064f-a259-40f6-a66c-c90588530cfb tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] 10.222.0.121 "GET /compute/v2.1/servers/b0d153c5-90d0-4814-92ec-6f237601def9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048860 Aug 04 10:46:31.852331 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 530/1061] 10.222.0.121 () {60 vars in 1348 bytes} [Thu Aug 4 10:46:31 2022] GET /compute/v2.1/servers/b0d153c5-90d0-4814-92ec-6f237601def9/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 04 10:46:32.866775 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-503761d0-f96e-4046-9bb2-58951b0dd150 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:46:32.869436 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-503761d0-f96e-4046-9bb2-58951b0dd150 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] [instance: b0d153c5-90d0-4814-92ec-6f237601def9] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:46:32.877038 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-503761d0-f96e-4046-9bb2-58951b0dd150 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:46:32.877541 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-503761d0-f96e-4046-9bb2-58951b0dd150 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:46:32.878307 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-503761d0-f96e-4046-9bb2-58951b0dd150 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:46:32.878755 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-503761d0-f96e-4046-9bb2-58951b0dd150 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:46:32.913981 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-503761d0-f96e-4046-9bb2-58951b0dd150 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] 10.222.0.121 "GET /compute/v2.1/servers/b0d153c5-90d0-4814-92ec-6f237601def9/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.052454 Aug 04 10:46:32.914650 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 532/1062] 10.222.0.121 () {60 vars in 1348 bytes} [Thu Aug 4 10:46:32 2022] GET /compute/v2.1/servers/b0d153c5-90d0-4814-92ec-6f237601def9/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:46:32.981605 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-b6d3b8d2-f078-4dd3-8e22-bd75bd7821d9 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:46:32.982235 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-b6d3b8d2-f078-4dd3-8e22-bd75bd7821d9 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] [instance: b0d153c5-90d0-4814-92ec-6f237601def9] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:46:32.989464 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-b6d3b8d2-f078-4dd3-8e22-bd75bd7821d9 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:46:32.989919 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-b6d3b8d2-f078-4dd3-8e22-bd75bd7821d9 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:46:32.990707 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-b6d3b8d2-f078-4dd3-8e22-bd75bd7821d9 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:46:32.991149 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-b6d3b8d2-f078-4dd3-8e22-bd75bd7821d9 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:46:33.029587 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-b6d3b8d2-f078-4dd3-8e22-bd75bd7821d9 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] [instance: b0d153c5-90d0-4814-92ec-6f237601def9] Going to try to terminate instance {{(pid=124456) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 10:46:33.117520 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-b6d3b8d2-f078-4dd3-8e22-bd75bd7821d9 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] 10.222.0.121 "DELETE /compute/v2.1/servers/b0d153c5-90d0-4814-92ec-6f237601def9" status: 204 len: 0 microversion: 2.20 time: 0.139510 Aug 04 10:46:33.118412 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 531/1063] 10.222.0.121 () {60 vars in 1285 bytes} [Thu Aug 4 10:46:32 2022] DELETE /compute/v2.1/servers/b0d153c5-90d0-4814-92ec-6f237601def9 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 04 10:46:33.127325 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-3a023403-cf17-4a2e-b1ca-81e6e6430e4f tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:46:33.128097 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-3a023403-cf17-4a2e-b1ca-81e6e6430e4f tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] [instance: b0d153c5-90d0-4814-92ec-6f237601def9] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:46:33.134960 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-3a023403-cf17-4a2e-b1ca-81e6e6430e4f tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:46:33.135414 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-3a023403-cf17-4a2e-b1ca-81e6e6430e4f tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:46:33.136236 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-3a023403-cf17-4a2e-b1ca-81e6e6430e4f tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:46:33.136696 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-3a023403-cf17-4a2e-b1ca-81e6e6430e4f tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:46:33.275727 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-3a023403-cf17-4a2e-b1ca-81e6e6430e4f tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:46:33.284351 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-3a023403-cf17-4a2e-b1ca-81e6e6430e4f tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:46:33.285929 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-3a023403-cf17-4a2e-b1ca-81e6e6430e4f tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:46:33.287284 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-3a023403-cf17-4a2e-b1ca-81e6e6430e4f tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] 10.222.0.121 "GET /compute/v2.1/servers/b0d153c5-90d0-4814-92ec-6f237601def9" status: 200 len: 1725 microversion: 2.20 time: 0.164170 Aug 04 10:46:33.288018 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 533/1064] 10.222.0.121 () {60 vars in 1282 bytes} [Thu Aug 4 10:46:33 2022] GET /compute/v2.1/servers/b0d153c5-90d0-4814-92ec-6f237601def9 => generated 1725 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:46:34.313780 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-f63b7d1d-9dad-4da2-be4d-4fe26a6b3d95 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:46:34.314526 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-f63b7d1d-9dad-4da2-be4d-4fe26a6b3d95 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] [instance: b0d153c5-90d0-4814-92ec-6f237601def9] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:46:34.322209 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-f63b7d1d-9dad-4da2-be4d-4fe26a6b3d95 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:46:34.322674 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-f63b7d1d-9dad-4da2-be4d-4fe26a6b3d95 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:46:34.323494 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-f63b7d1d-9dad-4da2-be4d-4fe26a6b3d95 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:46:34.323984 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-f63b7d1d-9dad-4da2-be4d-4fe26a6b3d95 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:46:34.738049 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-f63b7d1d-9dad-4da2-be4d-4fe26a6b3d95 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:46:34.747066 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-f63b7d1d-9dad-4da2-be4d-4fe26a6b3d95 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:46:34.748685 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-f63b7d1d-9dad-4da2-be4d-4fe26a6b3d95 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:46:34.749923 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-f63b7d1d-9dad-4da2-be4d-4fe26a6b3d95 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] 10.222.0.121 "GET /compute/v2.1/servers/b0d153c5-90d0-4814-92ec-6f237601def9" status: 200 len: 1725 microversion: 2.20 time: 0.440842 Aug 04 10:46:34.750570 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 532/1065] 10.222.0.121 () {60 vars in 1282 bytes} [Thu Aug 4 10:46:34 2022] GET /compute/v2.1/servers/b0d153c5-90d0-4814-92ec-6f237601def9 => generated 1725 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:46:35.773947 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-8c59de5f-bc8c-420d-a312-0cb75c43ad9d tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:46:35.774765 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-8c59de5f-bc8c-420d-a312-0cb75c43ad9d tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] [instance: b0d153c5-90d0-4814-92ec-6f237601def9] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:46:35.782521 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-8c59de5f-bc8c-420d-a312-0cb75c43ad9d tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:46:35.782877 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-8c59de5f-bc8c-420d-a312-0cb75c43ad9d tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:46:35.783659 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-8c59de5f-bc8c-420d-a312-0cb75c43ad9d tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:46:35.784158 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-8c59de5f-bc8c-420d-a312-0cb75c43ad9d tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:46:35.858939 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-8c59de5f-bc8c-420d-a312-0cb75c43ad9d tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:46:35.867978 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-8c59de5f-bc8c-420d-a312-0cb75c43ad9d tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:46:35.869544 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-8c59de5f-bc8c-420d-a312-0cb75c43ad9d tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:46:35.870738 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-8c59de5f-bc8c-420d-a312-0cb75c43ad9d tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] 10.222.0.121 "GET /compute/v2.1/servers/b0d153c5-90d0-4814-92ec-6f237601def9" status: 200 len: 1658 microversion: 2.20 time: 0.101155 Aug 04 10:46:35.871364 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 534/1066] 10.222.0.121 () {60 vars in 1282 bytes} [Thu Aug 4 10:46:35 2022] GET /compute/v2.1/servers/b0d153c5-90d0-4814-92ec-6f237601def9 => generated 1658 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:46:36.052965 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [req-0ed27b45-54a1-4f5b-9452-e8bb08ab82d0 req-155d0167-323a-4f3d-9587-92e059602721 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0d153c5-90d0-4814-92ec-6f237601def9", "name": "network-vif-deleted", "tag": "800ffaa9-8acb-4634-8260-3d89de6eccd5"}]} {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:46:36.064759 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [req-0ed27b45-54a1-4f5b-9452-e8bb08ab82d0 req-155d0167-323a-4f3d-9587-92e059602721 service nova] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:46:36.065174 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [req-0ed27b45-54a1-4f5b-9452-e8bb08ab82d0 req-155d0167-323a-4f3d-9587-92e059602721 service nova] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:46:36.082716 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.compute.server_external_events [req-0ed27b45-54a1-4f5b-9452-e8bb08ab82d0 req-155d0167-323a-4f3d-9587-92e059602721 service nova] Creating event network-vif-deleted:800ffaa9-8acb-4634-8260-3d89de6eccd5 for instance b0d153c5-90d0-4814-92ec-6f237601def9 on hv-cinder-85200 Aug 04 10:46:36.089533 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [req-0ed27b45-54a1-4f5b-9452-e8bb08ab82d0 req-155d0167-323a-4f3d-9587-92e059602721 service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040501 Aug 04 10:46:36.093874 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 533/1067] 10.222.0.121 () {64 vars in 1322 bytes} [Thu Aug 4 10:46:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:46:36.895015 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-a4f4f681-14d2-40b3-b999-6944fbb3edda tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:46:36.895659 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-a4f4f681-14d2-40b3-b999-6944fbb3edda tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] [instance: b0d153c5-90d0-4814-92ec-6f237601def9] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:46:36.903628 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-a4f4f681-14d2-40b3-b999-6944fbb3edda tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:46:36.904125 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-a4f4f681-14d2-40b3-b999-6944fbb3edda tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:46:36.904949 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-a4f4f681-14d2-40b3-b999-6944fbb3edda tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:46:36.905396 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-a4f4f681-14d2-40b3-b999-6944fbb3edda tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:46:36.920910 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.wsgi [None req-a4f4f681-14d2-40b3-b999-6944fbb3edda tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] HTTP exception thrown: Instance b0d153c5-90d0-4814-92ec-6f237601def9 could not be found. Aug 04 10:46:36.923007 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-a4f4f681-14d2-40b3-b999-6944fbb3edda tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Request method failure captured: Aug 04 10:46:36.923007 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: request: GET /compute/v2.1/servers/b0d153c5-90d0-4814-92ec-6f237601def9 HTTP/1.1 Aug 04 10:46:36.923007 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: Accept: application/json Aug 04 10:46:36.923007 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: Accept-Encoding: identity Aug 04 10:46:36.923007 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: Connection: close Aug 04 10:46:36.923007 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: Content-Length: 0 Aug 04 10:46:36.923007 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: Content-Type: application/json Aug 04 10:46:36.923007 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: Host: 10.222.0.121 Aug 04 10:46:36.923007 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: Openstack-System-Scope: None Aug 04 10:46:36.923007 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: User-Agent: python-urllib3/1.26.11 Aug 04 10:46:36.923007 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Auth-Token: gAAAAABi66KV7b1Y_j4kdGqXsQGrCsyrMvYeNIyDM37JsB_tbsGBeodavgBf1gb7117EW3-BIqFTnIsdi1M4YkklBwFtZnK-pFDxRPpn7avu3xKkfr_bwzIyWL0oK7-iXJPlJGLeGliqWHjTKoBafP2EyD8nNI1ca96zThoqRI4TjZhVpSk8_CM Aug 04 10:46:36.923007 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Domain-Id: None Aug 04 10:46:36.923007 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Domain-Name: None Aug 04 10:46:36.923007 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Identity-Status: Confirmed Aug 04 10:46:36.923007 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Is-Admin-Project: True Aug 04 10:46:36.923007 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Openstack-Nova-Api-Version: 2.20 Aug 04 10:46:36.923007 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Project-Domain-Id: default Aug 04 10:46:36.923007 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Project-Domain-Name: Default Aug 04 10:46:36.923007 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Project-Id: 18d95fd38a664ce1b69afbb11189020a Aug 04 10:46:36.923007 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1397441079 Aug 04 10:46:36.923007 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Role: reader,member Aug 04 10:46:36.923007 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Roles: reader,member Aug 04 10:46:36.924783 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/18d95fd38a664ce1b69afbb11189020a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/18d95fd38a664ce1b69afbb11189020a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.121:8080", "publicURL": "http://10.222.0.121:8080/v1/AUTH_18d95fd38a664ce1b69afbb11189020a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2/18d95fd38a664ce1b69afbb11189020a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:9696/networking"}]}] Aug 04 10:46:36.924783 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1397441079 Aug 04 10:46:36.924783 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Tenant-Id: 18d95fd38a664ce1b69afbb11189020a Aug 04 10:46:36.924783 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1397441079 Aug 04 10:46:36.924783 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-User: tempest-AttachVolumeShelveTestJSON-1397441079-project Aug 04 10:46:36.924783 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-User-Domain-Id: default Aug 04 10:46:36.924783 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-User-Domain-Name: Default Aug 04 10:46:36.924783 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-User-Id: f2c14f2350dd450b846db0c22c43688b Aug 04 10:46:36.924783 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1397441079-project Aug 04 10:46:36.924783 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: method: > Aug 04 10:46:36.924783 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: exception: Instance b0d153c5-90d0-4814-92ec-6f237601def9 could not be found. Aug 04 10:46:36.924783 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: action_args: {'id': 'b0d153c5-90d0-4814-92ec-6f237601def9'} Aug 04 10:46:36.925717 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 10:46:36.925717 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:46:36.925717 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 10:46:36.925717 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 10:46:36.925717 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 10:46:36.925717 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 10:46:36.925717 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 10:46:36.925717 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 10:46:36.925717 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 10:46:36.925717 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 10:46:36.925717 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0d153c5-90d0-4814-92ec-6f237601def9 could not be found. Aug 04 10:46:36.925717 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Aug 04 10:46:36.925717 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:46:36.925717 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Aug 04 10:46:36.925717 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:46:36.925717 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:46:36.925717 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:46:36.925717 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 10:46:36.925717 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 10:46:36.925717 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 10:46:36.927122 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 10:46:36.927122 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 10:46:36.927122 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 10:46:36.927122 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 10:46:36.927122 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 10:46:36.927122 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 10:46:36.927122 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 10:46:36.927122 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0d153c5-90d0-4814-92ec-6f237601def9 could not be found. Aug 04 10:46:36.927122 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Aug 04 10:46:36.927122 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:46:36.927122 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Aug 04 10:46:36.927122 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:46:36.927122 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:46:36.927122 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:46:36.927122 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 10:46:36.927122 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 10:46:36.927122 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0d153c5-90d0-4814-92ec-6f237601def9 could not be found. Aug 04 10:46:36.927122 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Aug 04 10:46:36.928490 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-a4f4f681-14d2-40b3-b999-6944fbb3edda tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Returning 404 to user: Instance b0d153c5-90d0-4814-92ec-6f237601def9 could not be found. {{(pid=124457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 10:46:36.928490 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-a4f4f681-14d2-40b3-b999-6944fbb3edda tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] 10.222.0.121 "GET /compute/v2.1/servers/b0d153c5-90d0-4814-92ec-6f237601def9" status: 404 len: 111 microversion: 2.20 time: 0.033666 Aug 04 10:46:36.928490 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 535/1068] 10.222.0.121 () {60 vars in 1282 bytes} [Thu Aug 4 10:46:36 2022] GET /compute/v2.1/servers/b0d153c5-90d0-4814-92ec-6f237601def9 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 04 10:46:36.935127 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-5149b087-ca18-402f-b073-f0dfc6923027 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Calling method '.version_select at 0x7f6754ee5310>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:46:36.959265 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-5149b087-ca18-402f-b073-f0dfc6923027 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] 10.222.0.121 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-97523757" status: 204 len: 0 microversion: 2.20 time: 0.028370 Aug 04 10:46:36.959890 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 534/1069] 10.222.0.121 () {60 vars in 1261 bytes} [Thu Aug 4 10:46:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-97523757 => generated 0 bytes in 30 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 04 10:46:37.628272 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-6b0f1f77-f726-42db-8eab-a53ecea5e9ac tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Action: 'create', calling method: .version_select at 0x7f67558294c0>, body: {"keypair": {"name": "tempest-keypair-1602391143", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBESerrFTxqEx+G2Zl8RaF+EfhJq1YmTKpoaNvCd+iFl9Q5JWwTjLTIhSZCh1DmFkKsWJvpwAuKC6ep7MbSilLYF3iEDjq7OHfSK/E3IU0ccoLgCl4EeNmZT1G1XbWqXLvQ=="}} {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:46:37.644951 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.quota [None req-6b0f1f77-f726-42db-8eab-a53ecea5e9ac tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Getting quotas for project 18d95fd38a664ce1b69afbb11189020a. Resources: {'key_pairs'} {{(pid=124457) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 10:46:37.649209 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.quota [None req-6b0f1f77-f726-42db-8eab-a53ecea5e9ac tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Getting quotas for user f2c14f2350dd450b846db0c22c43688b and project 18d95fd38a664ce1b69afbb11189020a. Resources: {'key_pairs'} {{(pid=124457) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 10:46:37.674531 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-6b0f1f77-f726-42db-8eab-a53ecea5e9ac tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] 10.222.0.121 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.050547 Aug 04 10:46:37.675303 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 536/1070] 10.222.0.121 () {62 vars in 1205 bytes} [Thu Aug 4 10:46:37 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 52 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 04 10:46:39.349914 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-b58980d5-4521-457d-86f9-e8818e8439af tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-124408058", "imageRef": "46724bb5-955f-4f3f-bd6a-b561fdde55e3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0d806319-6112-4986-8f37-97e9e0b31209"}], "security_groups": [{"name": "tempest-securitygroup--1058386422"}], "key_name": "tempest-keypair-1602391143", "user_data": "}} {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:46:39.461471 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.network.neutron [None req-b58980d5-4521-457d-86f9-e8818e8439af tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] validate_networks() for [('0d806319-6112-4986-8f37-97e9e0b31209', None, None, None, None, None)] {{(pid=124456) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 10:46:39.871753 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.virt.hardware [None req-b58980d5-4521-457d-86f9-e8818e8439af tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Flavor limits 0:0:0 {{(pid=124456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 10:46:39.872230 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.virt.hardware [None req-b58980d5-4521-457d-86f9-e8818e8439af tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Image limits 0:0:0 {{(pid=124456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 10:46:39.872778 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.virt.hardware [None req-b58980d5-4521-457d-86f9-e8818e8439af tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Flavor pref 0:0:0 {{(pid=124456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 10:46:39.873197 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.virt.hardware [None req-b58980d5-4521-457d-86f9-e8818e8439af tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Image pref 0:0:0 {{(pid=124456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 10:46:39.873615 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.virt.hardware [None req-b58980d5-4521-457d-86f9-e8818e8439af tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 10:46:39.883772 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-b58980d5-4521-457d-86f9-e8818e8439af tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:46:39.884267 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-b58980d5-4521-457d-86f9-e8818e8439af tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:46:39.885084 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-b58980d5-4521-457d-86f9-e8818e8439af tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:46:39.885530 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-b58980d5-4521-457d-86f9-e8818e8439af tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:46:39.904665 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.quota [None req-b58980d5-4521-457d-86f9-e8818e8439af tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Getting quotas for project 18d95fd38a664ce1b69afbb11189020a. Resources: {'ram', 'instances', 'cores'} {{(pid=124456) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 10:46:39.909389 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.quota [None req-b58980d5-4521-457d-86f9-e8818e8439af tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Getting quotas for user f2c14f2350dd450b846db0c22c43688b and project 18d95fd38a664ce1b69afbb11189020a. Resources: {'ram', 'instances', 'cores'} {{(pid=124456) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 10:46:39.922404 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-b58980d5-4521-457d-86f9-e8818e8439af tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Going to run 1 instances... {{(pid=124456) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 10:46:39.924877 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-b58980d5-4521-457d-86f9-e8818e8439af tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] [instance: 825f082d-bf46-440f-9d5f-424241f04c38] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='46724bb5-955f-4f3f-bd6a-b561fdde55e3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124456) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 10:46:39.976950 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-b58980d5-4521-457d-86f9-e8818e8439af tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] 10.222.0.121 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.20 time: 0.631598 Aug 04 10:46:39.977621 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 535/1071] 10.222.0.121 () {62 vars in 1193 bytes} [Thu Aug 4 10:46:39 2022] POST /compute/v2.1/servers => generated 404 bytes in 633 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Aug 04 10:46:39.990656 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-17b36b5e-68f8-4688-9047-f657afafcf62 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:46:39.991344 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-17b36b5e-68f8-4688-9047-f657afafcf62 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] [instance: 825f082d-bf46-440f-9d5f-424241f04c38] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:46:40.055769 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-17b36b5e-68f8-4688-9047-f657afafcf62 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:46:40.063770 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-17b36b5e-68f8-4688-9047-f657afafcf62 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:46:40.065422 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-17b36b5e-68f8-4688-9047-f657afafcf62 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:46:40.066651 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-17b36b5e-68f8-4688-9047-f657afafcf62 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] 10.222.0.121 "GET /compute/v2.1/servers/825f082d-bf46-440f-9d5f-424241f04c38" status: 200 len: 1285 microversion: 2.20 time: 0.081338 Aug 04 10:46:40.067244 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 537/1072] 10.222.0.121 () {60 vars in 1282 bytes} [Thu Aug 4 10:46:39 2022] GET /compute/v2.1/servers/825f082d-bf46-440f-9d5f-424241f04c38 => generated 1285 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:46:41.090934 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-e58d3385-503b-458e-8606-1fef46cd3464 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:46:41.091730 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-e58d3385-503b-458e-8606-1fef46cd3464 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] [instance: 825f082d-bf46-440f-9d5f-424241f04c38] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:46:41.100199 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-e58d3385-503b-458e-8606-1fef46cd3464 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:46:41.100766 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-e58d3385-503b-458e-8606-1fef46cd3464 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:46:41.101614 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-e58d3385-503b-458e-8606-1fef46cd3464 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:46:41.102069 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-e58d3385-503b-458e-8606-1fef46cd3464 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:46:41.186723 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-e58d3385-503b-458e-8606-1fef46cd3464 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:46:41.199132 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-e58d3385-503b-458e-8606-1fef46cd3464 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:46:41.200782 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-e58d3385-503b-458e-8606-1fef46cd3464 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:46:41.201962 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-e58d3385-503b-458e-8606-1fef46cd3464 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] 10.222.0.121 "GET /compute/v2.1/servers/825f082d-bf46-440f-9d5f-424241f04c38" status: 200 len: 1355 microversion: 2.20 time: 0.116158 Aug 04 10:46:41.202805 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 536/1073] 10.222.0.121 () {60 vars in 1282 bytes} [Thu Aug 4 10:46:41 2022] GET /compute/v2.1/servers/825f082d-bf46-440f-9d5f-424241f04c38 => generated 1355 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:46:42.226685 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-51b7bbcb-30ea-4229-8aeb-840f26b21c35 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:46:42.227339 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-51b7bbcb-30ea-4229-8aeb-840f26b21c35 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] [instance: 825f082d-bf46-440f-9d5f-424241f04c38] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:46:42.234862 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-51b7bbcb-30ea-4229-8aeb-840f26b21c35 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:46:42.235323 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-51b7bbcb-30ea-4229-8aeb-840f26b21c35 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:46:42.236178 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-51b7bbcb-30ea-4229-8aeb-840f26b21c35 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:46:42.236629 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-51b7bbcb-30ea-4229-8aeb-840f26b21c35 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:46:42.465756 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-51b7bbcb-30ea-4229-8aeb-840f26b21c35 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:46:42.476739 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-51b7bbcb-30ea-4229-8aeb-840f26b21c35 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:46:42.478410 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-51b7bbcb-30ea-4229-8aeb-840f26b21c35 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:46:42.479682 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-51b7bbcb-30ea-4229-8aeb-840f26b21c35 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] 10.222.0.121 "GET /compute/v2.1/servers/825f082d-bf46-440f-9d5f-424241f04c38" status: 200 len: 1411 microversion: 2.20 time: 0.257304 Aug 04 10:46:42.492209 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 538/1074] 10.222.0.121 () {60 vars in 1282 bytes} [Thu Aug 4 10:46:42 2022] GET /compute/v2.1/servers/825f082d-bf46-440f-9d5f-424241f04c38 => generated 1411 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:46:42.706216 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [req-2fd3c3ed-09b6-4be9-b9c2-a7a8f42ebc17 req-13e35270-5e06-4971-9928-bb7f70bd84ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "825f082d-bf46-440f-9d5f-424241f04c38", "tag": "f83f40cc-fa5c-4346-aa16-153595a2f799"}]} {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:46:42.721213 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [req-2fd3c3ed-09b6-4be9-b9c2-a7a8f42ebc17 req-13e35270-5e06-4971-9928-bb7f70bd84ca service nova] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:46:42.721817 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [req-2fd3c3ed-09b6-4be9-b9c2-a7a8f42ebc17 req-13e35270-5e06-4971-9928-bb7f70bd84ca service nova] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:46:42.736964 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.compute.server_external_events [req-2fd3c3ed-09b6-4be9-b9c2-a7a8f42ebc17 req-13e35270-5e06-4971-9928-bb7f70bd84ca service nova] Creating event network-changed:f83f40cc-fa5c-4346-aa16-153595a2f799 for instance 825f082d-bf46-440f-9d5f-424241f04c38 on hv-cinder-85200 Aug 04 10:46:42.742793 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [req-2fd3c3ed-09b6-4be9-b9c2-a7a8f42ebc17 req-13e35270-5e06-4971-9928-bb7f70bd84ca service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040386 Aug 04 10:46:42.743417 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 537/1075] 10.222.0.121 () {64 vars in 1322 bytes} [Thu Aug 4 10:46:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:46:43.503776 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-5a75b24e-379d-4b59-9bb5-d45aa47aa7e9 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:46:43.504438 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-5a75b24e-379d-4b59-9bb5-d45aa47aa7e9 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] [instance: 825f082d-bf46-440f-9d5f-424241f04c38] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:46:43.511681 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-5a75b24e-379d-4b59-9bb5-d45aa47aa7e9 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:46:43.512151 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-5a75b24e-379d-4b59-9bb5-d45aa47aa7e9 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:46:43.512960 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-5a75b24e-379d-4b59-9bb5-d45aa47aa7e9 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:46:43.513404 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-5a75b24e-379d-4b59-9bb5-d45aa47aa7e9 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:46:43.657451 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-5a75b24e-379d-4b59-9bb5-d45aa47aa7e9 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:46:43.666224 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-5a75b24e-379d-4b59-9bb5-d45aa47aa7e9 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:46:43.667738 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-5a75b24e-379d-4b59-9bb5-d45aa47aa7e9 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:46:43.668917 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-5a75b24e-379d-4b59-9bb5-d45aa47aa7e9 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] 10.222.0.121 "GET /compute/v2.1/servers/825f082d-bf46-440f-9d5f-424241f04c38" status: 200 len: 1411 microversion: 2.20 time: 0.169473 Aug 04 10:46:43.669515 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 539/1076] 10.222.0.121 () {60 vars in 1282 bytes} [Thu Aug 4 10:46:43 2022] GET /compute/v2.1/servers/825f082d-bf46-440f-9d5f-424241f04c38 => generated 1411 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:46:44.695420 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-f3395ef7-e6df-4dec-af7b-bc014bf425be tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:46:44.696390 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-f3395ef7-e6df-4dec-af7b-bc014bf425be tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] [instance: 825f082d-bf46-440f-9d5f-424241f04c38] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:46:44.703894 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-f3395ef7-e6df-4dec-af7b-bc014bf425be tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:46:44.704390 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-f3395ef7-e6df-4dec-af7b-bc014bf425be tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:46:44.705199 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-f3395ef7-e6df-4dec-af7b-bc014bf425be tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:46:44.705650 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-f3395ef7-e6df-4dec-af7b-bc014bf425be tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:46:44.848153 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-f3395ef7-e6df-4dec-af7b-bc014bf425be tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:46:44.857230 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-f3395ef7-e6df-4dec-af7b-bc014bf425be tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:46:44.858737 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-f3395ef7-e6df-4dec-af7b-bc014bf425be tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:46:44.859891 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-f3395ef7-e6df-4dec-af7b-bc014bf425be tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] 10.222.0.121 "GET /compute/v2.1/servers/825f082d-bf46-440f-9d5f-424241f04c38" status: 200 len: 1411 microversion: 2.20 time: 0.169704 Aug 04 10:46:44.860509 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 538/1077] 10.222.0.121 () {60 vars in 1282 bytes} [Thu Aug 4 10:46:44 2022] GET /compute/v2.1/servers/825f082d-bf46-440f-9d5f-424241f04c38 => generated 1411 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 10:46:45.883524 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-07b1f71b-fff7-4d24-ab34-06e66239c6ee tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:46:45.884310 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-07b1f71b-fff7-4d24-ab34-06e66239c6ee tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] [instance: 825f082d-bf46-440f-9d5f-424241f04c38] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:46:45.892060 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-07b1f71b-fff7-4d24-ab34-06e66239c6ee tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:46:45.892526 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-07b1f71b-fff7-4d24-ab34-06e66239c6ee tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:46:45.893330 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-07b1f71b-fff7-4d24-ab34-06e66239c6ee tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:46:45.893777 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-07b1f71b-fff7-4d24-ab34-06e66239c6ee tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:46:46.040646 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-07b1f71b-fff7-4d24-ab34-06e66239c6ee tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:46:46.049444 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-07b1f71b-fff7-4d24-ab34-06e66239c6ee tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:46:46.050990 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-07b1f71b-fff7-4d24-ab34-06e66239c6ee tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:46:46.052175 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-07b1f71b-fff7-4d24-ab34-06e66239c6ee tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] 10.222.0.121 "GET /compute/v2.1/servers/825f082d-bf46-440f-9d5f-424241f04c38" status: 200 len: 1411 microversion: 2.20 time: 0.172935 Aug 04 10:46:46.052765 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 540/1078] 10.222.0.121 () {60 vars in 1282 bytes} [Thu Aug 4 10:46:45 2022] GET /compute/v2.1/servers/825f082d-bf46-440f-9d5f-424241f04c38 => generated 1411 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:46:47.075445 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-c1e11aea-246b-4987-86b3-66b17bb78a35 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:46:47.076109 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-c1e11aea-246b-4987-86b3-66b17bb78a35 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] [instance: 825f082d-bf46-440f-9d5f-424241f04c38] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:46:47.083302 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-c1e11aea-246b-4987-86b3-66b17bb78a35 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:46:47.083799 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-c1e11aea-246b-4987-86b3-66b17bb78a35 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:46:47.084633 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-c1e11aea-246b-4987-86b3-66b17bb78a35 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:46:47.085096 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-c1e11aea-246b-4987-86b3-66b17bb78a35 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:46:47.233630 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-c1e11aea-246b-4987-86b3-66b17bb78a35 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:46:47.244748 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-c1e11aea-246b-4987-86b3-66b17bb78a35 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:46:47.246416 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-c1e11aea-246b-4987-86b3-66b17bb78a35 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:46:47.247615 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-c1e11aea-246b-4987-86b3-66b17bb78a35 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] 10.222.0.121 "GET /compute/v2.1/servers/825f082d-bf46-440f-9d5f-424241f04c38" status: 200 len: 1411 microversion: 2.20 time: 0.176351 Aug 04 10:46:47.248227 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 539/1079] 10.222.0.121 () {60 vars in 1282 bytes} [Thu Aug 4 10:46:47 2022] GET /compute/v2.1/servers/825f082d-bf46-440f-9d5f-424241f04c38 => generated 1411 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:46:48.270666 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-d29a5a81-4409-4223-a823-5942a8838781 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:46:48.271402 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-d29a5a81-4409-4223-a823-5942a8838781 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] [instance: 825f082d-bf46-440f-9d5f-424241f04c38] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:46:48.278842 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-d29a5a81-4409-4223-a823-5942a8838781 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:46:48.279278 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-d29a5a81-4409-4223-a823-5942a8838781 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:46:48.280143 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-d29a5a81-4409-4223-a823-5942a8838781 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:46:48.280578 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-d29a5a81-4409-4223-a823-5942a8838781 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:46:48.422699 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-d29a5a81-4409-4223-a823-5942a8838781 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:46:48.431431 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-d29a5a81-4409-4223-a823-5942a8838781 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:46:48.433044 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-d29a5a81-4409-4223-a823-5942a8838781 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:46:48.434210 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-d29a5a81-4409-4223-a823-5942a8838781 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] 10.222.0.121 "GET /compute/v2.1/servers/825f082d-bf46-440f-9d5f-424241f04c38" status: 200 len: 1411 microversion: 2.20 time: 0.167755 Aug 04 10:46:48.434802 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 541/1080] 10.222.0.121 () {60 vars in 1282 bytes} [Thu Aug 4 10:46:48 2022] GET /compute/v2.1/servers/825f082d-bf46-440f-9d5f-424241f04c38 => generated 1411 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:46:48.916526 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [req-0b1fc40f-3303-4e31-a702-8fe4ba878775 req-17cabf6f-7745-4044-bf50-c937fad01081 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "825f082d-bf46-440f-9d5f-424241f04c38", "name": "network-vif-plugged", "status": "completed", "tag": "f83f40cc-fa5c-4346-aa16-153595a2f799"}]} {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:46:48.932087 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [req-0b1fc40f-3303-4e31-a702-8fe4ba878775 req-17cabf6f-7745-4044-bf50-c937fad01081 service nova] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:46:48.932896 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [req-0b1fc40f-3303-4e31-a702-8fe4ba878775 req-17cabf6f-7745-4044-bf50-c937fad01081 service nova] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:46:48.954212 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.compute.server_external_events [req-0b1fc40f-3303-4e31-a702-8fe4ba878775 req-17cabf6f-7745-4044-bf50-c937fad01081 service nova] Creating event network-vif-plugged:f83f40cc-fa5c-4346-aa16-153595a2f799 for instance 825f082d-bf46-440f-9d5f-424241f04c38 on hv-cinder-85200 Aug 04 10:46:48.962948 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [req-0b1fc40f-3303-4e31-a702-8fe4ba878775 req-17cabf6f-7745-4044-bf50-c937fad01081 service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050918 Aug 04 10:46:48.963593 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 540/1081] 10.222.0.121 () {64 vars in 1322 bytes} [Thu Aug 4 10:46:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:46:49.461072 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-1d23aa15-3d32-48ad-b379-a8808c2fca13 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:46:49.461707 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-1d23aa15-3d32-48ad-b379-a8808c2fca13 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] [instance: 825f082d-bf46-440f-9d5f-424241f04c38] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:46:49.469531 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-1d23aa15-3d32-48ad-b379-a8808c2fca13 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:46:49.469992 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-1d23aa15-3d32-48ad-b379-a8808c2fca13 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:46:49.470784 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-1d23aa15-3d32-48ad-b379-a8808c2fca13 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:46:49.471239 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-1d23aa15-3d32-48ad-b379-a8808c2fca13 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:46:49.614421 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-1d23aa15-3d32-48ad-b379-a8808c2fca13 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:46:49.623101 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-1d23aa15-3d32-48ad-b379-a8808c2fca13 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:46:49.624709 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-1d23aa15-3d32-48ad-b379-a8808c2fca13 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:46:49.625913 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-1d23aa15-3d32-48ad-b379-a8808c2fca13 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] 10.222.0.121 "GET /compute/v2.1/servers/825f082d-bf46-440f-9d5f-424241f04c38" status: 200 len: 1411 microversion: 2.20 time: 0.169258 Aug 04 10:46:49.626535 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 542/1082] 10.222.0.121 () {60 vars in 1282 bytes} [Thu Aug 4 10:46:49 2022] GET /compute/v2.1/servers/825f082d-bf46-440f-9d5f-424241f04c38 => generated 1411 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:46:50.647256 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG dbcounter [-] [124456] Writing DB stats nova_cell0:SELECT=2 {{(pid=124456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:46:50.647961 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG dbcounter [-] [124456] Writing DB stats nova_cell0:SELECT=6 {{(pid=124456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:46:50.652990 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-771a86b9-c91f-4373-9b5e-73c048f0db26 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:46:50.653716 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-771a86b9-c91f-4373-9b5e-73c048f0db26 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] [instance: 825f082d-bf46-440f-9d5f-424241f04c38] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:46:50.661461 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-771a86b9-c91f-4373-9b5e-73c048f0db26 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:46:50.661899 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-771a86b9-c91f-4373-9b5e-73c048f0db26 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:46:50.662709 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-771a86b9-c91f-4373-9b5e-73c048f0db26 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:46:50.663156 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-771a86b9-c91f-4373-9b5e-73c048f0db26 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:46:50.804684 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-771a86b9-c91f-4373-9b5e-73c048f0db26 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:46:50.813624 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-771a86b9-c91f-4373-9b5e-73c048f0db26 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:46:50.815151 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-771a86b9-c91f-4373-9b5e-73c048f0db26 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:46:50.816362 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-771a86b9-c91f-4373-9b5e-73c048f0db26 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] 10.222.0.121 "GET /compute/v2.1/servers/825f082d-bf46-440f-9d5f-424241f04c38" status: 200 len: 1411 microversion: 2.20 time: 0.170431 Aug 04 10:46:50.816945 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 541/1083] 10.222.0.121 () {60 vars in 1282 bytes} [Thu Aug 4 10:46:50 2022] GET /compute/v2.1/servers/825f082d-bf46-440f-9d5f-424241f04c38 => generated 1411 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:46:51.839893 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-8453bf7d-8c7f-4656-9d8b-87748e4b8bdd tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:46:51.840573 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-8453bf7d-8c7f-4656-9d8b-87748e4b8bdd tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] [instance: 825f082d-bf46-440f-9d5f-424241f04c38] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:46:51.842863 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG dbcounter [-] [124457] Writing DB stats nova_cell0:SELECT=6 {{(pid=124457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:46:51.848817 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-8453bf7d-8c7f-4656-9d8b-87748e4b8bdd tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:46:51.849276 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-8453bf7d-8c7f-4656-9d8b-87748e4b8bdd tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:46:51.850084 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-8453bf7d-8c7f-4656-9d8b-87748e4b8bdd tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:46:51.850525 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-8453bf7d-8c7f-4656-9d8b-87748e4b8bdd tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:46:51.998850 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-8453bf7d-8c7f-4656-9d8b-87748e4b8bdd tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:46:52.007653 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-8453bf7d-8c7f-4656-9d8b-87748e4b8bdd tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:46:52.009234 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-8453bf7d-8c7f-4656-9d8b-87748e4b8bdd tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:46:52.010455 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-8453bf7d-8c7f-4656-9d8b-87748e4b8bdd tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] 10.222.0.121 "GET /compute/v2.1/servers/825f082d-bf46-440f-9d5f-424241f04c38" status: 200 len: 1603 microversion: 2.20 time: 0.175166 Aug 04 10:46:52.011178 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 543/1084] 10.222.0.121 () {60 vars in 1282 bytes} [Thu Aug 4 10:46:51 2022] GET /compute/v2.1/servers/825f082d-bf46-440f-9d5f-424241f04c38 => generated 1603 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:46:52.035006 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-14ed80c8-c5d7-426f-9c71-f1d3aa095ed6 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:46:52.035664 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-14ed80c8-c5d7-426f-9c71-f1d3aa095ed6 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] [instance: 825f082d-bf46-440f-9d5f-424241f04c38] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:46:52.042848 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-14ed80c8-c5d7-426f-9c71-f1d3aa095ed6 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:46:52.043314 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-14ed80c8-c5d7-426f-9c71-f1d3aa095ed6 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:46:52.044168 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-14ed80c8-c5d7-426f-9c71-f1d3aa095ed6 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:46:52.044741 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-14ed80c8-c5d7-426f-9c71-f1d3aa095ed6 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:46:52.128304 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-14ed80c8-c5d7-426f-9c71-f1d3aa095ed6 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] 10.222.0.121 "GET /compute/v2.1/servers/825f082d-bf46-440f-9d5f-424241f04c38/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.098980 Aug 04 10:46:52.128920 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 542/1085] 10.222.0.121 () {60 vars in 1321 bytes} [Thu Aug 4 10:46:52 2022] GET /compute/v2.1/servers/825f082d-bf46-440f-9d5f-424241f04c38/os-interface => generated 284 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 10:46:53.109323 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [req-aeb9bc35-ccf9-44b0-9baa-07922d572c91 req-55b44d87-b2dd-42cb-8802-4b4b5f3104f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "825f082d-bf46-440f-9d5f-424241f04c38", "tag": "f83f40cc-fa5c-4346-aa16-153595a2f799"}]} {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:46:53.120687 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [req-aeb9bc35-ccf9-44b0-9baa-07922d572c91 req-55b44d87-b2dd-42cb-8802-4b4b5f3104f2 service nova] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:46:53.121448 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [req-aeb9bc35-ccf9-44b0-9baa-07922d572c91 req-55b44d87-b2dd-42cb-8802-4b4b5f3104f2 service nova] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:46:53.133535 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.compute.server_external_events [req-aeb9bc35-ccf9-44b0-9baa-07922d572c91 req-55b44d87-b2dd-42cb-8802-4b4b5f3104f2 service nova] Creating event network-changed:f83f40cc-fa5c-4346-aa16-153595a2f799 for instance 825f082d-bf46-440f-9d5f-424241f04c38 on hv-cinder-85200 Aug 04 10:46:53.139131 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [req-aeb9bc35-ccf9-44b0-9baa-07922d572c91 req-55b44d87-b2dd-42cb-8802-4b4b5f3104f2 service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033725 Aug 04 10:46:53.139744 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 544/1086] 10.222.0.121 () {64 vars in 1322 bytes} [Thu Aug 4 10:46:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:48:04.681545 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 10:48:04.682389 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: Thu Aug 4 10:48:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 10:48:08.166822 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG dbcounter [-] [124456] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=124456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:48:08.167605 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG dbcounter [-] [124456] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:48:08.324468 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-da1c874d-1b8a-443f-aa7f-e666d49b9eea tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:48:08.325018 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-da1c874d-1b8a-443f-aa7f-e666d49b9eea tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] [instance: 825f082d-bf46-440f-9d5f-424241f04c38] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:48:08.333061 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-da1c874d-1b8a-443f-aa7f-e666d49b9eea tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:48:08.333061 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-da1c874d-1b8a-443f-aa7f-e666d49b9eea tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:48:08.333612 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-da1c874d-1b8a-443f-aa7f-e666d49b9eea tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:48:08.334088 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-da1c874d-1b8a-443f-aa7f-e666d49b9eea tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:48:08.359649 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-da1c874d-1b8a-443f-aa7f-e666d49b9eea tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] 10.222.0.121 "GET /compute/v2.1/servers/825f082d-bf46-440f-9d5f-424241f04c38/ips" status: 200 len: 151 microversion: 2.20 time: 0.195281 Aug 04 10:48:08.360263 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 543/1087] 10.222.0.121 () {60 vars in 1294 bytes} [Thu Aug 4 10:48:08 2022] GET /compute/v2.1/servers/825f082d-bf46-440f-9d5f-424241f04c38/ips => generated 151 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 10:48:10.237104 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG dbcounter [-] [124457] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=1 {{(pid=124457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:48:10.237908 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG dbcounter [-] [124457] Writing DB stats nova_cell1:SELECT=67,nova_cell1:INSERT=1 {{(pid=124457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:48:10.243095 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-18419fae-6700-491d-a385-3f0cfb350f24 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:48:10.243752 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-18419fae-6700-491d-a385-3f0cfb350f24 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] [instance: 825f082d-bf46-440f-9d5f-424241f04c38] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:48:10.252485 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-18419fae-6700-491d-a385-3f0cfb350f24 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:48:10.252947 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-18419fae-6700-491d-a385-3f0cfb350f24 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:48:10.253755 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-18419fae-6700-491d-a385-3f0cfb350f24 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:48:10.254201 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-18419fae-6700-491d-a385-3f0cfb350f24 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:48:10.279304 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.objects.instance [None req-18419fae-6700-491d-a385-3f0cfb350f24 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lazy-loading 'flavor' on Instance uuid 825f082d-bf46-440f-9d5f-424241f04c38 {{(pid=124457) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 10:48:10.574013 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-18419fae-6700-491d-a385-3f0cfb350f24 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] 10.222.0.121 "POST /compute/v2.1/servers/825f082d-bf46-440f-9d5f-424241f04c38/action" status: 202 len: 0 microversion: 2.20 time: 0.338981 Aug 04 10:48:10.574634 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 545/1088] 10.222.0.121 () {62 vars in 1324 bytes} [Thu Aug 4 10:48:10 2022] POST /compute/v2.1/servers/825f082d-bf46-440f-9d5f-424241f04c38/action => generated 0 bytes in 341 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 04 10:48:10.588837 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-76930d33-eb4b-47f0-adac-929b38f7bde8 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:48:10.589478 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-76930d33-eb4b-47f0-adac-929b38f7bde8 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] [instance: 825f082d-bf46-440f-9d5f-424241f04c38] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:48:10.596577 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-76930d33-eb4b-47f0-adac-929b38f7bde8 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:48:10.597041 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-76930d33-eb4b-47f0-adac-929b38f7bde8 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:48:10.597881 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-76930d33-eb4b-47f0-adac-929b38f7bde8 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:48:10.598421 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-76930d33-eb4b-47f0-adac-929b38f7bde8 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:48:10.898227 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-76930d33-eb4b-47f0-adac-929b38f7bde8 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:48:10.914479 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-76930d33-eb4b-47f0-adac-929b38f7bde8 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:48:10.916622 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-76930d33-eb4b-47f0-adac-929b38f7bde8 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:48:10.917824 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-76930d33-eb4b-47f0-adac-929b38f7bde8 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] 10.222.0.121 "GET /compute/v2.1/servers/825f082d-bf46-440f-9d5f-424241f04c38" status: 200 len: 1727 microversion: 2.20 time: 0.338320 Aug 04 10:48:10.918404 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 544/1089] 10.222.0.121 () {60 vars in 1282 bytes} [Thu Aug 4 10:48:10 2022] GET /compute/v2.1/servers/825f082d-bf46-440f-9d5f-424241f04c38 => generated 1727 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:48:11.944376 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-fd4f278d-4fd0-4a60-9999-8c5359737ae9 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:48:11.945173 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-fd4f278d-4fd0-4a60-9999-8c5359737ae9 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] [instance: 825f082d-bf46-440f-9d5f-424241f04c38] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:48:11.954694 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-fd4f278d-4fd0-4a60-9999-8c5359737ae9 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:48:11.955158 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-fd4f278d-4fd0-4a60-9999-8c5359737ae9 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:48:11.955974 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-fd4f278d-4fd0-4a60-9999-8c5359737ae9 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:48:11.956439 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-fd4f278d-4fd0-4a60-9999-8c5359737ae9 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:48:12.106444 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-fd4f278d-4fd0-4a60-9999-8c5359737ae9 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:48:12.115410 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-fd4f278d-4fd0-4a60-9999-8c5359737ae9 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:48:12.116973 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-fd4f278d-4fd0-4a60-9999-8c5359737ae9 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:48:12.118283 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-fd4f278d-4fd0-4a60-9999-8c5359737ae9 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] 10.222.0.121 "GET /compute/v2.1/servers/825f082d-bf46-440f-9d5f-424241f04c38" status: 200 len: 1727 microversion: 2.20 time: 0.179480 Aug 04 10:48:12.118860 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 546/1090] 10.222.0.121 () {60 vars in 1282 bytes} [Thu Aug 4 10:48:11 2022] GET /compute/v2.1/servers/825f082d-bf46-440f-9d5f-424241f04c38 => generated 1727 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:48:13.142321 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-2c1578b8-9369-46c3-8ca0-54dccd46dad6 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:48:13.143073 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-2c1578b8-9369-46c3-8ca0-54dccd46dad6 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] [instance: 825f082d-bf46-440f-9d5f-424241f04c38] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:48:13.151336 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-2c1578b8-9369-46c3-8ca0-54dccd46dad6 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:48:13.151809 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-2c1578b8-9369-46c3-8ca0-54dccd46dad6 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:48:13.152670 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-2c1578b8-9369-46c3-8ca0-54dccd46dad6 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:48:13.153129 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-2c1578b8-9369-46c3-8ca0-54dccd46dad6 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:48:13.300841 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-2c1578b8-9369-46c3-8ca0-54dccd46dad6 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:48:13.309683 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-2c1578b8-9369-46c3-8ca0-54dccd46dad6 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:48:13.311209 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-2c1578b8-9369-46c3-8ca0-54dccd46dad6 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:48:13.312504 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-2c1578b8-9369-46c3-8ca0-54dccd46dad6 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] 10.222.0.121 "GET /compute/v2.1/servers/825f082d-bf46-440f-9d5f-424241f04c38" status: 200 len: 1727 microversion: 2.20 time: 0.174600 Aug 04 10:48:13.313143 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 545/1091] 10.222.0.121 () {60 vars in 1282 bytes} [Thu Aug 4 10:48:13 2022] GET /compute/v2.1/servers/825f082d-bf46-440f-9d5f-424241f04c38 => generated 1727 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 10:48:14.336811 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-10ce443d-90cc-44ce-94e8-924ff34533fb tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:48:14.337530 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-10ce443d-90cc-44ce-94e8-924ff34533fb tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] [instance: 825f082d-bf46-440f-9d5f-424241f04c38] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:48:14.348042 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-10ce443d-90cc-44ce-94e8-924ff34533fb tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:48:14.348780 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-10ce443d-90cc-44ce-94e8-924ff34533fb tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:48:14.349933 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-10ce443d-90cc-44ce-94e8-924ff34533fb tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:48:14.350635 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-10ce443d-90cc-44ce-94e8-924ff34533fb tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:48:14.508805 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-10ce443d-90cc-44ce-94e8-924ff34533fb tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:48:14.517179 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-10ce443d-90cc-44ce-94e8-924ff34533fb tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:48:14.518684 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-10ce443d-90cc-44ce-94e8-924ff34533fb tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:48:14.519884 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-10ce443d-90cc-44ce-94e8-924ff34533fb tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] 10.222.0.121 "GET /compute/v2.1/servers/825f082d-bf46-440f-9d5f-424241f04c38" status: 200 len: 1727 microversion: 2.20 time: 0.187293 Aug 04 10:48:14.520494 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 547/1092] 10.222.0.121 () {60 vars in 1282 bytes} [Thu Aug 4 10:48:14 2022] GET /compute/v2.1/servers/825f082d-bf46-440f-9d5f-424241f04c38 => generated 1727 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:48:15.546032 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-4d13c1dc-4610-4702-91dd-86ba47b30f6e tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:48:15.546752 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-4d13c1dc-4610-4702-91dd-86ba47b30f6e tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] [instance: 825f082d-bf46-440f-9d5f-424241f04c38] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:48:15.554673 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-4d13c1dc-4610-4702-91dd-86ba47b30f6e tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:48:15.555132 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-4d13c1dc-4610-4702-91dd-86ba47b30f6e tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:48:15.556045 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-4d13c1dc-4610-4702-91dd-86ba47b30f6e tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:48:15.556508 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-4d13c1dc-4610-4702-91dd-86ba47b30f6e tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:48:15.706366 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-4d13c1dc-4610-4702-91dd-86ba47b30f6e tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:48:15.719678 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-4d13c1dc-4610-4702-91dd-86ba47b30f6e tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:48:15.722392 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-4d13c1dc-4610-4702-91dd-86ba47b30f6e tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:48:15.724218 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-4d13c1dc-4610-4702-91dd-86ba47b30f6e tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] 10.222.0.121 "GET /compute/v2.1/servers/825f082d-bf46-440f-9d5f-424241f04c38" status: 200 len: 1727 microversion: 2.20 time: 0.182913 Aug 04 10:48:15.725008 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 546/1093] 10.222.0.121 () {60 vars in 1282 bytes} [Thu Aug 4 10:48:15 2022] GET /compute/v2.1/servers/825f082d-bf46-440f-9d5f-424241f04c38 => generated 1727 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:48:16.750307 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-af0340ac-bf4d-4ad3-be55-a2914f9eedcf tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:48:16.751012 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-af0340ac-bf4d-4ad3-be55-a2914f9eedcf tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] [instance: 825f082d-bf46-440f-9d5f-424241f04c38] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:48:16.758154 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-af0340ac-bf4d-4ad3-be55-a2914f9eedcf tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:48:16.758620 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-af0340ac-bf4d-4ad3-be55-a2914f9eedcf tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:48:16.759421 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-af0340ac-bf4d-4ad3-be55-a2914f9eedcf tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:48:16.759880 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-af0340ac-bf4d-4ad3-be55-a2914f9eedcf tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:48:16.905550 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-af0340ac-bf4d-4ad3-be55-a2914f9eedcf tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:48:16.915712 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-af0340ac-bf4d-4ad3-be55-a2914f9eedcf tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:48:16.917577 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-af0340ac-bf4d-4ad3-be55-a2914f9eedcf tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:48:16.918460 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-af0340ac-bf4d-4ad3-be55-a2914f9eedcf tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] 10.222.0.121 "GET /compute/v2.1/servers/825f082d-bf46-440f-9d5f-424241f04c38" status: 200 len: 1727 microversion: 2.20 time: 0.172383 Aug 04 10:48:16.919008 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 548/1094] 10.222.0.121 () {60 vars in 1282 bytes} [Thu Aug 4 10:48:16 2022] GET /compute/v2.1/servers/825f082d-bf46-440f-9d5f-424241f04c38 => generated 1727 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:48:17.942186 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-bf814a99-f9e2-40b9-9a32-c4748d45da9b tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:48:17.942867 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-bf814a99-f9e2-40b9-9a32-c4748d45da9b tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] [instance: 825f082d-bf46-440f-9d5f-424241f04c38] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:48:17.950955 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-bf814a99-f9e2-40b9-9a32-c4748d45da9b tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:48:17.951431 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-bf814a99-f9e2-40b9-9a32-c4748d45da9b tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:48:17.952321 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-bf814a99-f9e2-40b9-9a32-c4748d45da9b tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:48:17.952807 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-bf814a99-f9e2-40b9-9a32-c4748d45da9b tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:48:18.099876 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-bf814a99-f9e2-40b9-9a32-c4748d45da9b tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:48:18.108687 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-bf814a99-f9e2-40b9-9a32-c4748d45da9b tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:48:18.110211 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-bf814a99-f9e2-40b9-9a32-c4748d45da9b tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:48:18.111422 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-bf814a99-f9e2-40b9-9a32-c4748d45da9b tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] 10.222.0.121 "GET /compute/v2.1/servers/825f082d-bf46-440f-9d5f-424241f04c38" status: 200 len: 1727 microversion: 2.20 time: 0.174047 Aug 04 10:48:18.112035 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 547/1095] 10.222.0.121 () {60 vars in 1282 bytes} [Thu Aug 4 10:48:17 2022] GET /compute/v2.1/servers/825f082d-bf46-440f-9d5f-424241f04c38 => generated 1727 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:48:19.138140 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-cc0c07a9-3117-441f-9cb8-374ab23e6c34 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:48:19.138954 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-cc0c07a9-3117-441f-9cb8-374ab23e6c34 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] [instance: 825f082d-bf46-440f-9d5f-424241f04c38] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:48:19.146215 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-cc0c07a9-3117-441f-9cb8-374ab23e6c34 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:48:19.146746 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-cc0c07a9-3117-441f-9cb8-374ab23e6c34 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:48:19.147598 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-cc0c07a9-3117-441f-9cb8-374ab23e6c34 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:48:19.148151 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-cc0c07a9-3117-441f-9cb8-374ab23e6c34 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:48:19.308267 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-cc0c07a9-3117-441f-9cb8-374ab23e6c34 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:48:19.320449 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-cc0c07a9-3117-441f-9cb8-374ab23e6c34 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:48:19.322321 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-cc0c07a9-3117-441f-9cb8-374ab23e6c34 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:48:19.323916 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-cc0c07a9-3117-441f-9cb8-374ab23e6c34 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] 10.222.0.121 "GET /compute/v2.1/servers/825f082d-bf46-440f-9d5f-424241f04c38" status: 200 len: 1727 microversion: 2.20 time: 0.192026 Aug 04 10:48:19.324631 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 549/1096] 10.222.0.121 () {60 vars in 1282 bytes} [Thu Aug 4 10:48:19 2022] GET /compute/v2.1/servers/825f082d-bf46-440f-9d5f-424241f04c38 => generated 1727 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:48:20.350892 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-ada2432d-fba0-47e9-8c5a-cebc555dd54e tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:48:20.351565 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-ada2432d-fba0-47e9-8c5a-cebc555dd54e tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] [instance: 825f082d-bf46-440f-9d5f-424241f04c38] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:48:20.358903 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-ada2432d-fba0-47e9-8c5a-cebc555dd54e tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:48:20.359407 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-ada2432d-fba0-47e9-8c5a-cebc555dd54e tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:48:20.360231 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-ada2432d-fba0-47e9-8c5a-cebc555dd54e tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:48:20.360676 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-ada2432d-fba0-47e9-8c5a-cebc555dd54e tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:48:20.513002 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-ada2432d-fba0-47e9-8c5a-cebc555dd54e tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:48:20.522101 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-ada2432d-fba0-47e9-8c5a-cebc555dd54e tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:48:20.523672 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-ada2432d-fba0-47e9-8c5a-cebc555dd54e tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:48:20.524974 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-ada2432d-fba0-47e9-8c5a-cebc555dd54e tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] 10.222.0.121 "GET /compute/v2.1/servers/825f082d-bf46-440f-9d5f-424241f04c38" status: 200 len: 1727 microversion: 2.20 time: 0.178254 Aug 04 10:48:20.525619 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 548/1097] 10.222.0.121 () {60 vars in 1282 bytes} [Thu Aug 4 10:48:20 2022] GET /compute/v2.1/servers/825f082d-bf46-440f-9d5f-424241f04c38 => generated 1727 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:48:21.556400 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-3f10ac0e-56bd-4a02-b383-aa059de8c446 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:48:21.557327 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-3f10ac0e-56bd-4a02-b383-aa059de8c446 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] [instance: 825f082d-bf46-440f-9d5f-424241f04c38] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:48:21.565120 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-3f10ac0e-56bd-4a02-b383-aa059de8c446 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:48:21.565627 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-3f10ac0e-56bd-4a02-b383-aa059de8c446 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:48:21.566637 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-3f10ac0e-56bd-4a02-b383-aa059de8c446 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:48:21.567193 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-3f10ac0e-56bd-4a02-b383-aa059de8c446 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:48:21.714671 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-3f10ac0e-56bd-4a02-b383-aa059de8c446 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:48:21.723630 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-3f10ac0e-56bd-4a02-b383-aa059de8c446 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:48:21.725326 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-3f10ac0e-56bd-4a02-b383-aa059de8c446 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:48:21.726562 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-3f10ac0e-56bd-4a02-b383-aa059de8c446 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] 10.222.0.121 "GET /compute/v2.1/servers/825f082d-bf46-440f-9d5f-424241f04c38" status: 200 len: 1727 microversion: 2.20 time: 0.175157 Aug 04 10:48:21.727139 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 550/1098] 10.222.0.121 () {60 vars in 1282 bytes} [Thu Aug 4 10:48:21 2022] GET /compute/v2.1/servers/825f082d-bf46-440f-9d5f-424241f04c38 => generated 1727 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:48:22.751109 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-408ec0df-2b90-4a4e-86b1-80b7e54805de tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:48:22.751868 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-408ec0df-2b90-4a4e-86b1-80b7e54805de tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] [instance: 825f082d-bf46-440f-9d5f-424241f04c38] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:48:22.760710 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-408ec0df-2b90-4a4e-86b1-80b7e54805de tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:48:22.761276 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-408ec0df-2b90-4a4e-86b1-80b7e54805de tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:48:22.762158 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-408ec0df-2b90-4a4e-86b1-80b7e54805de tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:48:22.762715 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-408ec0df-2b90-4a4e-86b1-80b7e54805de tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:48:22.919861 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-408ec0df-2b90-4a4e-86b1-80b7e54805de tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:48:22.929300 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-408ec0df-2b90-4a4e-86b1-80b7e54805de tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:48:22.931181 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-408ec0df-2b90-4a4e-86b1-80b7e54805de tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:48:22.932527 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-408ec0df-2b90-4a4e-86b1-80b7e54805de tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] 10.222.0.121 "GET /compute/v2.1/servers/825f082d-bf46-440f-9d5f-424241f04c38" status: 200 len: 1748 microversion: 2.20 time: 0.186567 Aug 04 10:48:22.934757 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 549/1099] 10.222.0.121 () {60 vars in 1282 bytes} [Thu Aug 4 10:48:22 2022] GET /compute/v2.1/servers/825f082d-bf46-440f-9d5f-424241f04c38 => generated 1748 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:48:23.960653 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-dd70f520-ff52-4036-b52f-5bd01eedf5d1 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:48:23.961444 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-dd70f520-ff52-4036-b52f-5bd01eedf5d1 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] [instance: 825f082d-bf46-440f-9d5f-424241f04c38] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:48:23.970166 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-dd70f520-ff52-4036-b52f-5bd01eedf5d1 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:48:23.970719 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-dd70f520-ff52-4036-b52f-5bd01eedf5d1 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:48:23.972125 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-dd70f520-ff52-4036-b52f-5bd01eedf5d1 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:48:23.972614 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-dd70f520-ff52-4036-b52f-5bd01eedf5d1 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:48:24.134333 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-dd70f520-ff52-4036-b52f-5bd01eedf5d1 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:48:24.145591 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-dd70f520-ff52-4036-b52f-5bd01eedf5d1 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:48:24.147130 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-dd70f520-ff52-4036-b52f-5bd01eedf5d1 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:48:24.148381 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-dd70f520-ff52-4036-b52f-5bd01eedf5d1 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] 10.222.0.121 "GET /compute/v2.1/servers/825f082d-bf46-440f-9d5f-424241f04c38" status: 200 len: 1748 microversion: 2.20 time: 0.193670 Aug 04 10:48:24.148973 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 551/1100] 10.222.0.121 () {60 vars in 1282 bytes} [Thu Aug 4 10:48:23 2022] GET /compute/v2.1/servers/825f082d-bf46-440f-9d5f-424241f04c38 => generated 1748 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:48:25.172568 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-a30771d5-0c9f-473f-9488-48ab05a4830c tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:48:25.173172 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-a30771d5-0c9f-473f-9488-48ab05a4830c tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] [instance: 825f082d-bf46-440f-9d5f-424241f04c38] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:48:25.182104 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-a30771d5-0c9f-473f-9488-48ab05a4830c tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:48:25.182703 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-a30771d5-0c9f-473f-9488-48ab05a4830c tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:48:25.183642 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-a30771d5-0c9f-473f-9488-48ab05a4830c tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:48:25.184357 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-a30771d5-0c9f-473f-9488-48ab05a4830c tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:48:25.205823 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [req-2e0cbcd8-8cb9-46bf-aca1-b164d266c300 req-65459174-0e6f-4604-91e4-a13915a5b585 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "825f082d-bf46-440f-9d5f-424241f04c38", "name": "network-vif-plugged", "status": "completed", "tag": "f83f40cc-fa5c-4346-aa16-153595a2f799"}]} {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:48:25.223371 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [req-2e0cbcd8-8cb9-46bf-aca1-b164d266c300 req-65459174-0e6f-4604-91e4-a13915a5b585 service nova] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:48:25.224231 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [req-2e0cbcd8-8cb9-46bf-aca1-b164d266c300 req-65459174-0e6f-4604-91e4-a13915a5b585 service nova] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:48:25.240641 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.compute.server_external_events [req-2e0cbcd8-8cb9-46bf-aca1-b164d266c300 req-65459174-0e6f-4604-91e4-a13915a5b585 service nova] Creating event network-vif-plugged:f83f40cc-fa5c-4346-aa16-153595a2f799 for instance 825f082d-bf46-440f-9d5f-424241f04c38 on hv-cinder-85200 Aug 04 10:48:25.246951 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [req-2e0cbcd8-8cb9-46bf-aca1-b164d266c300 req-65459174-0e6f-4604-91e4-a13915a5b585 service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044925 Aug 04 10:48:25.247599 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 552/1101] 10.222.0.121 () {64 vars in 1322 bytes} [Thu Aug 4 10:48:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:48:25.343936 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-a30771d5-0c9f-473f-9488-48ab05a4830c tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:48:25.357225 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-a30771d5-0c9f-473f-9488-48ab05a4830c tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:48:25.359104 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-a30771d5-0c9f-473f-9488-48ab05a4830c tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:48:25.360592 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-a30771d5-0c9f-473f-9488-48ab05a4830c tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] 10.222.0.121 "GET /compute/v2.1/servers/825f082d-bf46-440f-9d5f-424241f04c38" status: 200 len: 1748 microversion: 2.20 time: 0.192985 Aug 04 10:48:25.361220 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 550/1102] 10.222.0.121 () {60 vars in 1282 bytes} [Thu Aug 4 10:48:25 2022] GET /compute/v2.1/servers/825f082d-bf46-440f-9d5f-424241f04c38 => generated 1748 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:48:26.387360 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-1643463c-bacf-4d23-a5c4-13d42748f272 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:48:26.388107 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-1643463c-bacf-4d23-a5c4-13d42748f272 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] [instance: 825f082d-bf46-440f-9d5f-424241f04c38] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:48:26.395574 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-1643463c-bacf-4d23-a5c4-13d42748f272 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:48:26.396193 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-1643463c-bacf-4d23-a5c4-13d42748f272 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:48:26.396866 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-1643463c-bacf-4d23-a5c4-13d42748f272 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:48:26.397374 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-1643463c-bacf-4d23-a5c4-13d42748f272 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:48:26.545133 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-1643463c-bacf-4d23-a5c4-13d42748f272 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:48:26.554767 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-1643463c-bacf-4d23-a5c4-13d42748f272 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:48:26.556353 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-1643463c-bacf-4d23-a5c4-13d42748f272 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:48:26.557617 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-1643463c-bacf-4d23-a5c4-13d42748f272 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] 10.222.0.121 "GET /compute/v2.1/servers/825f082d-bf46-440f-9d5f-424241f04c38" status: 200 len: 1748 microversion: 2.20 time: 0.175386 Aug 04 10:48:26.559081 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 553/1103] 10.222.0.121 () {60 vars in 1282 bytes} [Thu Aug 4 10:48:26 2022] GET /compute/v2.1/servers/825f082d-bf46-440f-9d5f-424241f04c38 => generated 1748 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:48:27.592667 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-8fd4aa01-ee3f-4318-9ef9-ba1cf3c5c908 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:48:27.593306 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-8fd4aa01-ee3f-4318-9ef9-ba1cf3c5c908 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] [instance: 825f082d-bf46-440f-9d5f-424241f04c38] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:48:27.600941 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-8fd4aa01-ee3f-4318-9ef9-ba1cf3c5c908 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:48:27.601402 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-8fd4aa01-ee3f-4318-9ef9-ba1cf3c5c908 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:48:27.602198 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-8fd4aa01-ee3f-4318-9ef9-ba1cf3c5c908 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:48:27.602644 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-8fd4aa01-ee3f-4318-9ef9-ba1cf3c5c908 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:48:27.748949 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-8fd4aa01-ee3f-4318-9ef9-ba1cf3c5c908 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:48:27.757882 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-8fd4aa01-ee3f-4318-9ef9-ba1cf3c5c908 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:48:27.759417 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-8fd4aa01-ee3f-4318-9ef9-ba1cf3c5c908 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:48:27.760678 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-8fd4aa01-ee3f-4318-9ef9-ba1cf3c5c908 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] 10.222.0.121 "GET /compute/v2.1/servers/825f082d-bf46-440f-9d5f-424241f04c38" status: 200 len: 1748 microversion: 2.20 time: 0.172769 Aug 04 10:48:27.761271 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 551/1104] 10.222.0.121 () {60 vars in 1282 bytes} [Thu Aug 4 10:48:27 2022] GET /compute/v2.1/servers/825f082d-bf46-440f-9d5f-424241f04c38 => generated 1748 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:48:28.787258 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-1a00c34d-1a18-4e2f-ae49-96288cdee188 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:48:28.787892 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-1a00c34d-1a18-4e2f-ae49-96288cdee188 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] [instance: 825f082d-bf46-440f-9d5f-424241f04c38] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:48:28.795202 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-1a00c34d-1a18-4e2f-ae49-96288cdee188 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:48:28.795674 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-1a00c34d-1a18-4e2f-ae49-96288cdee188 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:48:28.796805 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-1a00c34d-1a18-4e2f-ae49-96288cdee188 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:48:28.797074 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-1a00c34d-1a18-4e2f-ae49-96288cdee188 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:48:28.964278 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-1a00c34d-1a18-4e2f-ae49-96288cdee188 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:48:28.977406 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-1a00c34d-1a18-4e2f-ae49-96288cdee188 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:48:28.979333 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-1a00c34d-1a18-4e2f-ae49-96288cdee188 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:48:28.981227 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-1a00c34d-1a18-4e2f-ae49-96288cdee188 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] 10.222.0.121 "GET /compute/v2.1/servers/825f082d-bf46-440f-9d5f-424241f04c38" status: 200 len: 1743 microversion: 2.20 time: 0.199662 Aug 04 10:48:28.981935 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 554/1105] 10.222.0.121 () {60 vars in 1282 bytes} [Thu Aug 4 10:48:28 2022] GET /compute/v2.1/servers/825f082d-bf46-440f-9d5f-424241f04c38 => generated 1743 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 10:48:30.007020 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-9d89b4e1-1679-44b0-bb49-ad466e490fdc tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:48:30.007678 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-9d89b4e1-1679-44b0-bb49-ad466e490fdc tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] [instance: 825f082d-bf46-440f-9d5f-424241f04c38] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:48:30.015551 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-9d89b4e1-1679-44b0-bb49-ad466e490fdc tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:48:30.016824 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-9d89b4e1-1679-44b0-bb49-ad466e490fdc tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:48:30.018127 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-9d89b4e1-1679-44b0-bb49-ad466e490fdc tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:48:30.018822 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-9d89b4e1-1679-44b0-bb49-ad466e490fdc tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:48:30.200568 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-9d89b4e1-1679-44b0-bb49-ad466e490fdc tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:48:30.211844 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-9d89b4e1-1679-44b0-bb49-ad466e490fdc tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:48:30.213509 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-9d89b4e1-1679-44b0-bb49-ad466e490fdc tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:48:30.214867 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-9d89b4e1-1679-44b0-bb49-ad466e490fdc tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] 10.222.0.121 "GET /compute/v2.1/servers/825f082d-bf46-440f-9d5f-424241f04c38" status: 200 len: 1743 microversion: 2.20 time: 0.212595 Aug 04 10:48:30.216155 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 552/1106] 10.222.0.121 () {60 vars in 1282 bytes} [Thu Aug 4 10:48:30 2022] GET /compute/v2.1/servers/825f082d-bf46-440f-9d5f-424241f04c38 => generated 1743 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:48:31.240942 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-47ef7c67-b7c6-43c3-91bd-cdba8a7a814c tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:48:31.242918 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-47ef7c67-b7c6-43c3-91bd-cdba8a7a814c tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] [instance: 825f082d-bf46-440f-9d5f-424241f04c38] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:48:31.252213 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-47ef7c67-b7c6-43c3-91bd-cdba8a7a814c tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:48:31.253037 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-47ef7c67-b7c6-43c3-91bd-cdba8a7a814c tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:48:31.254033 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-47ef7c67-b7c6-43c3-91bd-cdba8a7a814c tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:48:31.254476 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-47ef7c67-b7c6-43c3-91bd-cdba8a7a814c tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:48:31.428145 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-47ef7c67-b7c6-43c3-91bd-cdba8a7a814c tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:48:31.441040 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-47ef7c67-b7c6-43c3-91bd-cdba8a7a814c tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:48:31.443330 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-47ef7c67-b7c6-43c3-91bd-cdba8a7a814c tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:48:31.445232 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-47ef7c67-b7c6-43c3-91bd-cdba8a7a814c tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] 10.222.0.121 "GET /compute/v2.1/servers/825f082d-bf46-440f-9d5f-424241f04c38" status: 200 len: 1743 microversion: 2.20 time: 0.209986 Aug 04 10:48:31.446350 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 555/1107] 10.222.0.121 () {60 vars in 1282 bytes} [Thu Aug 4 10:48:31 2022] GET /compute/v2.1/servers/825f082d-bf46-440f-9d5f-424241f04c38 => generated 1743 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:48:32.475777 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-5e0aacdd-171d-48b8-adde-bf740ad78086 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:48:32.476549 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-5e0aacdd-171d-48b8-adde-bf740ad78086 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] [instance: 825f082d-bf46-440f-9d5f-424241f04c38] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:48:32.487057 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-5e0aacdd-171d-48b8-adde-bf740ad78086 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:48:32.487846 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-5e0aacdd-171d-48b8-adde-bf740ad78086 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:48:32.489018 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-5e0aacdd-171d-48b8-adde-bf740ad78086 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:48:32.489632 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-5e0aacdd-171d-48b8-adde-bf740ad78086 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:48:32.662102 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-5e0aacdd-171d-48b8-adde-bf740ad78086 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:48:32.673210 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-5e0aacdd-171d-48b8-adde-bf740ad78086 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:48:32.674747 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-5e0aacdd-171d-48b8-adde-bf740ad78086 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:48:32.676329 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-5e0aacdd-171d-48b8-adde-bf740ad78086 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] 10.222.0.121 "GET /compute/v2.1/servers/825f082d-bf46-440f-9d5f-424241f04c38" status: 200 len: 1743 microversion: 2.20 time: 0.205222 Aug 04 10:48:32.684730 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 553/1108] 10.222.0.121 () {60 vars in 1282 bytes} [Thu Aug 4 10:48:32 2022] GET /compute/v2.1/servers/825f082d-bf46-440f-9d5f-424241f04c38 => generated 1743 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:48:33.705305 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-7c9bdddf-73d8-40ff-a4f2-c7b674695f37 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:48:33.706982 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-7c9bdddf-73d8-40ff-a4f2-c7b674695f37 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] [instance: 825f082d-bf46-440f-9d5f-424241f04c38] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:48:33.727017 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-7c9bdddf-73d8-40ff-a4f2-c7b674695f37 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:48:33.728137 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-7c9bdddf-73d8-40ff-a4f2-c7b674695f37 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:48:33.729903 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-7c9bdddf-73d8-40ff-a4f2-c7b674695f37 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:48:33.730757 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-7c9bdddf-73d8-40ff-a4f2-c7b674695f37 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:48:33.927895 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-7c9bdddf-73d8-40ff-a4f2-c7b674695f37 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:48:33.938690 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-7c9bdddf-73d8-40ff-a4f2-c7b674695f37 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:48:33.940330 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-7c9bdddf-73d8-40ff-a4f2-c7b674695f37 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:48:33.941606 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-7c9bdddf-73d8-40ff-a4f2-c7b674695f37 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] 10.222.0.121 "GET /compute/v2.1/servers/825f082d-bf46-440f-9d5f-424241f04c38" status: 200 len: 1743 microversion: 2.20 time: 0.244015 Aug 04 10:48:33.942423 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 556/1109] 10.222.0.121 () {60 vars in 1282 bytes} [Thu Aug 4 10:48:33 2022] GET /compute/v2.1/servers/825f082d-bf46-440f-9d5f-424241f04c38 => generated 1743 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:48:34.967519 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-9101cf2e-7406-450e-bb8a-86844a07ac26 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:48:34.968292 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-9101cf2e-7406-450e-bb8a-86844a07ac26 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] [instance: 825f082d-bf46-440f-9d5f-424241f04c38] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:48:34.976254 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-9101cf2e-7406-450e-bb8a-86844a07ac26 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:48:34.977283 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-9101cf2e-7406-450e-bb8a-86844a07ac26 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:48:34.978667 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-9101cf2e-7406-450e-bb8a-86844a07ac26 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:48:34.979524 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-9101cf2e-7406-450e-bb8a-86844a07ac26 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:48:35.153738 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-9101cf2e-7406-450e-bb8a-86844a07ac26 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:48:35.168815 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-9101cf2e-7406-450e-bb8a-86844a07ac26 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:48:35.170807 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-9101cf2e-7406-450e-bb8a-86844a07ac26 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:48:35.172773 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-9101cf2e-7406-450e-bb8a-86844a07ac26 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] 10.222.0.121 "GET /compute/v2.1/servers/825f082d-bf46-440f-9d5f-424241f04c38" status: 200 len: 1743 microversion: 2.20 time: 0.210497 Aug 04 10:48:35.189787 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 554/1110] 10.222.0.121 () {60 vars in 1282 bytes} [Thu Aug 4 10:48:34 2022] GET /compute/v2.1/servers/825f082d-bf46-440f-9d5f-424241f04c38 => generated 1743 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:48:36.210008 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-3a1b6e9c-5957-456a-897d-bd771e80c232 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:48:36.210711 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-3a1b6e9c-5957-456a-897d-bd771e80c232 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] [instance: 825f082d-bf46-440f-9d5f-424241f04c38] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:48:36.219538 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-3a1b6e9c-5957-456a-897d-bd771e80c232 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:48:36.220430 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-3a1b6e9c-5957-456a-897d-bd771e80c232 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:48:36.221478 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-3a1b6e9c-5957-456a-897d-bd771e80c232 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:48:36.222171 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-3a1b6e9c-5957-456a-897d-bd771e80c232 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:48:36.400571 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-3a1b6e9c-5957-456a-897d-bd771e80c232 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:48:36.414274 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-3a1b6e9c-5957-456a-897d-bd771e80c232 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:48:36.415798 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-3a1b6e9c-5957-456a-897d-bd771e80c232 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:48:36.417077 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-3a1b6e9c-5957-456a-897d-bd771e80c232 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] 10.222.0.121 "GET /compute/v2.1/servers/825f082d-bf46-440f-9d5f-424241f04c38" status: 200 len: 1743 microversion: 2.20 time: 0.212239 Aug 04 10:48:36.418221 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 557/1111] 10.222.0.121 () {60 vars in 1282 bytes} [Thu Aug 4 10:48:36 2022] GET /compute/v2.1/servers/825f082d-bf46-440f-9d5f-424241f04c38 => generated 1743 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:48:37.443134 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-3abd53ff-4844-45b4-b3b5-2381a10f46a7 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:48:37.444256 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-3abd53ff-4844-45b4-b3b5-2381a10f46a7 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] [instance: 825f082d-bf46-440f-9d5f-424241f04c38] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:48:37.451554 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-3abd53ff-4844-45b4-b3b5-2381a10f46a7 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:48:37.452492 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-3abd53ff-4844-45b4-b3b5-2381a10f46a7 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:48:37.453376 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-3abd53ff-4844-45b4-b3b5-2381a10f46a7 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:48:37.453811 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-3abd53ff-4844-45b4-b3b5-2381a10f46a7 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:48:37.645176 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-3abd53ff-4844-45b4-b3b5-2381a10f46a7 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:48:37.653877 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-3abd53ff-4844-45b4-b3b5-2381a10f46a7 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:48:37.655476 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-3abd53ff-4844-45b4-b3b5-2381a10f46a7 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:48:37.656740 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-3abd53ff-4844-45b4-b3b5-2381a10f46a7 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] 10.222.0.121 "GET /compute/v2.1/servers/825f082d-bf46-440f-9d5f-424241f04c38" status: 200 len: 1743 microversion: 2.20 time: 0.217891 Aug 04 10:48:37.657336 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 555/1112] 10.222.0.121 () {60 vars in 1282 bytes} [Thu Aug 4 10:48:37 2022] GET /compute/v2.1/servers/825f082d-bf46-440f-9d5f-424241f04c38 => generated 1743 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:48:38.680726 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-0fa2f08b-2bdb-473f-8fe7-8e6758eb4e1c tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:48:38.681419 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-0fa2f08b-2bdb-473f-8fe7-8e6758eb4e1c tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] [instance: 825f082d-bf46-440f-9d5f-424241f04c38] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:48:38.688752 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-0fa2f08b-2bdb-473f-8fe7-8e6758eb4e1c tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:48:38.689200 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-0fa2f08b-2bdb-473f-8fe7-8e6758eb4e1c tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:48:38.690009 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-0fa2f08b-2bdb-473f-8fe7-8e6758eb4e1c tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:48:38.690459 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-0fa2f08b-2bdb-473f-8fe7-8e6758eb4e1c tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:48:38.837740 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-0fa2f08b-2bdb-473f-8fe7-8e6758eb4e1c tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:48:38.851454 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-0fa2f08b-2bdb-473f-8fe7-8e6758eb4e1c tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:48:38.854162 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-0fa2f08b-2bdb-473f-8fe7-8e6758eb4e1c tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:48:38.856106 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-0fa2f08b-2bdb-473f-8fe7-8e6758eb4e1c tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] 10.222.0.121 "GET /compute/v2.1/servers/825f082d-bf46-440f-9d5f-424241f04c38" status: 200 len: 1743 microversion: 2.20 time: 0.179434 Aug 04 10:48:38.857124 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 558/1113] 10.222.0.121 () {60 vars in 1282 bytes} [Thu Aug 4 10:48:38 2022] GET /compute/v2.1/servers/825f082d-bf46-440f-9d5f-424241f04c38 => generated 1743 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:48:39.883930 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-fa18da0d-ef2b-4967-b1a2-0acbedeb0e84 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:48:39.884777 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-fa18da0d-ef2b-4967-b1a2-0acbedeb0e84 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] [instance: 825f082d-bf46-440f-9d5f-424241f04c38] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:48:39.887923 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG dbcounter [-] [124456] Writing DB stats nova_api:SELECT=27 {{(pid=124456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:48:39.898104 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-fa18da0d-ef2b-4967-b1a2-0acbedeb0e84 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:48:39.898814 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-fa18da0d-ef2b-4967-b1a2-0acbedeb0e84 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:48:39.900271 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-fa18da0d-ef2b-4967-b1a2-0acbedeb0e84 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:48:39.900946 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-fa18da0d-ef2b-4967-b1a2-0acbedeb0e84 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:48:39.905711 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG dbcounter [-] [124456] Writing DB stats nova_cell1:SELECT=77 {{(pid=124456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:48:40.061013 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-fa18da0d-ef2b-4967-b1a2-0acbedeb0e84 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:48:40.071159 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-fa18da0d-ef2b-4967-b1a2-0acbedeb0e84 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:48:40.072971 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-fa18da0d-ef2b-4967-b1a2-0acbedeb0e84 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:48:40.074314 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-fa18da0d-ef2b-4967-b1a2-0acbedeb0e84 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] 10.222.0.121 "GET /compute/v2.1/servers/825f082d-bf46-440f-9d5f-424241f04c38" status: 200 len: 1725 microversion: 2.20 time: 0.196346 Aug 04 10:48:40.074901 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 556/1114] 10.222.0.121 () {60 vars in 1282 bytes} [Thu Aug 4 10:48:39 2022] GET /compute/v2.1/servers/825f082d-bf46-440f-9d5f-424241f04c38 => generated 1725 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:48:41.103254 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-e5329c51-eded-4556-bc6f-0ae482398b52 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:48:41.104086 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-e5329c51-eded-4556-bc6f-0ae482398b52 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] [instance: 825f082d-bf46-440f-9d5f-424241f04c38] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:48:41.106787 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG dbcounter [-] [124457] Writing DB stats nova_api:SELECT=29 {{(pid=124457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:48:41.113354 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-e5329c51-eded-4556-bc6f-0ae482398b52 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:48:41.113804 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-e5329c51-eded-4556-bc6f-0ae482398b52 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:48:41.114597 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-e5329c51-eded-4556-bc6f-0ae482398b52 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:48:41.115037 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-e5329c51-eded-4556-bc6f-0ae482398b52 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:48:41.119482 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG dbcounter [-] [124457] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:48:41.255704 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [req-43363537-292f-42b8-a2d7-cf99d6d28d43 req-03a297ed-ba65-4963-80fe-5efe60478861 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "825f082d-bf46-440f-9d5f-424241f04c38", "name": "network-vif-unplugged", "status": "completed", "tag": "f83f40cc-fa5c-4346-aa16-153595a2f799"}]} {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:48:41.270083 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-e5329c51-eded-4556-bc6f-0ae482398b52 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:48:41.280417 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [req-43363537-292f-42b8-a2d7-cf99d6d28d43 req-03a297ed-ba65-4963-80fe-5efe60478861 service nova] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:48:41.281001 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-e5329c51-eded-4556-bc6f-0ae482398b52 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:48:41.281575 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [req-43363537-292f-42b8-a2d7-cf99d6d28d43 req-03a297ed-ba65-4963-80fe-5efe60478861 service nova] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:48:41.282565 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-e5329c51-eded-4556-bc6f-0ae482398b52 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:48:41.283891 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-e5329c51-eded-4556-bc6f-0ae482398b52 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] 10.222.0.121 "GET /compute/v2.1/servers/825f082d-bf46-440f-9d5f-424241f04c38" status: 200 len: 1725 microversion: 2.20 time: 0.185112 Aug 04 10:48:41.296902 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 559/1115] 10.222.0.121 () {60 vars in 1282 bytes} [Thu Aug 4 10:48:41 2022] GET /compute/v2.1/servers/825f082d-bf46-440f-9d5f-424241f04c38 => generated 1725 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:48:41.313393 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.compute.server_external_events [req-43363537-292f-42b8-a2d7-cf99d6d28d43 req-03a297ed-ba65-4963-80fe-5efe60478861 service nova] Creating event network-vif-unplugged:f83f40cc-fa5c-4346-aa16-153595a2f799 for instance 825f082d-bf46-440f-9d5f-424241f04c38 on hv-cinder-85200 Aug 04 10:48:41.319867 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [req-43363537-292f-42b8-a2d7-cf99d6d28d43 req-03a297ed-ba65-4963-80fe-5efe60478861 service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.069006 Aug 04 10:48:41.320566 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 557/1116] 10.222.0.121 () {64 vars in 1322 bytes} [Thu Aug 4 10:48:41 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:48:42.320813 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-3e5d975d-dfcc-496f-ac1d-62b82e959294 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:48:42.321486 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-3e5d975d-dfcc-496f-ac1d-62b82e959294 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] [instance: 825f082d-bf46-440f-9d5f-424241f04c38] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:48:42.329494 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-3e5d975d-dfcc-496f-ac1d-62b82e959294 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:48:42.329946 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-3e5d975d-dfcc-496f-ac1d-62b82e959294 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:48:42.330747 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-3e5d975d-dfcc-496f-ac1d-62b82e959294 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:48:42.331188 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-3e5d975d-dfcc-496f-ac1d-62b82e959294 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:48:42.485642 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-3e5d975d-dfcc-496f-ac1d-62b82e959294 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:48:42.494640 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-3e5d975d-dfcc-496f-ac1d-62b82e959294 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:48:42.496207 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-3e5d975d-dfcc-496f-ac1d-62b82e959294 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:48:42.497427 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-3e5d975d-dfcc-496f-ac1d-62b82e959294 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] 10.222.0.121 "GET /compute/v2.1/servers/825f082d-bf46-440f-9d5f-424241f04c38" status: 200 len: 1668 microversion: 2.20 time: 0.180766 Aug 04 10:48:42.498011 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 560/1117] 10.222.0.121 () {60 vars in 1282 bytes} [Thu Aug 4 10:48:42 2022] GET /compute/v2.1/servers/825f082d-bf46-440f-9d5f-424241f04c38 => generated 1668 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:48:42.522665 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-17e79464-5ff6-4a55-ae9a-385fc1c9201b tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "faa03b5d-db4b-4ffa-8a38-a2d1781fbfef"}} {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:48:42.525497 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-17e79464-5ff6-4a55-ae9a-385fc1c9201b tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] [instance: 825f082d-bf46-440f-9d5f-424241f04c38] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:48:42.533343 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-17e79464-5ff6-4a55-ae9a-385fc1c9201b tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:48:42.533895 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-17e79464-5ff6-4a55-ae9a-385fc1c9201b tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:48:42.534809 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-17e79464-5ff6-4a55-ae9a-385fc1c9201b tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:48:42.535325 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-17e79464-5ff6-4a55-ae9a-385fc1c9201b tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:48:42.859170 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-17e79464-5ff6-4a55-ae9a-385fc1c9201b tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] 10.222.0.121 "POST /compute/v2.1/servers/825f082d-bf46-440f-9d5f-424241f04c38/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.341708 Aug 04 10:48:42.860218 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 558/1118] 10.222.0.121 () {62 vars in 1369 bytes} [Thu Aug 4 10:48:42 2022] POST /compute/v2.1/servers/825f082d-bf46-440f-9d5f-424241f04c38/os-volume_attachments => generated 188 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 10:48:43.026283 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-8a5219d6-e665-4742-b4e7-32a91ccaa9b6 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:48:43.026778 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-8a5219d6-e665-4742-b4e7-32a91ccaa9b6 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] [instance: 825f082d-bf46-440f-9d5f-424241f04c38] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:48:43.034204 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-8a5219d6-e665-4742-b4e7-32a91ccaa9b6 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:48:43.034659 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-8a5219d6-e665-4742-b4e7-32a91ccaa9b6 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:48:43.035447 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-8a5219d6-e665-4742-b4e7-32a91ccaa9b6 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:48:43.035889 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-8a5219d6-e665-4742-b4e7-32a91ccaa9b6 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:48:43.341060 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-8a5219d6-e665-4742-b4e7-32a91ccaa9b6 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] 10.222.0.121 "DELETE /compute/v2.1/servers/825f082d-bf46-440f-9d5f-424241f04c38/os-volume_attachments/faa03b5d-db4b-4ffa-8a38-a2d1781fbfef" status: 202 len: 0 microversion: 2.20 time: 0.318468 Aug 04 10:48:43.341869 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 561/1119] 10.222.0.121 () {60 vars in 1462 bytes} [Thu Aug 4 10:48:43 2022] DELETE /compute/v2.1/servers/825f082d-bf46-440f-9d5f-424241f04c38/os-volume_attachments/faa03b5d-db4b-4ffa-8a38-a2d1781fbfef => generated 0 bytes in 321 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 04 10:48:43.423634 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-ec21ba48-095a-460f-9b3d-0873712ee756 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:48:43.424262 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-ec21ba48-095a-460f-9b3d-0873712ee756 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] [instance: 825f082d-bf46-440f-9d5f-424241f04c38] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:48:43.431609 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-ec21ba48-095a-460f-9b3d-0873712ee756 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:48:43.432096 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-ec21ba48-095a-460f-9b3d-0873712ee756 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:48:43.432881 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-ec21ba48-095a-460f-9b3d-0873712ee756 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:48:43.433318 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-ec21ba48-095a-460f-9b3d-0873712ee756 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:48:43.467486 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-ec21ba48-095a-460f-9b3d-0873712ee756 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] [instance: 825f082d-bf46-440f-9d5f-424241f04c38] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=124456) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 04 10:48:43.539938 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-ec21ba48-095a-460f-9b3d-0873712ee756 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] 10.222.0.121 "POST /compute/v2.1/servers/825f082d-bf46-440f-9d5f-424241f04c38/action" status: 202 len: 0 microversion: 2.20 time: 0.120784 Aug 04 10:48:43.541031 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 559/1120] 10.222.0.121 () {62 vars in 1324 bytes} [Thu Aug 4 10:48:43 2022] POST /compute/v2.1/servers/825f082d-bf46-440f-9d5f-424241f04c38/action => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 04 10:48:43.550131 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-58fc6825-c33d-48b2-b293-985e551523e2 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:48:43.551221 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-58fc6825-c33d-48b2-b293-985e551523e2 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] [instance: 825f082d-bf46-440f-9d5f-424241f04c38] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:48:43.558220 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-58fc6825-c33d-48b2-b293-985e551523e2 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:48:43.558674 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-58fc6825-c33d-48b2-b293-985e551523e2 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:48:43.559494 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-58fc6825-c33d-48b2-b293-985e551523e2 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:48:43.559927 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-58fc6825-c33d-48b2-b293-985e551523e2 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:48:43.720036 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-58fc6825-c33d-48b2-b293-985e551523e2 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:48:43.730459 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-58fc6825-c33d-48b2-b293-985e551523e2 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:48:43.732544 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-58fc6825-c33d-48b2-b293-985e551523e2 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:48:43.734052 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-58fc6825-c33d-48b2-b293-985e551523e2 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] 10.222.0.121 "GET /compute/v2.1/servers/825f082d-bf46-440f-9d5f-424241f04c38" status: 200 len: 1676 microversion: 2.20 time: 0.188852 Aug 04 10:48:43.734816 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 562/1121] 10.222.0.121 () {60 vars in 1282 bytes} [Thu Aug 4 10:48:43 2022] GET /compute/v2.1/servers/825f082d-bf46-440f-9d5f-424241f04c38 => generated 1676 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:48:44.762160 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-ee65e637-19bc-4b4e-8d37-85900b922f67 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:48:44.762865 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-ee65e637-19bc-4b4e-8d37-85900b922f67 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] [instance: 825f082d-bf46-440f-9d5f-424241f04c38] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:48:44.770292 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-ee65e637-19bc-4b4e-8d37-85900b922f67 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:48:44.770823 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-ee65e637-19bc-4b4e-8d37-85900b922f67 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:48:44.771856 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-ee65e637-19bc-4b4e-8d37-85900b922f67 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:48:44.772232 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-ee65e637-19bc-4b4e-8d37-85900b922f67 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:48:45.014939 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-ee65e637-19bc-4b4e-8d37-85900b922f67 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:48:45.024124 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-ee65e637-19bc-4b4e-8d37-85900b922f67 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:48:45.025676 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-ee65e637-19bc-4b4e-8d37-85900b922f67 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:48:45.027053 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-ee65e637-19bc-4b4e-8d37-85900b922f67 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] 10.222.0.121 "GET /compute/v2.1/servers/825f082d-bf46-440f-9d5f-424241f04c38" status: 200 len: 1734 microversion: 2.20 time: 0.269711 Aug 04 10:48:45.027684 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 560/1122] 10.222.0.121 () {60 vars in 1282 bytes} [Thu Aug 4 10:48:44 2022] GET /compute/v2.1/servers/825f082d-bf46-440f-9d5f-424241f04c38 => generated 1734 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:48:46.052205 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-f453e76c-fb1f-4398-9bd1-6b3d50b63537 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:48:46.053625 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-f453e76c-fb1f-4398-9bd1-6b3d50b63537 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] [instance: 825f082d-bf46-440f-9d5f-424241f04c38] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:48:46.063566 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-f453e76c-fb1f-4398-9bd1-6b3d50b63537 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:48:46.065060 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-f453e76c-fb1f-4398-9bd1-6b3d50b63537 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:48:46.067466 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-f453e76c-fb1f-4398-9bd1-6b3d50b63537 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:48:46.068244 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-f453e76c-fb1f-4398-9bd1-6b3d50b63537 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:48:46.231414 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-f453e76c-fb1f-4398-9bd1-6b3d50b63537 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:48:46.240808 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-f453e76c-fb1f-4398-9bd1-6b3d50b63537 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:48:46.242341 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-f453e76c-fb1f-4398-9bd1-6b3d50b63537 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:48:46.243561 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-f453e76c-fb1f-4398-9bd1-6b3d50b63537 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] 10.222.0.121 "GET /compute/v2.1/servers/825f082d-bf46-440f-9d5f-424241f04c38" status: 200 len: 1734 microversion: 2.20 time: 0.196268 Aug 04 10:48:46.244190 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 563/1123] 10.222.0.121 () {60 vars in 1282 bytes} [Thu Aug 4 10:48:46 2022] GET /compute/v2.1/servers/825f082d-bf46-440f-9d5f-424241f04c38 => generated 1734 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:48:47.270822 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-5547de86-2a64-415b-8aec-b0c4ec76790d tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:48:47.272573 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-5547de86-2a64-415b-8aec-b0c4ec76790d tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] [instance: 825f082d-bf46-440f-9d5f-424241f04c38] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:48:47.290928 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-5547de86-2a64-415b-8aec-b0c4ec76790d tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:48:47.292218 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-5547de86-2a64-415b-8aec-b0c4ec76790d tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:48:47.293781 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-5547de86-2a64-415b-8aec-b0c4ec76790d tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:48:47.294490 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-5547de86-2a64-415b-8aec-b0c4ec76790d tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:48:47.501369 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-5547de86-2a64-415b-8aec-b0c4ec76790d tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:48:47.510394 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-5547de86-2a64-415b-8aec-b0c4ec76790d tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:48:47.512049 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-5547de86-2a64-415b-8aec-b0c4ec76790d tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:48:47.513433 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-5547de86-2a64-415b-8aec-b0c4ec76790d tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] 10.222.0.121 "GET /compute/v2.1/servers/825f082d-bf46-440f-9d5f-424241f04c38" status: 200 len: 1734 microversion: 2.20 time: 0.249607 Aug 04 10:48:47.514022 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 561/1124] 10.222.0.121 () {60 vars in 1282 bytes} [Thu Aug 4 10:48:47 2022] GET /compute/v2.1/servers/825f082d-bf46-440f-9d5f-424241f04c38 => generated 1734 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:48:48.537935 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-7c194b7b-441b-4232-ac43-81bd8aa68c2f tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:48:48.538653 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-7c194b7b-441b-4232-ac43-81bd8aa68c2f tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] [instance: 825f082d-bf46-440f-9d5f-424241f04c38] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:48:48.546039 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-7c194b7b-441b-4232-ac43-81bd8aa68c2f tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:48:48.546498 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-7c194b7b-441b-4232-ac43-81bd8aa68c2f tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:48:48.547316 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-7c194b7b-441b-4232-ac43-81bd8aa68c2f tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:48:48.547745 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-7c194b7b-441b-4232-ac43-81bd8aa68c2f tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:48:48.714151 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-7c194b7b-441b-4232-ac43-81bd8aa68c2f tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:48:48.729802 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-7c194b7b-441b-4232-ac43-81bd8aa68c2f tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:48:48.731768 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-7c194b7b-441b-4232-ac43-81bd8aa68c2f tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:48:48.733118 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-7c194b7b-441b-4232-ac43-81bd8aa68c2f tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] 10.222.0.121 "GET /compute/v2.1/servers/825f082d-bf46-440f-9d5f-424241f04c38" status: 200 len: 1734 microversion: 2.20 time: 0.199337 Aug 04 10:48:48.734004 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 564/1125] 10.222.0.121 () {60 vars in 1282 bytes} [Thu Aug 4 10:48:48 2022] GET /compute/v2.1/servers/825f082d-bf46-440f-9d5f-424241f04c38 => generated 1734 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:48:49.766666 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-2df565d5-5884-4b9c-ad57-8e79bae5bdb4 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:48:49.767422 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-2df565d5-5884-4b9c-ad57-8e79bae5bdb4 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] [instance: 825f082d-bf46-440f-9d5f-424241f04c38] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:48:49.777619 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-2df565d5-5884-4b9c-ad57-8e79bae5bdb4 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:48:49.778293 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-2df565d5-5884-4b9c-ad57-8e79bae5bdb4 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:48:49.778918 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-2df565d5-5884-4b9c-ad57-8e79bae5bdb4 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:48:49.779810 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-2df565d5-5884-4b9c-ad57-8e79bae5bdb4 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:48:49.955553 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-2df565d5-5884-4b9c-ad57-8e79bae5bdb4 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:48:49.966352 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-2df565d5-5884-4b9c-ad57-8e79bae5bdb4 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:48:49.968320 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-2df565d5-5884-4b9c-ad57-8e79bae5bdb4 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:48:49.970218 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-2df565d5-5884-4b9c-ad57-8e79bae5bdb4 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] 10.222.0.121 "GET /compute/v2.1/servers/825f082d-bf46-440f-9d5f-424241f04c38" status: 200 len: 1734 microversion: 2.20 time: 0.207771 Aug 04 10:48:49.971619 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 562/1126] 10.222.0.121 () {60 vars in 1282 bytes} [Thu Aug 4 10:48:49 2022] GET /compute/v2.1/servers/825f082d-bf46-440f-9d5f-424241f04c38 => generated 1734 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:48:51.001975 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-e38cf204-58b6-4d24-a7ba-ba9d4154b2ed tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:48:51.004661 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-e38cf204-58b6-4d24-a7ba-ba9d4154b2ed tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] [instance: 825f082d-bf46-440f-9d5f-424241f04c38] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:48:51.014330 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-e38cf204-58b6-4d24-a7ba-ba9d4154b2ed tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:48:51.014848 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-e38cf204-58b6-4d24-a7ba-ba9d4154b2ed tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:48:51.015796 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-e38cf204-58b6-4d24-a7ba-ba9d4154b2ed tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:48:51.016590 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-e38cf204-58b6-4d24-a7ba-ba9d4154b2ed tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:48:51.201708 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-e38cf204-58b6-4d24-a7ba-ba9d4154b2ed tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:48:51.211045 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-e38cf204-58b6-4d24-a7ba-ba9d4154b2ed tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:48:51.212656 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-e38cf204-58b6-4d24-a7ba-ba9d4154b2ed tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:48:51.215681 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-e38cf204-58b6-4d24-a7ba-ba9d4154b2ed tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] 10.222.0.121 "GET /compute/v2.1/servers/825f082d-bf46-440f-9d5f-424241f04c38" status: 200 len: 1734 microversion: 2.20 time: 0.220104 Aug 04 10:48:51.216918 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 565/1127] 10.222.0.121 () {60 vars in 1282 bytes} [Thu Aug 4 10:48:50 2022] GET /compute/v2.1/servers/825f082d-bf46-440f-9d5f-424241f04c38 => generated 1734 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:48:52.240986 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-21a658fc-06d3-4f39-8af6-722a0c0b2bd6 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:48:52.241742 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-21a658fc-06d3-4f39-8af6-722a0c0b2bd6 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] [instance: 825f082d-bf46-440f-9d5f-424241f04c38] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:48:52.249978 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-21a658fc-06d3-4f39-8af6-722a0c0b2bd6 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:48:52.250518 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-21a658fc-06d3-4f39-8af6-722a0c0b2bd6 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:48:52.251284 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-21a658fc-06d3-4f39-8af6-722a0c0b2bd6 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:48:52.251733 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-21a658fc-06d3-4f39-8af6-722a0c0b2bd6 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:48:52.442045 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-21a658fc-06d3-4f39-8af6-722a0c0b2bd6 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:48:52.451421 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-21a658fc-06d3-4f39-8af6-722a0c0b2bd6 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:48:52.453117 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-21a658fc-06d3-4f39-8af6-722a0c0b2bd6 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:48:52.454467 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-21a658fc-06d3-4f39-8af6-722a0c0b2bd6 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] 10.222.0.121 "GET /compute/v2.1/servers/825f082d-bf46-440f-9d5f-424241f04c38" status: 200 len: 1734 microversion: 2.20 time: 0.217871 Aug 04 10:48:52.455054 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 563/1128] 10.222.0.121 () {60 vars in 1282 bytes} [Thu Aug 4 10:48:52 2022] GET /compute/v2.1/servers/825f082d-bf46-440f-9d5f-424241f04c38 => generated 1734 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:48:53.480808 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-6aa4ce19-6a55-4cf7-bc31-4b90f6498c7c tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:48:53.481746 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-6aa4ce19-6a55-4cf7-bc31-4b90f6498c7c tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] [instance: 825f082d-bf46-440f-9d5f-424241f04c38] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:48:53.490861 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-6aa4ce19-6a55-4cf7-bc31-4b90f6498c7c tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:48:53.491322 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-6aa4ce19-6a55-4cf7-bc31-4b90f6498c7c tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:48:53.492192 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-6aa4ce19-6a55-4cf7-bc31-4b90f6498c7c tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:48:53.492705 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-6aa4ce19-6a55-4cf7-bc31-4b90f6498c7c tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:48:53.643200 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-6aa4ce19-6a55-4cf7-bc31-4b90f6498c7c tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:48:53.652997 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-6aa4ce19-6a55-4cf7-bc31-4b90f6498c7c tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:48:53.654655 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-6aa4ce19-6a55-4cf7-bc31-4b90f6498c7c tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:48:53.655722 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-6aa4ce19-6a55-4cf7-bc31-4b90f6498c7c tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] 10.222.0.121 "GET /compute/v2.1/servers/825f082d-bf46-440f-9d5f-424241f04c38" status: 200 len: 1734 microversion: 2.20 time: 0.179380 Aug 04 10:48:53.656424 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 566/1129] 10.222.0.121 () {60 vars in 1282 bytes} [Thu Aug 4 10:48:53 2022] GET /compute/v2.1/servers/825f082d-bf46-440f-9d5f-424241f04c38 => generated 1734 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:48:54.680170 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-829013b4-f140-42d5-acff-031f2e1c8e73 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:48:54.680916 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-829013b4-f140-42d5-acff-031f2e1c8e73 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] [instance: 825f082d-bf46-440f-9d5f-424241f04c38] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:48:54.688071 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-829013b4-f140-42d5-acff-031f2e1c8e73 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:48:54.688546 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-829013b4-f140-42d5-acff-031f2e1c8e73 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:48:54.689342 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-829013b4-f140-42d5-acff-031f2e1c8e73 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:48:54.689787 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-829013b4-f140-42d5-acff-031f2e1c8e73 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:48:54.826981 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-829013b4-f140-42d5-acff-031f2e1c8e73 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:48:54.835980 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-829013b4-f140-42d5-acff-031f2e1c8e73 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:48:54.837404 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-829013b4-f140-42d5-acff-031f2e1c8e73 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:48:54.838588 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-829013b4-f140-42d5-acff-031f2e1c8e73 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] 10.222.0.121 "GET /compute/v2.1/servers/825f082d-bf46-440f-9d5f-424241f04c38" status: 200 len: 1734 microversion: 2.20 time: 0.163448 Aug 04 10:48:54.839164 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 564/1130] 10.222.0.121 () {60 vars in 1282 bytes} [Thu Aug 4 10:48:54 2022] GET /compute/v2.1/servers/825f082d-bf46-440f-9d5f-424241f04c38 => generated 1734 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:48:55.863178 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-f145fffa-6174-4887-be4e-36cef8d99e43 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:48:55.864214 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-f145fffa-6174-4887-be4e-36cef8d99e43 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] [instance: 825f082d-bf46-440f-9d5f-424241f04c38] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:48:55.875732 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-f145fffa-6174-4887-be4e-36cef8d99e43 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:48:55.876251 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-f145fffa-6174-4887-be4e-36cef8d99e43 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:48:55.877074 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-f145fffa-6174-4887-be4e-36cef8d99e43 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:48:55.877654 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-f145fffa-6174-4887-be4e-36cef8d99e43 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:48:56.046873 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-f145fffa-6174-4887-be4e-36cef8d99e43 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:48:56.056356 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-f145fffa-6174-4887-be4e-36cef8d99e43 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:48:56.058136 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-f145fffa-6174-4887-be4e-36cef8d99e43 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:48:56.059567 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-f145fffa-6174-4887-be4e-36cef8d99e43 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] 10.222.0.121 "GET /compute/v2.1/servers/825f082d-bf46-440f-9d5f-424241f04c38" status: 200 len: 1734 microversion: 2.20 time: 0.200812 Aug 04 10:48:56.060223 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 567/1131] 10.222.0.121 () {60 vars in 1282 bytes} [Thu Aug 4 10:48:55 2022] GET /compute/v2.1/servers/825f082d-bf46-440f-9d5f-424241f04c38 => generated 1734 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:48:57.085644 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-5dfd0c5d-f8de-4bb1-a896-779135d32c39 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:48:57.086350 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-5dfd0c5d-f8de-4bb1-a896-779135d32c39 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] [instance: 825f082d-bf46-440f-9d5f-424241f04c38] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:48:57.094594 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-5dfd0c5d-f8de-4bb1-a896-779135d32c39 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:48:57.095182 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-5dfd0c5d-f8de-4bb1-a896-779135d32c39 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:48:57.095983 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-5dfd0c5d-f8de-4bb1-a896-779135d32c39 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:48:57.096439 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-5dfd0c5d-f8de-4bb1-a896-779135d32c39 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:48:57.236947 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-5dfd0c5d-f8de-4bb1-a896-779135d32c39 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:48:57.245470 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-5dfd0c5d-f8de-4bb1-a896-779135d32c39 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:48:57.246991 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-5dfd0c5d-f8de-4bb1-a896-779135d32c39 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:48:57.248214 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-5dfd0c5d-f8de-4bb1-a896-779135d32c39 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] 10.222.0.121 "GET /compute/v2.1/servers/825f082d-bf46-440f-9d5f-424241f04c38" status: 200 len: 1734 microversion: 2.20 time: 0.167731 Aug 04 10:48:57.248814 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 565/1132] 10.222.0.121 () {60 vars in 1282 bytes} [Thu Aug 4 10:48:57 2022] GET /compute/v2.1/servers/825f082d-bf46-440f-9d5f-424241f04c38 => generated 1734 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:48:58.272751 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-62673547-e7e7-4ae1-96ad-ec2ca9ed948c tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:48:58.273433 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-62673547-e7e7-4ae1-96ad-ec2ca9ed948c tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] [instance: 825f082d-bf46-440f-9d5f-424241f04c38] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:48:58.280561 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-62673547-e7e7-4ae1-96ad-ec2ca9ed948c tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:48:58.281151 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-62673547-e7e7-4ae1-96ad-ec2ca9ed948c tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:48:58.281938 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-62673547-e7e7-4ae1-96ad-ec2ca9ed948c tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:48:58.282379 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-62673547-e7e7-4ae1-96ad-ec2ca9ed948c tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:48:58.474140 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-62673547-e7e7-4ae1-96ad-ec2ca9ed948c tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:48:58.483650 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-62673547-e7e7-4ae1-96ad-ec2ca9ed948c tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:48:58.485212 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-62673547-e7e7-4ae1-96ad-ec2ca9ed948c tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:48:58.486425 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-62673547-e7e7-4ae1-96ad-ec2ca9ed948c tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] 10.222.0.121 "GET /compute/v2.1/servers/825f082d-bf46-440f-9d5f-424241f04c38" status: 200 len: 1734 microversion: 2.20 time: 0.219355 Aug 04 10:48:58.487022 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 568/1133] 10.222.0.121 () {60 vars in 1282 bytes} [Thu Aug 4 10:48:58 2022] GET /compute/v2.1/servers/825f082d-bf46-440f-9d5f-424241f04c38 => generated 1734 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:48:59.510456 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-211e21e6-51ca-48c7-8654-f5b29561eb9f tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:48:59.511118 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-211e21e6-51ca-48c7-8654-f5b29561eb9f tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] [instance: 825f082d-bf46-440f-9d5f-424241f04c38] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:48:59.518492 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-211e21e6-51ca-48c7-8654-f5b29561eb9f tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:48:59.518954 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-211e21e6-51ca-48c7-8654-f5b29561eb9f tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:48:59.519776 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-211e21e6-51ca-48c7-8654-f5b29561eb9f tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:48:59.520251 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-211e21e6-51ca-48c7-8654-f5b29561eb9f tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:48:59.665672 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-211e21e6-51ca-48c7-8654-f5b29561eb9f tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:48:59.674527 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-211e21e6-51ca-48c7-8654-f5b29561eb9f tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:48:59.676082 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-211e21e6-51ca-48c7-8654-f5b29561eb9f tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:48:59.677971 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-211e21e6-51ca-48c7-8654-f5b29561eb9f tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] 10.222.0.121 "GET /compute/v2.1/servers/825f082d-bf46-440f-9d5f-424241f04c38" status: 200 len: 1734 microversion: 2.20 time: 0.171148 Aug 04 10:48:59.677971 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 566/1134] 10.222.0.121 () {60 vars in 1282 bytes} [Thu Aug 4 10:48:59 2022] GET /compute/v2.1/servers/825f082d-bf46-440f-9d5f-424241f04c38 => generated 1734 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:49:00.701860 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-673e38d4-1231-4cce-8a69-b96d31c91b56 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:49:00.702603 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-673e38d4-1231-4cce-8a69-b96d31c91b56 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] [instance: 825f082d-bf46-440f-9d5f-424241f04c38] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:49:00.710634 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-673e38d4-1231-4cce-8a69-b96d31c91b56 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:49:00.711101 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-673e38d4-1231-4cce-8a69-b96d31c91b56 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:49:00.712124 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-673e38d4-1231-4cce-8a69-b96d31c91b56 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:49:00.712416 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-673e38d4-1231-4cce-8a69-b96d31c91b56 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:49:00.853004 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-673e38d4-1231-4cce-8a69-b96d31c91b56 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:49:00.863158 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-673e38d4-1231-4cce-8a69-b96d31c91b56 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:49:00.864766 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-673e38d4-1231-4cce-8a69-b96d31c91b56 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:49:00.866018 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-673e38d4-1231-4cce-8a69-b96d31c91b56 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] 10.222.0.121 "GET /compute/v2.1/servers/825f082d-bf46-440f-9d5f-424241f04c38" status: 200 len: 1734 microversion: 2.20 time: 0.168392 Aug 04 10:49:00.866612 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 569/1135] 10.222.0.121 () {60 vars in 1282 bytes} [Thu Aug 4 10:49:00 2022] GET /compute/v2.1/servers/825f082d-bf46-440f-9d5f-424241f04c38 => generated 1734 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:49:01.386414 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [req-0635f0d5-3894-4684-9808-cd283a851e4d req-82e7e191-4727-4c17-bccf-284bec5dd8bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "825f082d-bf46-440f-9d5f-424241f04c38", "name": "network-vif-plugged", "status": "completed", "tag": "f83f40cc-fa5c-4346-aa16-153595a2f799"}]} {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:49:01.397851 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [req-0635f0d5-3894-4684-9808-cd283a851e4d req-82e7e191-4727-4c17-bccf-284bec5dd8bf service nova] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:49:01.398411 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [req-0635f0d5-3894-4684-9808-cd283a851e4d req-82e7e191-4727-4c17-bccf-284bec5dd8bf service nova] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:49:01.411004 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.compute.server_external_events [req-0635f0d5-3894-4684-9808-cd283a851e4d req-82e7e191-4727-4c17-bccf-284bec5dd8bf service nova] Creating event network-vif-plugged:f83f40cc-fa5c-4346-aa16-153595a2f799 for instance 825f082d-bf46-440f-9d5f-424241f04c38 on hv-cinder-85200 Aug 04 10:49:01.416532 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [req-0635f0d5-3894-4684-9808-cd283a851e4d req-82e7e191-4727-4c17-bccf-284bec5dd8bf service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034037 Aug 04 10:49:01.417169 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 567/1136] 10.222.0.121 () {64 vars in 1322 bytes} [Thu Aug 4 10:49:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:49:01.896905 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-277c55e9-f60b-4a2a-ae56-b8e370198f46 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:49:01.897595 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-277c55e9-f60b-4a2a-ae56-b8e370198f46 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] [instance: 825f082d-bf46-440f-9d5f-424241f04c38] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:49:01.905585 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-277c55e9-f60b-4a2a-ae56-b8e370198f46 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:49:01.906187 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-277c55e9-f60b-4a2a-ae56-b8e370198f46 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:49:01.907008 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-277c55e9-f60b-4a2a-ae56-b8e370198f46 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:49:01.907751 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-277c55e9-f60b-4a2a-ae56-b8e370198f46 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:49:02.055056 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-277c55e9-f60b-4a2a-ae56-b8e370198f46 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:49:02.064827 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-277c55e9-f60b-4a2a-ae56-b8e370198f46 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:49:02.067175 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-277c55e9-f60b-4a2a-ae56-b8e370198f46 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:49:02.068898 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-277c55e9-f60b-4a2a-ae56-b8e370198f46 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] 10.222.0.121 "GET /compute/v2.1/servers/825f082d-bf46-440f-9d5f-424241f04c38" status: 200 len: 1734 microversion: 2.20 time: 0.177653 Aug 04 10:49:02.069470 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 570/1137] 10.222.0.121 () {60 vars in 1282 bytes} [Thu Aug 4 10:49:01 2022] GET /compute/v2.1/servers/825f082d-bf46-440f-9d5f-424241f04c38 => generated 1734 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:49:03.094343 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-4b049545-e4d8-407d-b49f-5513129b9b1d tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:49:03.095039 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-4b049545-e4d8-407d-b49f-5513129b9b1d tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] [instance: 825f082d-bf46-440f-9d5f-424241f04c38] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:49:03.102338 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-4b049545-e4d8-407d-b49f-5513129b9b1d tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:49:03.102803 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-4b049545-e4d8-407d-b49f-5513129b9b1d tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:49:03.103610 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-4b049545-e4d8-407d-b49f-5513129b9b1d tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:49:03.104160 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-4b049545-e4d8-407d-b49f-5513129b9b1d tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:49:03.267346 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-4b049545-e4d8-407d-b49f-5513129b9b1d tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:49:03.276564 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-4b049545-e4d8-407d-b49f-5513129b9b1d tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:49:03.278114 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-4b049545-e4d8-407d-b49f-5513129b9b1d tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:49:03.279347 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-4b049545-e4d8-407d-b49f-5513129b9b1d tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] 10.222.0.121 "GET /compute/v2.1/servers/825f082d-bf46-440f-9d5f-424241f04c38" status: 200 len: 1734 microversion: 2.20 time: 0.190622 Aug 04 10:49:03.279925 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 568/1138] 10.222.0.121 () {60 vars in 1282 bytes} [Thu Aug 4 10:49:03 2022] GET /compute/v2.1/servers/825f082d-bf46-440f-9d5f-424241f04c38 => generated 1734 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:49:04.303211 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-06484323-5d10-458c-a88e-74614f77e324 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:49:04.303907 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-06484323-5d10-458c-a88e-74614f77e324 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] [instance: 825f082d-bf46-440f-9d5f-424241f04c38] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:49:04.310997 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-06484323-5d10-458c-a88e-74614f77e324 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:49:04.311453 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-06484323-5d10-458c-a88e-74614f77e324 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:49:04.312404 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-06484323-5d10-458c-a88e-74614f77e324 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:49:04.312855 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-06484323-5d10-458c-a88e-74614f77e324 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:49:04.451817 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-06484323-5d10-458c-a88e-74614f77e324 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:49:04.460898 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-06484323-5d10-458c-a88e-74614f77e324 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:49:04.462455 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-06484323-5d10-458c-a88e-74614f77e324 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:49:04.463651 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-06484323-5d10-458c-a88e-74614f77e324 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] 10.222.0.121 "GET /compute/v2.1/servers/825f082d-bf46-440f-9d5f-424241f04c38" status: 200 len: 1721 microversion: 2.20 time: 0.164926 Aug 04 10:49:04.464270 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 571/1139] 10.222.0.121 () {60 vars in 1282 bytes} [Thu Aug 4 10:49:04 2022] GET /compute/v2.1/servers/825f082d-bf46-440f-9d5f-424241f04c38 => generated 1721 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:49:29.866306 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 10:49:29.867067 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: Thu Aug 4 10:49:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 10:49:31.259593 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 10:49:31.260446 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: Thu Aug 4 10:49:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 10:49:59.989983 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-57945763-a149-4101-af9e-4e6f6713049c tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:49:59.993156 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-57945763-a149-4101-af9e-4e6f6713049c tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] [instance: 825f082d-bf46-440f-9d5f-424241f04c38] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:49:59.995548 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG dbcounter [-] [124456] Writing DB stats nova_api:SELECT=29,nova_api:UPDATE=1 {{(pid=124456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:49:59.996898 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG dbcounter [-] [124456] Writing DB stats nova_cell1:SELECT=82,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=124456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:50:00.004378 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-57945763-a149-4101-af9e-4e6f6713049c tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:50:00.004922 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-57945763-a149-4101-af9e-4e6f6713049c tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:50:00.005869 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-57945763-a149-4101-af9e-4e6f6713049c tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:50:00.006318 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-57945763-a149-4101-af9e-4e6f6713049c tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:50:00.040485 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-57945763-a149-4101-af9e-4e6f6713049c tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] 10.222.0.121 "GET /compute/v2.1/servers/825f082d-bf46-440f-9d5f-424241f04c38/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.056233 Aug 04 10:50:00.041279 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 569/1140] 10.222.0.121 () {60 vars in 1348 bytes} [Thu Aug 4 10:49:59 2022] GET /compute/v2.1/servers/825f082d-bf46-440f-9d5f-424241f04c38/os-volume_attachments => generated 25 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:50:00.113806 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-5824f5b6-9e71-4efb-8774-88c5b218d88f tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:50:00.114487 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-5824f5b6-9e71-4efb-8774-88c5b218d88f tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] [instance: 825f082d-bf46-440f-9d5f-424241f04c38] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:50:00.116887 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG dbcounter [-] [124457] Writing DB stats nova_api:SELECT=25 {{(pid=124457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:50:00.121828 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG dbcounter [-] [124457] Writing DB stats nova_cell1:SELECT=86,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=124457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:50:00.123427 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-5824f5b6-9e71-4efb-8774-88c5b218d88f tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:50:00.123867 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-5824f5b6-9e71-4efb-8774-88c5b218d88f tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:50:00.124830 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-5824f5b6-9e71-4efb-8774-88c5b218d88f tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:50:00.125200 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-5824f5b6-9e71-4efb-8774-88c5b218d88f tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:50:00.158713 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-5824f5b6-9e71-4efb-8774-88c5b218d88f tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] [instance: 825f082d-bf46-440f-9d5f-424241f04c38] Going to try to terminate instance {{(pid=124457) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 10:50:00.252678 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-5824f5b6-9e71-4efb-8774-88c5b218d88f tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] 10.222.0.121 "DELETE /compute/v2.1/servers/825f082d-bf46-440f-9d5f-424241f04c38" status: 204 len: 0 microversion: 2.20 time: 0.144867 Aug 04 10:50:00.253259 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 572/1141] 10.222.0.121 () {60 vars in 1285 bytes} [Thu Aug 4 10:50:00 2022] DELETE /compute/v2.1/servers/825f082d-bf46-440f-9d5f-424241f04c38 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 04 10:50:00.262880 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-3233a2b5-9a2e-4c0e-b55e-d4e2bbe9a35e tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:50:00.263512 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-3233a2b5-9a2e-4c0e-b55e-d4e2bbe9a35e tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] [instance: 825f082d-bf46-440f-9d5f-424241f04c38] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:50:00.271075 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-3233a2b5-9a2e-4c0e-b55e-d4e2bbe9a35e tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:50:00.271540 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-3233a2b5-9a2e-4c0e-b55e-d4e2bbe9a35e tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:50:00.272382 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-3233a2b5-9a2e-4c0e-b55e-d4e2bbe9a35e tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:50:00.272827 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-3233a2b5-9a2e-4c0e-b55e-d4e2bbe9a35e tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:50:00.716879 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-3233a2b5-9a2e-4c0e-b55e-d4e2bbe9a35e tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:50:00.726738 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-3233a2b5-9a2e-4c0e-b55e-d4e2bbe9a35e tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:50:00.728439 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-3233a2b5-9a2e-4c0e-b55e-d4e2bbe9a35e tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:50:00.729834 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-3233a2b5-9a2e-4c0e-b55e-d4e2bbe9a35e tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] 10.222.0.121 "GET /compute/v2.1/servers/825f082d-bf46-440f-9d5f-424241f04c38" status: 200 len: 1727 microversion: 2.20 time: 0.471285 Aug 04 10:50:00.730391 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 570/1142] 10.222.0.121 () {60 vars in 1282 bytes} [Thu Aug 4 10:50:00 2022] GET /compute/v2.1/servers/825f082d-bf46-440f-9d5f-424241f04c38 => generated 1727 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:50:01.756373 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-3d64c301-8faa-4abe-b008-7f97166f8333 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:50:01.757654 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-3d64c301-8faa-4abe-b008-7f97166f8333 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] [instance: 825f082d-bf46-440f-9d5f-424241f04c38] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:50:01.766458 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-3d64c301-8faa-4abe-b008-7f97166f8333 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:50:01.766909 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-3d64c301-8faa-4abe-b008-7f97166f8333 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:50:01.767724 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-3d64c301-8faa-4abe-b008-7f97166f8333 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:50:01.768222 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-3d64c301-8faa-4abe-b008-7f97166f8333 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:50:01.929345 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-3d64c301-8faa-4abe-b008-7f97166f8333 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:50:01.939461 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-3d64c301-8faa-4abe-b008-7f97166f8333 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:50:01.941025 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-3d64c301-8faa-4abe-b008-7f97166f8333 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:50:01.942248 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-3d64c301-8faa-4abe-b008-7f97166f8333 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] 10.222.0.121 "GET /compute/v2.1/servers/825f082d-bf46-440f-9d5f-424241f04c38" status: 200 len: 1727 microversion: 2.20 time: 0.192141 Aug 04 10:50:01.942831 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 573/1143] 10.222.0.121 () {60 vars in 1282 bytes} [Thu Aug 4 10:50:01 2022] GET /compute/v2.1/servers/825f082d-bf46-440f-9d5f-424241f04c38 => generated 1727 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:50:02.969189 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-5507b982-8605-4e6a-8caf-d03bfed8c0a9 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:50:02.969189 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-5507b982-8605-4e6a-8caf-d03bfed8c0a9 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] [instance: 825f082d-bf46-440f-9d5f-424241f04c38] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:50:02.977327 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-5507b982-8605-4e6a-8caf-d03bfed8c0a9 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:50:02.977839 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-5507b982-8605-4e6a-8caf-d03bfed8c0a9 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:50:02.979183 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-5507b982-8605-4e6a-8caf-d03bfed8c0a9 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:50:02.980185 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-5507b982-8605-4e6a-8caf-d03bfed8c0a9 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:50:03.074938 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-5507b982-8605-4e6a-8caf-d03bfed8c0a9 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:50:03.088234 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-5507b982-8605-4e6a-8caf-d03bfed8c0a9 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:50:03.091027 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-5507b982-8605-4e6a-8caf-d03bfed8c0a9 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2c14f2350dd450b846db0c22c43688b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18d95fd38a664ce1b69afbb11189020a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:50:03.093710 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-5507b982-8605-4e6a-8caf-d03bfed8c0a9 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] 10.222.0.121 "GET /compute/v2.1/servers/825f082d-bf46-440f-9d5f-424241f04c38" status: 200 len: 1659 microversion: 2.20 time: 0.130870 Aug 04 10:50:03.096019 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 571/1144] 10.222.0.121 () {60 vars in 1282 bytes} [Thu Aug 4 10:50:02 2022] GET /compute/v2.1/servers/825f082d-bf46-440f-9d5f-424241f04c38 => generated 1659 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 10:50:03.135867 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [req-012d2ef8-c6cb-4379-97de-c351a9b8c442 req-c4f1c4b6-3d83-4c20-9d71-83434d84f649 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "825f082d-bf46-440f-9d5f-424241f04c38", "name": "network-vif-deleted", "tag": "f83f40cc-fa5c-4346-aa16-153595a2f799"}]} {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:50:03.147046 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [req-012d2ef8-c6cb-4379-97de-c351a9b8c442 req-c4f1c4b6-3d83-4c20-9d71-83434d84f649 service nova] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:50:03.147622 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [req-012d2ef8-c6cb-4379-97de-c351a9b8c442 req-c4f1c4b6-3d83-4c20-9d71-83434d84f649 service nova] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:50:03.164692 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.compute.server_external_events [req-012d2ef8-c6cb-4379-97de-c351a9b8c442 req-c4f1c4b6-3d83-4c20-9d71-83434d84f649 service nova] Creating event network-vif-deleted:f83f40cc-fa5c-4346-aa16-153595a2f799 for instance 825f082d-bf46-440f-9d5f-424241f04c38 on hv-cinder-85200 Aug 04 10:50:03.171463 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [req-012d2ef8-c6cb-4379-97de-c351a9b8c442 req-c4f1c4b6-3d83-4c20-9d71-83434d84f649 service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.165768 Aug 04 10:50:03.172683 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 574/1145] 10.222.0.121 () {64 vars in 1322 bytes} [Thu Aug 4 10:50:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:50:04.120468 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-5eebb7ae-6326-4452-ba15-144605fc2916 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:50:04.123768 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-5eebb7ae-6326-4452-ba15-144605fc2916 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] [instance: 825f082d-bf46-440f-9d5f-424241f04c38] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:50:04.131444 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-5eebb7ae-6326-4452-ba15-144605fc2916 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:50:04.131904 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-5eebb7ae-6326-4452-ba15-144605fc2916 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:50:04.132797 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-5eebb7ae-6326-4452-ba15-144605fc2916 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:50:04.133221 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-5eebb7ae-6326-4452-ba15-144605fc2916 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:50:04.151165 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.wsgi [None req-5eebb7ae-6326-4452-ba15-144605fc2916 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] HTTP exception thrown: Instance 825f082d-bf46-440f-9d5f-424241f04c38 could not be found. Aug 04 10:50:04.152771 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-5eebb7ae-6326-4452-ba15-144605fc2916 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Request method failure captured: Aug 04 10:50:04.152771 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: request: GET /compute/v2.1/servers/825f082d-bf46-440f-9d5f-424241f04c38 HTTP/1.1 Aug 04 10:50:04.152771 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: Accept: application/json Aug 04 10:50:04.152771 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: Accept-Encoding: identity Aug 04 10:50:04.152771 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: Connection: close Aug 04 10:50:04.152771 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: Content-Length: 0 Aug 04 10:50:04.152771 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: Content-Type: application/json Aug 04 10:50:04.152771 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: Host: 10.222.0.121 Aug 04 10:50:04.152771 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: Openstack-System-Scope: None Aug 04 10:50:04.152771 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: User-Agent: python-urllib3/1.26.11 Aug 04 10:50:04.152771 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Auth-Token: gAAAAABi66KV7b1Y_j4kdGqXsQGrCsyrMvYeNIyDM37JsB_tbsGBeodavgBf1gb7117EW3-BIqFTnIsdi1M4YkklBwFtZnK-pFDxRPpn7avu3xKkfr_bwzIyWL0oK7-iXJPlJGLeGliqWHjTKoBafP2EyD8nNI1ca96zThoqRI4TjZhVpSk8_CM Aug 04 10:50:04.152771 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Domain-Id: None Aug 04 10:50:04.152771 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Domain-Name: None Aug 04 10:50:04.152771 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Identity-Status: Confirmed Aug 04 10:50:04.152771 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Is-Admin-Project: True Aug 04 10:50:04.152771 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Openstack-Nova-Api-Version: 2.20 Aug 04 10:50:04.152771 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Project-Domain-Id: default Aug 04 10:50:04.152771 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Project-Domain-Name: Default Aug 04 10:50:04.152771 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Project-Id: 18d95fd38a664ce1b69afbb11189020a Aug 04 10:50:04.152771 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1397441079 Aug 04 10:50:04.152771 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Role: reader,member Aug 04 10:50:04.152771 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Roles: reader,member Aug 04 10:50:04.154721 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/18d95fd38a664ce1b69afbb11189020a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/18d95fd38a664ce1b69afbb11189020a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.121:8080", "publicURL": "http://10.222.0.121:8080/v1/AUTH_18d95fd38a664ce1b69afbb11189020a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2/18d95fd38a664ce1b69afbb11189020a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:9696/networking"}]}] Aug 04 10:50:04.154721 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1397441079 Aug 04 10:50:04.154721 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Tenant-Id: 18d95fd38a664ce1b69afbb11189020a Aug 04 10:50:04.154721 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1397441079 Aug 04 10:50:04.154721 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-User: tempest-AttachVolumeShelveTestJSON-1397441079-project Aug 04 10:50:04.154721 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-User-Domain-Id: default Aug 04 10:50:04.154721 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-User-Domain-Name: Default Aug 04 10:50:04.154721 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-User-Id: f2c14f2350dd450b846db0c22c43688b Aug 04 10:50:04.154721 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1397441079-project Aug 04 10:50:04.154721 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: method: > Aug 04 10:50:04.154721 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: exception: Instance 825f082d-bf46-440f-9d5f-424241f04c38 could not be found. Aug 04 10:50:04.154721 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: action_args: {'id': '825f082d-bf46-440f-9d5f-424241f04c38'} Aug 04 10:50:04.155702 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 10:50:04.155702 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:50:04.155702 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 10:50:04.155702 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 10:50:04.155702 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 10:50:04.155702 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 10:50:04.155702 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 10:50:04.155702 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 10:50:04.155702 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 10:50:04.155702 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 10:50:04.155702 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 825f082d-bf46-440f-9d5f-424241f04c38 could not be found. Aug 04 10:50:04.155702 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi Aug 04 10:50:04.155702 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:50:04.155702 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi Aug 04 10:50:04.155702 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:50:04.155702 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:50:04.155702 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:50:04.155702 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 10:50:04.155702 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 10:50:04.155702 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 10:50:04.157387 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 10:50:04.157387 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 10:50:04.157387 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 10:50:04.157387 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 10:50:04.157387 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 10:50:04.157387 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 10:50:04.157387 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 10:50:04.157387 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 825f082d-bf46-440f-9d5f-424241f04c38 could not be found. Aug 04 10:50:04.157387 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi Aug 04 10:50:04.157387 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:50:04.157387 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi Aug 04 10:50:04.157387 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:50:04.157387 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:50:04.157387 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:50:04.157387 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 10:50:04.157387 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 10:50:04.157387 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 825f082d-bf46-440f-9d5f-424241f04c38 could not be found. Aug 04 10:50:04.157387 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi Aug 04 10:50:04.158804 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-5eebb7ae-6326-4452-ba15-144605fc2916 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Returning 404 to user: Instance 825f082d-bf46-440f-9d5f-424241f04c38 could not be found. {{(pid=124456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 10:50:04.158804 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-5eebb7ae-6326-4452-ba15-144605fc2916 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] 10.222.0.121 "GET /compute/v2.1/servers/825f082d-bf46-440f-9d5f-424241f04c38" status: 404 len: 111 microversion: 2.20 time: 0.038787 Aug 04 10:50:04.158804 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 572/1146] 10.222.0.121 () {60 vars in 1282 bytes} [Thu Aug 4 10:50:04 2022] GET /compute/v2.1/servers/825f082d-bf46-440f-9d5f-424241f04c38 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 04 10:50:04.167069 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-caba8586-6acb-4abf-a339-a06181698ec7 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Calling method '.version_select at 0x7f6754e369d0>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:50:04.195756 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-caba8586-6acb-4abf-a339-a06181698ec7 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] 10.222.0.121 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1602391143" status: 204 len: 0 microversion: 2.20 time: 0.034663 Aug 04 10:50:04.196427 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 575/1147] 10.222.0.121 () {60 vars in 1267 bytes} [Thu Aug 4 10:50:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1602391143 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 04 10:50:06.082406 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-67eb80c8-f190-48d5-b93d-859b60275e66 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:50:06.083053 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-67eb80c8-f190-48d5-b93d-859b60275e66 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] [instance: 825f082d-bf46-440f-9d5f-424241f04c38] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:50:06.090496 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-67eb80c8-f190-48d5-b93d-859b60275e66 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:50:06.090980 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-67eb80c8-f190-48d5-b93d-859b60275e66 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:50:06.092162 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-67eb80c8-f190-48d5-b93d-859b60275e66 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:50:06.092801 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-67eb80c8-f190-48d5-b93d-859b60275e66 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:50:06.109221 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.wsgi [None req-67eb80c8-f190-48d5-b93d-859b60275e66 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] HTTP exception thrown: Instance 825f082d-bf46-440f-9d5f-424241f04c38 could not be found. Aug 04 10:50:06.118119 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-67eb80c8-f190-48d5-b93d-859b60275e66 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Request method failure captured: Aug 04 10:50:06.118119 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: request: DELETE /compute/v2.1/servers/825f082d-bf46-440f-9d5f-424241f04c38 HTTP/1.1 Aug 04 10:50:06.118119 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: Accept: application/json Aug 04 10:50:06.118119 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: Accept-Encoding: identity Aug 04 10:50:06.118119 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: Connection: close Aug 04 10:50:06.118119 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: Content-Length: 0 Aug 04 10:50:06.118119 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: Content-Type: application/json Aug 04 10:50:06.118119 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: Host: 10.222.0.121 Aug 04 10:50:06.118119 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: Openstack-System-Scope: None Aug 04 10:50:06.118119 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: User-Agent: python-urllib3/1.26.11 Aug 04 10:50:06.118119 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Auth-Token: gAAAAABi66KV7b1Y_j4kdGqXsQGrCsyrMvYeNIyDM37JsB_tbsGBeodavgBf1gb7117EW3-BIqFTnIsdi1M4YkklBwFtZnK-pFDxRPpn7avu3xKkfr_bwzIyWL0oK7-iXJPlJGLeGliqWHjTKoBafP2EyD8nNI1ca96zThoqRI4TjZhVpSk8_CM Aug 04 10:50:06.118119 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Domain-Id: None Aug 04 10:50:06.118119 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Domain-Name: None Aug 04 10:50:06.118119 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Identity-Status: Confirmed Aug 04 10:50:06.118119 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Is-Admin-Project: True Aug 04 10:50:06.118119 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Openstack-Nova-Api-Version: 2.20 Aug 04 10:50:06.118119 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Project-Domain-Id: default Aug 04 10:50:06.118119 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Project-Domain-Name: Default Aug 04 10:50:06.118119 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Project-Id: 18d95fd38a664ce1b69afbb11189020a Aug 04 10:50:06.118119 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1397441079 Aug 04 10:50:06.118119 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Role: reader,member Aug 04 10:50:06.118119 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Roles: reader,member Aug 04 10:50:06.120197 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/18d95fd38a664ce1b69afbb11189020a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/18d95fd38a664ce1b69afbb11189020a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.121:8080", "publicURL": "http://10.222.0.121:8080/v1/AUTH_18d95fd38a664ce1b69afbb11189020a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2/18d95fd38a664ce1b69afbb11189020a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:9696/networking"}]}] Aug 04 10:50:06.120197 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1397441079 Aug 04 10:50:06.120197 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Tenant-Id: 18d95fd38a664ce1b69afbb11189020a Aug 04 10:50:06.120197 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1397441079 Aug 04 10:50:06.120197 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-User: tempest-AttachVolumeShelveTestJSON-1397441079-project Aug 04 10:50:06.120197 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-User-Domain-Id: default Aug 04 10:50:06.120197 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-User-Domain-Name: Default Aug 04 10:50:06.120197 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-User-Id: f2c14f2350dd450b846db0c22c43688b Aug 04 10:50:06.120197 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1397441079-project Aug 04 10:50:06.120197 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: method: > Aug 04 10:50:06.120197 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: exception: Instance 825f082d-bf46-440f-9d5f-424241f04c38 could not be found. Aug 04 10:50:06.120197 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: action_args: {'id': '825f082d-bf46-440f-9d5f-424241f04c38'} Aug 04 10:50:06.121609 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 10:50:06.121609 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:50:06.121609 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 10:50:06.121609 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 10:50:06.121609 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 10:50:06.121609 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 10:50:06.121609 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 10:50:06.121609 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 10:50:06.121609 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 10:50:06.121609 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 10:50:06.121609 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 825f082d-bf46-440f-9d5f-424241f04c38 could not be found. Aug 04 10:50:06.121609 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi Aug 04 10:50:06.121609 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:50:06.121609 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi Aug 04 10:50:06.121609 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:50:06.121609 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:50:06.121609 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:50:06.121609 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 10:50:06.121609 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 10:50:06.121609 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 10:50:06.123163 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 10:50:06.123163 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 10:50:06.123163 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 10:50:06.123163 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 10:50:06.123163 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 10:50:06.123163 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 10:50:06.123163 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 10:50:06.123163 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 10:50:06.123163 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 10:50:06.123163 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 825f082d-bf46-440f-9d5f-424241f04c38 could not be found. Aug 04 10:50:06.123163 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi Aug 04 10:50:06.123163 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:50:06.123163 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi Aug 04 10:50:06.123163 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:50:06.123163 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:50:06.123163 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:50:06.123163 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 10:50:06.123163 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 10:50:06.123163 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 825f082d-bf46-440f-9d5f-424241f04c38 could not be found. Aug 04 10:50:06.123163 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi Aug 04 10:50:06.124955 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-67eb80c8-f190-48d5-b93d-859b60275e66 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Returning 404 to user: Instance 825f082d-bf46-440f-9d5f-424241f04c38 could not be found. {{(pid=124456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 10:50:06.124955 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-67eb80c8-f190-48d5-b93d-859b60275e66 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] 10.222.0.121 "DELETE /compute/v2.1/servers/825f082d-bf46-440f-9d5f-424241f04c38" status: 404 len: 111 microversion: 2.20 time: 0.034155 Aug 04 10:50:06.124955 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 573/1148] 10.222.0.121 () {60 vars in 1285 bytes} [Thu Aug 4 10:50:06 2022] DELETE /compute/v2.1/servers/825f082d-bf46-440f-9d5f-424241f04c38 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 04 10:50:06.125257 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-1d2a29c8-2ad5-4ca7-8d61-9edb4e84d9ed tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:50:06.125257 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-1d2a29c8-2ad5-4ca7-8d61-9edb4e84d9ed tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] [instance: 825f082d-bf46-440f-9d5f-424241f04c38] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:50:06.135115 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-1d2a29c8-2ad5-4ca7-8d61-9edb4e84d9ed tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:50:06.135786 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-1d2a29c8-2ad5-4ca7-8d61-9edb4e84d9ed tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:50:06.136888 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-1d2a29c8-2ad5-4ca7-8d61-9edb4e84d9ed tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:50:06.137391 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-1d2a29c8-2ad5-4ca7-8d61-9edb4e84d9ed tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:50:06.153529 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.wsgi [None req-1d2a29c8-2ad5-4ca7-8d61-9edb4e84d9ed tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] HTTP exception thrown: Instance 825f082d-bf46-440f-9d5f-424241f04c38 could not be found. Aug 04 10:50:06.155294 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-1d2a29c8-2ad5-4ca7-8d61-9edb4e84d9ed tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Request method failure captured: Aug 04 10:50:06.155294 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: request: GET /compute/v2.1/servers/825f082d-bf46-440f-9d5f-424241f04c38 HTTP/1.1 Aug 04 10:50:06.155294 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: Accept: application/json Aug 04 10:50:06.155294 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: Accept-Encoding: identity Aug 04 10:50:06.155294 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: Connection: close Aug 04 10:50:06.155294 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: Content-Length: 0 Aug 04 10:50:06.155294 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: Content-Type: application/json Aug 04 10:50:06.155294 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: Host: 10.222.0.121 Aug 04 10:50:06.155294 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: Openstack-System-Scope: None Aug 04 10:50:06.155294 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: User-Agent: python-urllib3/1.26.11 Aug 04 10:50:06.155294 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Auth-Token: gAAAAABi66KV7b1Y_j4kdGqXsQGrCsyrMvYeNIyDM37JsB_tbsGBeodavgBf1gb7117EW3-BIqFTnIsdi1M4YkklBwFtZnK-pFDxRPpn7avu3xKkfr_bwzIyWL0oK7-iXJPlJGLeGliqWHjTKoBafP2EyD8nNI1ca96zThoqRI4TjZhVpSk8_CM Aug 04 10:50:06.155294 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Domain-Id: None Aug 04 10:50:06.155294 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Domain-Name: None Aug 04 10:50:06.155294 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Identity-Status: Confirmed Aug 04 10:50:06.155294 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Is-Admin-Project: True Aug 04 10:50:06.155294 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Openstack-Nova-Api-Version: 2.20 Aug 04 10:50:06.155294 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Project-Domain-Id: default Aug 04 10:50:06.155294 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Project-Domain-Name: Default Aug 04 10:50:06.155294 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Project-Id: 18d95fd38a664ce1b69afbb11189020a Aug 04 10:50:06.155294 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1397441079 Aug 04 10:50:06.155294 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Role: reader,member Aug 04 10:50:06.155294 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Roles: reader,member Aug 04 10:50:06.157092 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/18d95fd38a664ce1b69afbb11189020a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/18d95fd38a664ce1b69afbb11189020a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.121:8080", "publicURL": "http://10.222.0.121:8080/v1/AUTH_18d95fd38a664ce1b69afbb11189020a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2/18d95fd38a664ce1b69afbb11189020a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:9696/networking"}]}] Aug 04 10:50:06.157092 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1397441079 Aug 04 10:50:06.157092 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Tenant-Id: 18d95fd38a664ce1b69afbb11189020a Aug 04 10:50:06.157092 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1397441079 Aug 04 10:50:06.157092 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-User: tempest-AttachVolumeShelveTestJSON-1397441079-project Aug 04 10:50:06.157092 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-User-Domain-Id: default Aug 04 10:50:06.157092 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-User-Domain-Name: Default Aug 04 10:50:06.157092 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-User-Id: f2c14f2350dd450b846db0c22c43688b Aug 04 10:50:06.157092 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1397441079-project Aug 04 10:50:06.157092 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: method: > Aug 04 10:50:06.157092 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: exception: Instance 825f082d-bf46-440f-9d5f-424241f04c38 could not be found. Aug 04 10:50:06.157092 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: action_args: {'id': '825f082d-bf46-440f-9d5f-424241f04c38'} Aug 04 10:50:06.157948 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 10:50:06.157948 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:50:06.157948 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 10:50:06.157948 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 10:50:06.157948 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 10:50:06.157948 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 10:50:06.157948 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 10:50:06.157948 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 10:50:06.157948 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 10:50:06.157948 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 10:50:06.157948 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 825f082d-bf46-440f-9d5f-424241f04c38 could not be found. Aug 04 10:50:06.157948 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Aug 04 10:50:06.157948 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:50:06.157948 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Aug 04 10:50:06.157948 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:50:06.157948 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:50:06.157948 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:50:06.157948 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 10:50:06.157948 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 10:50:06.157948 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 10:50:06.159415 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 10:50:06.159415 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 10:50:06.159415 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 10:50:06.159415 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 10:50:06.159415 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 10:50:06.159415 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 10:50:06.159415 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 10:50:06.159415 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 825f082d-bf46-440f-9d5f-424241f04c38 could not be found. Aug 04 10:50:06.159415 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Aug 04 10:50:06.159415 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:50:06.159415 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Aug 04 10:50:06.159415 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:50:06.159415 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:50:06.159415 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:50:06.159415 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 10:50:06.159415 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 10:50:06.159415 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 825f082d-bf46-440f-9d5f-424241f04c38 could not be found. Aug 04 10:50:06.159415 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Aug 04 10:50:06.161224 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-1d2a29c8-2ad5-4ca7-8d61-9edb4e84d9ed tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Returning 404 to user: Instance 825f082d-bf46-440f-9d5f-424241f04c38 could not be found. {{(pid=124457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 10:50:06.161224 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-1d2a29c8-2ad5-4ca7-8d61-9edb4e84d9ed tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] 10.222.0.121 "GET /compute/v2.1/servers/825f082d-bf46-440f-9d5f-424241f04c38" status: 404 len: 111 microversion: 2.20 time: 0.038939 Aug 04 10:50:06.161224 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 576/1149] 10.222.0.121 () {60 vars in 1282 bytes} [Thu Aug 4 10:50:06 2022] GET /compute/v2.1/servers/825f082d-bf46-440f-9d5f-424241f04c38 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 04 10:50:07.338471 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-751a3435-853e-4b60-9239-9a361376d062 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:50:07.339535 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-751a3435-853e-4b60-9239-9a361376d062 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] [instance: b0d153c5-90d0-4814-92ec-6f237601def9] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:50:07.347149 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-751a3435-853e-4b60-9239-9a361376d062 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:50:07.347530 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-751a3435-853e-4b60-9239-9a361376d062 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:50:07.348291 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-751a3435-853e-4b60-9239-9a361376d062 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:50:07.348768 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-751a3435-853e-4b60-9239-9a361376d062 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:50:07.364399 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.wsgi [None req-751a3435-853e-4b60-9239-9a361376d062 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] HTTP exception thrown: Instance b0d153c5-90d0-4814-92ec-6f237601def9 could not be found. Aug 04 10:50:07.365954 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-751a3435-853e-4b60-9239-9a361376d062 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Request method failure captured: Aug 04 10:50:07.365954 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: request: DELETE /compute/v2.1/servers/b0d153c5-90d0-4814-92ec-6f237601def9 HTTP/1.1 Aug 04 10:50:07.365954 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: Accept: application/json Aug 04 10:50:07.365954 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: Accept-Encoding: identity Aug 04 10:50:07.365954 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: Connection: close Aug 04 10:50:07.365954 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: Content-Length: 0 Aug 04 10:50:07.365954 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: Content-Type: application/json Aug 04 10:50:07.365954 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: Host: 10.222.0.121 Aug 04 10:50:07.365954 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: Openstack-System-Scope: None Aug 04 10:50:07.365954 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: User-Agent: python-urllib3/1.26.11 Aug 04 10:50:07.365954 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Auth-Token: gAAAAABi66KV7b1Y_j4kdGqXsQGrCsyrMvYeNIyDM37JsB_tbsGBeodavgBf1gb7117EW3-BIqFTnIsdi1M4YkklBwFtZnK-pFDxRPpn7avu3xKkfr_bwzIyWL0oK7-iXJPlJGLeGliqWHjTKoBafP2EyD8nNI1ca96zThoqRI4TjZhVpSk8_CM Aug 04 10:50:07.365954 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Domain-Id: None Aug 04 10:50:07.365954 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Domain-Name: None Aug 04 10:50:07.365954 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Identity-Status: Confirmed Aug 04 10:50:07.365954 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Is-Admin-Project: True Aug 04 10:50:07.365954 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Openstack-Nova-Api-Version: 2.20 Aug 04 10:50:07.365954 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Project-Domain-Id: default Aug 04 10:50:07.365954 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Project-Domain-Name: Default Aug 04 10:50:07.365954 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Project-Id: 18d95fd38a664ce1b69afbb11189020a Aug 04 10:50:07.365954 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1397441079 Aug 04 10:50:07.365954 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Role: reader,member Aug 04 10:50:07.365954 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Roles: reader,member Aug 04 10:50:07.367753 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/18d95fd38a664ce1b69afbb11189020a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/18d95fd38a664ce1b69afbb11189020a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.121:8080", "publicURL": "http://10.222.0.121:8080/v1/AUTH_18d95fd38a664ce1b69afbb11189020a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2/18d95fd38a664ce1b69afbb11189020a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:9696/networking"}]}] Aug 04 10:50:07.367753 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1397441079 Aug 04 10:50:07.367753 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Tenant-Id: 18d95fd38a664ce1b69afbb11189020a Aug 04 10:50:07.367753 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1397441079 Aug 04 10:50:07.367753 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-User: tempest-AttachVolumeShelveTestJSON-1397441079-project Aug 04 10:50:07.367753 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-User-Domain-Id: default Aug 04 10:50:07.367753 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-User-Domain-Name: Default Aug 04 10:50:07.367753 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-User-Id: f2c14f2350dd450b846db0c22c43688b Aug 04 10:50:07.367753 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1397441079-project Aug 04 10:50:07.367753 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: method: > Aug 04 10:50:07.367753 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: exception: Instance b0d153c5-90d0-4814-92ec-6f237601def9 could not be found. Aug 04 10:50:07.367753 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: action_args: {'id': 'b0d153c5-90d0-4814-92ec-6f237601def9'} Aug 04 10:50:07.368649 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 10:50:07.368649 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:50:07.368649 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 10:50:07.368649 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 10:50:07.368649 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 10:50:07.368649 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 10:50:07.368649 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 10:50:07.368649 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 10:50:07.368649 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 10:50:07.368649 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 10:50:07.368649 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0d153c5-90d0-4814-92ec-6f237601def9 could not be found. Aug 04 10:50:07.368649 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi Aug 04 10:50:07.368649 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:50:07.368649 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi Aug 04 10:50:07.368649 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:50:07.368649 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:50:07.368649 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:50:07.368649 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 10:50:07.368649 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 10:50:07.368649 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 10:50:07.370237 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 10:50:07.370237 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 10:50:07.370237 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 10:50:07.370237 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 10:50:07.370237 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 10:50:07.370237 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 10:50:07.370237 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 10:50:07.370237 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 10:50:07.370237 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 10:50:07.370237 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0d153c5-90d0-4814-92ec-6f237601def9 could not be found. Aug 04 10:50:07.370237 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi Aug 04 10:50:07.370237 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:50:07.370237 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi Aug 04 10:50:07.370237 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:50:07.370237 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:50:07.370237 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:50:07.370237 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 10:50:07.370237 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 10:50:07.370237 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0d153c5-90d0-4814-92ec-6f237601def9 could not be found. Aug 04 10:50:07.370237 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi Aug 04 10:50:07.371642 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-751a3435-853e-4b60-9239-9a361376d062 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Returning 404 to user: Instance b0d153c5-90d0-4814-92ec-6f237601def9 could not be found. {{(pid=124456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 10:50:07.371642 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-751a3435-853e-4b60-9239-9a361376d062 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] 10.222.0.121 "DELETE /compute/v2.1/servers/b0d153c5-90d0-4814-92ec-6f237601def9" status: 404 len: 111 microversion: 2.20 time: 0.033279 Aug 04 10:50:07.371642 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 574/1150] 10.222.0.121 () {60 vars in 1285 bytes} [Thu Aug 4 10:50:07 2022] DELETE /compute/v2.1/servers/b0d153c5-90d0-4814-92ec-6f237601def9 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 04 10:50:07.381215 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-0530a131-d6e3-4a40-a893-43c579b037c3 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:50:07.381966 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-0530a131-d6e3-4a40-a893-43c579b037c3 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] [instance: b0d153c5-90d0-4814-92ec-6f237601def9] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:50:07.389378 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-0530a131-d6e3-4a40-a893-43c579b037c3 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:50:07.389834 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-0530a131-d6e3-4a40-a893-43c579b037c3 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:50:07.392232 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-0530a131-d6e3-4a40-a893-43c579b037c3 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:50:07.392232 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-0530a131-d6e3-4a40-a893-43c579b037c3 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:50:07.414016 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.wsgi [None req-0530a131-d6e3-4a40-a893-43c579b037c3 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] HTTP exception thrown: Instance b0d153c5-90d0-4814-92ec-6f237601def9 could not be found. Aug 04 10:50:07.415673 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-0530a131-d6e3-4a40-a893-43c579b037c3 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Request method failure captured: Aug 04 10:50:07.415673 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: request: GET /compute/v2.1/servers/b0d153c5-90d0-4814-92ec-6f237601def9 HTTP/1.1 Aug 04 10:50:07.415673 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: Accept: application/json Aug 04 10:50:07.415673 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: Accept-Encoding: identity Aug 04 10:50:07.415673 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: Connection: close Aug 04 10:50:07.415673 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: Content-Length: 0 Aug 04 10:50:07.415673 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: Content-Type: application/json Aug 04 10:50:07.415673 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: Host: 10.222.0.121 Aug 04 10:50:07.415673 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: Openstack-System-Scope: None Aug 04 10:50:07.415673 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: User-Agent: python-urllib3/1.26.11 Aug 04 10:50:07.415673 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Auth-Token: gAAAAABi66KV7b1Y_j4kdGqXsQGrCsyrMvYeNIyDM37JsB_tbsGBeodavgBf1gb7117EW3-BIqFTnIsdi1M4YkklBwFtZnK-pFDxRPpn7avu3xKkfr_bwzIyWL0oK7-iXJPlJGLeGliqWHjTKoBafP2EyD8nNI1ca96zThoqRI4TjZhVpSk8_CM Aug 04 10:50:07.415673 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Domain-Id: None Aug 04 10:50:07.415673 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Domain-Name: None Aug 04 10:50:07.415673 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Identity-Status: Confirmed Aug 04 10:50:07.415673 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Is-Admin-Project: True Aug 04 10:50:07.415673 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Openstack-Nova-Api-Version: 2.20 Aug 04 10:50:07.415673 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Project-Domain-Id: default Aug 04 10:50:07.415673 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Project-Domain-Name: Default Aug 04 10:50:07.415673 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Project-Id: 18d95fd38a664ce1b69afbb11189020a Aug 04 10:50:07.415673 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1397441079 Aug 04 10:50:07.415673 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Role: reader,member Aug 04 10:50:07.415673 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Roles: reader,member Aug 04 10:50:07.418660 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/18d95fd38a664ce1b69afbb11189020a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/18d95fd38a664ce1b69afbb11189020a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.121:8080", "publicURL": "http://10.222.0.121:8080/v1/AUTH_18d95fd38a664ce1b69afbb11189020a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2/18d95fd38a664ce1b69afbb11189020a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:9696/networking"}]}] Aug 04 10:50:07.418660 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1397441079 Aug 04 10:50:07.418660 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Tenant-Id: 18d95fd38a664ce1b69afbb11189020a Aug 04 10:50:07.418660 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1397441079 Aug 04 10:50:07.418660 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-User: tempest-AttachVolumeShelveTestJSON-1397441079-project Aug 04 10:50:07.418660 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-User-Domain-Id: default Aug 04 10:50:07.418660 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-User-Domain-Name: Default Aug 04 10:50:07.418660 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-User-Id: f2c14f2350dd450b846db0c22c43688b Aug 04 10:50:07.418660 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1397441079-project Aug 04 10:50:07.418660 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: method: > Aug 04 10:50:07.418660 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: exception: Instance b0d153c5-90d0-4814-92ec-6f237601def9 could not be found. Aug 04 10:50:07.418660 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: action_args: {'id': 'b0d153c5-90d0-4814-92ec-6f237601def9'} Aug 04 10:50:07.420383 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 10:50:07.420383 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:50:07.420383 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 10:50:07.420383 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 10:50:07.420383 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 10:50:07.420383 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 10:50:07.420383 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 10:50:07.420383 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 10:50:07.420383 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 10:50:07.420383 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 10:50:07.420383 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0d153c5-90d0-4814-92ec-6f237601def9 could not be found. Aug 04 10:50:07.420383 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Aug 04 10:50:07.420383 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:50:07.420383 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Aug 04 10:50:07.420383 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:50:07.420383 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:50:07.420383 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:50:07.420383 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 10:50:07.420383 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 10:50:07.420383 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 10:50:07.423176 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 10:50:07.423176 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 10:50:07.423176 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 10:50:07.423176 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 10:50:07.423176 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 10:50:07.423176 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 10:50:07.423176 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 10:50:07.423176 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0d153c5-90d0-4814-92ec-6f237601def9 could not be found. Aug 04 10:50:07.423176 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Aug 04 10:50:07.423176 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:50:07.423176 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Aug 04 10:50:07.423176 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:50:07.423176 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:50:07.423176 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:50:07.423176 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 10:50:07.423176 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 10:50:07.423176 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0d153c5-90d0-4814-92ec-6f237601def9 could not be found. Aug 04 10:50:07.423176 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Aug 04 10:50:07.426260 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-0530a131-d6e3-4a40-a893-43c579b037c3 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] Returning 404 to user: Instance b0d153c5-90d0-4814-92ec-6f237601def9 could not be found. {{(pid=124457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 10:50:07.426260 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-0530a131-d6e3-4a40-a893-43c579b037c3 tempest-AttachVolumeShelveTestJSON-1397441079 tempest-AttachVolumeShelveTestJSON-1397441079-project] 10.222.0.121 "GET /compute/v2.1/servers/b0d153c5-90d0-4814-92ec-6f237601def9" status: 404 len: 111 microversion: 2.20 time: 0.040286 Aug 04 10:50:07.426260 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 577/1151] 10.222.0.121 () {60 vars in 1282 bytes} [Thu Aug 4 10:50:07 2022] GET /compute/v2.1/servers/b0d153c5-90d0-4814-92ec-6f237601def9 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 04 10:50:55.504275 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-fc19cc40-0be9-435a-9e3f-2d83bed5317d tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Action: 'create', calling method: .version_select at 0x7f6754ee55e0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-756766779", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEAOM6FUUc7n/cvU2WPSyS/hgMft0p9Gn7XOfS8wmqwyXBA0dnvrxV1BU1XHHlbMm0nGI0JMRw12kXPrA9gJjuO5EpG7e6cTgocR6EwxuFiXA7r1z6yiYLCrMT/Pf/9eKA=="}} {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:50:55.510276 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG dbcounter [-] [124456] Writing DB stats nova_api:SELECT=12 {{(pid=124456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:50:55.510957 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG dbcounter [-] [124456] Writing DB stats nova_cell1:SELECT=24 {{(pid=124456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:50:55.529270 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.quota [None req-fc19cc40-0be9-435a-9e3f-2d83bed5317d tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Getting quotas for project 9a6e2ee8a698471faedbb97fb2b936cd. Resources: {'key_pairs'} {{(pid=124456) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 10:50:55.533801 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.quota [None req-fc19cc40-0be9-435a-9e3f-2d83bed5317d tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Getting quotas for user 26ad0a8e94ab4bcfa8b01dc16ad08b0f and project 9a6e2ee8a698471faedbb97fb2b936cd. Resources: {'key_pairs'} {{(pid=124456) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 10:50:55.565802 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-fc19cc40-0be9-435a-9e3f-2d83bed5317d tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] 10.222.0.121 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.065629 Aug 04 10:50:55.566457 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 575/1152] 10.222.0.121 () {60 vars in 1164 bytes} [Thu Aug 4 10:50:55 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:50:55.626409 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-d3274417-75a9-4cc6-9f3a-32167b532e29 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-892180671", "imageRef": "611660c8-6e82-4e50-bbfb-030ca8ba9c8e", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-756766779", "networks": [{"uuid": "b51a5320-724e-4090-b88f-fbe9e3613440"}]}} {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:50:55.642017 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG dbcounter [-] [124457] Writing DB stats nova_api:SELECT=18,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=124457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:50:55.643207 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG dbcounter [-] [124457] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:50:55.714733 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.network.neutron [None req-d3274417-75a9-4cc6-9f3a-32167b532e29 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] validate_networks() for [('b51a5320-724e-4090-b88f-fbe9e3613440', None, None, None, None, None)] {{(pid=124457) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 10:50:56.253542 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.virt.hardware [None req-d3274417-75a9-4cc6-9f3a-32167b532e29 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Flavor limits 0:0:0 {{(pid=124457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 10:50:56.253974 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.virt.hardware [None req-d3274417-75a9-4cc6-9f3a-32167b532e29 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Image limits 0:0:0 {{(pid=124457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 10:50:56.254457 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.virt.hardware [None req-d3274417-75a9-4cc6-9f3a-32167b532e29 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Flavor pref 0:0:0 {{(pid=124457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 10:50:56.254873 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.virt.hardware [None req-d3274417-75a9-4cc6-9f3a-32167b532e29 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Image pref 0:0:0 {{(pid=124457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 10:50:56.255340 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.virt.hardware [None req-d3274417-75a9-4cc6-9f3a-32167b532e29 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 10:50:56.265238 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-d3274417-75a9-4cc6-9f3a-32167b532e29 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:50:56.265693 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-d3274417-75a9-4cc6-9f3a-32167b532e29 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:50:56.266513 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-d3274417-75a9-4cc6-9f3a-32167b532e29 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:50:56.266957 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-d3274417-75a9-4cc6-9f3a-32167b532e29 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:50:56.284313 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.quota [None req-d3274417-75a9-4cc6-9f3a-32167b532e29 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Getting quotas for project 9a6e2ee8a698471faedbb97fb2b936cd. Resources: {'ram', 'instances', 'cores'} {{(pid=124457) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 10:50:56.288384 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.quota [None req-d3274417-75a9-4cc6-9f3a-32167b532e29 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Getting quotas for user 26ad0a8e94ab4bcfa8b01dc16ad08b0f and project 9a6e2ee8a698471faedbb97fb2b936cd. Resources: {'ram', 'instances', 'cores'} {{(pid=124457) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 10:50:56.300974 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-d3274417-75a9-4cc6-9f3a-32167b532e29 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Going to run 1 instances... {{(pid=124457) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 10:50:56.303270 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-d3274417-75a9-4cc6-9f3a-32167b532e29 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] [instance: 60fd5618-274c-47e7-8c16-440d30c5f0a7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='611660c8-6e82-4e50-bbfb-030ca8ba9c8e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124457) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 10:50:56.353803 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-d3274417-75a9-4cc6-9f3a-32167b532e29 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] 10.222.0.121 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 0.735654 Aug 04 10:50:56.354493 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 578/1153] 10.222.0.121 () {60 vars in 1152 bytes} [Thu Aug 4 10:50:55 2022] POST /compute/v2.1/servers => generated 382 bytes in 738 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 04 10:50:56.365946 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-e038c160-1363-41d8-823b-23fd6e6c8aa8 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:50:56.366698 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-e038c160-1363-41d8-823b-23fd6e6c8aa8 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] [instance: 60fd5618-274c-47e7-8c16-440d30c5f0a7] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:50:56.430676 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-e038c160-1363-41d8-823b-23fd6e6c8aa8 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26ad0a8e94ab4bcfa8b01dc16ad08b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a6e2ee8a698471faedbb97fb2b936cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:50:56.438884 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-e038c160-1363-41d8-823b-23fd6e6c8aa8 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] 10.222.0.121 "GET /compute/v2.1/servers/60fd5618-274c-47e7-8c16-440d30c5f0a7" status: 200 len: 1261 microversion: 2.1 time: 0.077059 Aug 04 10:50:56.439345 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 576/1154] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:50:56 2022] GET /compute/v2.1/servers/60fd5618-274c-47e7-8c16-440d30c5f0a7 => generated 1261 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:50:57.459965 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-fe9fb613-c0cf-4a27-9495-b84ce1db7190 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:50:57.460772 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-fe9fb613-c0cf-4a27-9495-b84ce1db7190 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] [instance: 60fd5618-274c-47e7-8c16-440d30c5f0a7] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:50:57.468986 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-fe9fb613-c0cf-4a27-9495-b84ce1db7190 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:50:57.469454 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-fe9fb613-c0cf-4a27-9495-b84ce1db7190 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:50:57.470264 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-fe9fb613-c0cf-4a27-9495-b84ce1db7190 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:50:57.470697 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-fe9fb613-c0cf-4a27-9495-b84ce1db7190 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:50:57.543013 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-fe9fb613-c0cf-4a27-9495-b84ce1db7190 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26ad0a8e94ab4bcfa8b01dc16ad08b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a6e2ee8a698471faedbb97fb2b936cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:50:57.551648 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-fe9fb613-c0cf-4a27-9495-b84ce1db7190 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] 10.222.0.121 "GET /compute/v2.1/servers/60fd5618-274c-47e7-8c16-440d30c5f0a7" status: 200 len: 1313 microversion: 2.1 time: 0.096388 Aug 04 10:50:57.552294 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 579/1155] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:50:57 2022] GET /compute/v2.1/servers/60fd5618-274c-47e7-8c16-440d30c5f0a7 => generated 1313 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:50:58.575426 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-04a9a20e-6f65-45a6-8d86-32332f285004 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:50:58.576382 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-04a9a20e-6f65-45a6-8d86-32332f285004 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] [instance: 60fd5618-274c-47e7-8c16-440d30c5f0a7] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:50:58.597101 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-04a9a20e-6f65-45a6-8d86-32332f285004 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:50:58.597926 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-04a9a20e-6f65-45a6-8d86-32332f285004 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:50:58.599122 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-04a9a20e-6f65-45a6-8d86-32332f285004 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:50:58.599792 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-04a9a20e-6f65-45a6-8d86-32332f285004 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:50:58.844143 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-04a9a20e-6f65-45a6-8d86-32332f285004 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26ad0a8e94ab4bcfa8b01dc16ad08b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a6e2ee8a698471faedbb97fb2b936cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:50:58.852227 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-04a9a20e-6f65-45a6-8d86-32332f285004 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] 10.222.0.121 "GET /compute/v2.1/servers/60fd5618-274c-47e7-8c16-440d30c5f0a7" status: 200 len: 1361 microversion: 2.1 time: 0.282116 Aug 04 10:50:58.852821 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 577/1156] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:50:58 2022] GET /compute/v2.1/servers/60fd5618-274c-47e7-8c16-440d30c5f0a7 => generated 1361 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:50:59.874346 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-c2bbc914-6f6d-41db-84eb-ed8c502c609a tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:50:59.875023 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-c2bbc914-6f6d-41db-84eb-ed8c502c609a tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] [instance: 60fd5618-274c-47e7-8c16-440d30c5f0a7] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:50:59.882631 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-c2bbc914-6f6d-41db-84eb-ed8c502c609a tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:50:59.883206 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-c2bbc914-6f6d-41db-84eb-ed8c502c609a tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:50:59.884323 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-c2bbc914-6f6d-41db-84eb-ed8c502c609a tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:50:59.885065 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-c2bbc914-6f6d-41db-84eb-ed8c502c609a tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:51:00.059234 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-c2bbc914-6f6d-41db-84eb-ed8c502c609a tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26ad0a8e94ab4bcfa8b01dc16ad08b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a6e2ee8a698471faedbb97fb2b936cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:51:00.067539 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-c2bbc914-6f6d-41db-84eb-ed8c502c609a tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] 10.222.0.121 "GET /compute/v2.1/servers/60fd5618-274c-47e7-8c16-440d30c5f0a7" status: 200 len: 1361 microversion: 2.1 time: 0.197372 Aug 04 10:51:00.068185 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 580/1157] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:50:59 2022] GET /compute/v2.1/servers/60fd5618-274c-47e7-8c16-440d30c5f0a7 => generated 1361 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:51:01.089836 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-4768064e-8cd1-4cdb-91fc-ca96333c6f86 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:51:01.090529 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-4768064e-8cd1-4cdb-91fc-ca96333c6f86 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] [instance: 60fd5618-274c-47e7-8c16-440d30c5f0a7] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:51:01.102396 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-4768064e-8cd1-4cdb-91fc-ca96333c6f86 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:51:01.103005 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-4768064e-8cd1-4cdb-91fc-ca96333c6f86 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:51:01.103686 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-4768064e-8cd1-4cdb-91fc-ca96333c6f86 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:51:01.104175 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-4768064e-8cd1-4cdb-91fc-ca96333c6f86 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:51:01.260696 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-4768064e-8cd1-4cdb-91fc-ca96333c6f86 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26ad0a8e94ab4bcfa8b01dc16ad08b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a6e2ee8a698471faedbb97fb2b936cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:51:01.269869 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-4768064e-8cd1-4cdb-91fc-ca96333c6f86 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] 10.222.0.121 "GET /compute/v2.1/servers/60fd5618-274c-47e7-8c16-440d30c5f0a7" status: 200 len: 1361 microversion: 2.1 time: 0.184445 Aug 04 10:51:01.270494 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 578/1158] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:51:01 2022] GET /compute/v2.1/servers/60fd5618-274c-47e7-8c16-440d30c5f0a7 => generated 1361 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:51:02.291355 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-25268fa8-f69e-415e-b902-2dd51be9e0a7 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:51:02.292868 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-25268fa8-f69e-415e-b902-2dd51be9e0a7 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] [instance: 60fd5618-274c-47e7-8c16-440d30c5f0a7] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:51:02.300762 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-25268fa8-f69e-415e-b902-2dd51be9e0a7 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:51:02.301329 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-25268fa8-f69e-415e-b902-2dd51be9e0a7 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:51:02.302224 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-25268fa8-f69e-415e-b902-2dd51be9e0a7 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:51:02.302960 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-25268fa8-f69e-415e-b902-2dd51be9e0a7 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:51:02.459403 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-25268fa8-f69e-415e-b902-2dd51be9e0a7 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26ad0a8e94ab4bcfa8b01dc16ad08b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a6e2ee8a698471faedbb97fb2b936cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:51:02.468718 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-25268fa8-f69e-415e-b902-2dd51be9e0a7 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] 10.222.0.121 "GET /compute/v2.1/servers/60fd5618-274c-47e7-8c16-440d30c5f0a7" status: 200 len: 1361 microversion: 2.1 time: 0.181366 Aug 04 10:51:02.469686 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 581/1159] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:51:02 2022] GET /compute/v2.1/servers/60fd5618-274c-47e7-8c16-440d30c5f0a7 => generated 1361 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:51:03.490897 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-245b83f0-2222-4a86-9507-853fb7855b95 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:51:03.491613 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-245b83f0-2222-4a86-9507-853fb7855b95 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] [instance: 60fd5618-274c-47e7-8c16-440d30c5f0a7] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:51:03.498953 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-245b83f0-2222-4a86-9507-853fb7855b95 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:51:03.499479 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-245b83f0-2222-4a86-9507-853fb7855b95 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:51:03.500317 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-245b83f0-2222-4a86-9507-853fb7855b95 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:51:03.500775 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-245b83f0-2222-4a86-9507-853fb7855b95 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:51:03.651200 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-245b83f0-2222-4a86-9507-853fb7855b95 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26ad0a8e94ab4bcfa8b01dc16ad08b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a6e2ee8a698471faedbb97fb2b936cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:51:03.661691 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-245b83f0-2222-4a86-9507-853fb7855b95 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] 10.222.0.121 "GET /compute/v2.1/servers/60fd5618-274c-47e7-8c16-440d30c5f0a7" status: 200 len: 1361 microversion: 2.1 time: 0.174895 Aug 04 10:51:03.668012 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 579/1160] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:51:03 2022] GET /compute/v2.1/servers/60fd5618-274c-47e7-8c16-440d30c5f0a7 => generated 1361 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:51:04.683844 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-6f4ba6ef-154d-4141-b956-7aa8b478702b tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:51:04.685455 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-6f4ba6ef-154d-4141-b956-7aa8b478702b tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] [instance: 60fd5618-274c-47e7-8c16-440d30c5f0a7] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:51:04.694307 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-6f4ba6ef-154d-4141-b956-7aa8b478702b tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:51:04.694841 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-6f4ba6ef-154d-4141-b956-7aa8b478702b tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:51:04.695719 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-6f4ba6ef-154d-4141-b956-7aa8b478702b tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:51:04.696520 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-6f4ba6ef-154d-4141-b956-7aa8b478702b tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:51:04.877714 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-6f4ba6ef-154d-4141-b956-7aa8b478702b tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26ad0a8e94ab4bcfa8b01dc16ad08b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a6e2ee8a698471faedbb97fb2b936cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:51:04.887178 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-6f4ba6ef-154d-4141-b956-7aa8b478702b tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] 10.222.0.121 "GET /compute/v2.1/servers/60fd5618-274c-47e7-8c16-440d30c5f0a7" status: 200 len: 1361 microversion: 2.1 time: 0.207489 Aug 04 10:51:04.887810 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 582/1161] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:51:04 2022] GET /compute/v2.1/servers/60fd5618-274c-47e7-8c16-440d30c5f0a7 => generated 1361 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:51:05.909441 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-23b1d069-decc-4bfa-af64-cd9f7ea3f9ad tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:51:05.910443 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-23b1d069-decc-4bfa-af64-cd9f7ea3f9ad tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] [instance: 60fd5618-274c-47e7-8c16-440d30c5f0a7] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:51:05.917408 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-23b1d069-decc-4bfa-af64-cd9f7ea3f9ad tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:51:05.917860 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-23b1d069-decc-4bfa-af64-cd9f7ea3f9ad tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:51:05.918651 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-23b1d069-decc-4bfa-af64-cd9f7ea3f9ad tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:51:05.919088 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-23b1d069-decc-4bfa-af64-cd9f7ea3f9ad tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:51:06.055378 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-23b1d069-decc-4bfa-af64-cd9f7ea3f9ad tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26ad0a8e94ab4bcfa8b01dc16ad08b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a6e2ee8a698471faedbb97fb2b936cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:51:06.063431 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-23b1d069-decc-4bfa-af64-cd9f7ea3f9ad tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] 10.222.0.121 "GET /compute/v2.1/servers/60fd5618-274c-47e7-8c16-440d30c5f0a7" status: 200 len: 1361 microversion: 2.1 time: 0.158168 Aug 04 10:51:06.064048 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 580/1162] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:51:05 2022] GET /compute/v2.1/servers/60fd5618-274c-47e7-8c16-440d30c5f0a7 => generated 1361 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:51:07.085410 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-e33564db-744c-4dd1-9010-5c85c5757fb3 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:51:07.086112 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-e33564db-744c-4dd1-9010-5c85c5757fb3 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] [instance: 60fd5618-274c-47e7-8c16-440d30c5f0a7] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:51:07.089081 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG dbcounter [-] [124457] Writing DB stats nova_cell0:SELECT=2 {{(pid=124457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:51:07.089810 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG dbcounter [-] [124457] Writing DB stats nova_cell0:SELECT=6 {{(pid=124457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:51:07.096668 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-e33564db-744c-4dd1-9010-5c85c5757fb3 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:51:07.097053 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-e33564db-744c-4dd1-9010-5c85c5757fb3 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:51:07.097855 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-e33564db-744c-4dd1-9010-5c85c5757fb3 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:51:07.098305 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-e33564db-744c-4dd1-9010-5c85c5757fb3 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:51:07.239532 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-e33564db-744c-4dd1-9010-5c85c5757fb3 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26ad0a8e94ab4bcfa8b01dc16ad08b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a6e2ee8a698471faedbb97fb2b936cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:51:07.247740 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-e33564db-744c-4dd1-9010-5c85c5757fb3 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] 10.222.0.121 "GET /compute/v2.1/servers/60fd5618-274c-47e7-8c16-440d30c5f0a7" status: 200 len: 1361 microversion: 2.1 time: 0.166519 Aug 04 10:51:07.248362 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 583/1163] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:51:07 2022] GET /compute/v2.1/servers/60fd5618-274c-47e7-8c16-440d30c5f0a7 => generated 1361 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:51:08.269264 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-345f9091-794e-47dc-b62e-b116134dd539 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:51:08.269926 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-345f9091-794e-47dc-b62e-b116134dd539 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] [instance: 60fd5618-274c-47e7-8c16-440d30c5f0a7] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:51:08.271914 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG dbcounter [-] [124456] Writing DB stats nova_cell0:SELECT=6 {{(pid=124456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:51:08.278398 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-345f9091-794e-47dc-b62e-b116134dd539 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:51:08.278835 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-345f9091-794e-47dc-b62e-b116134dd539 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:51:08.279616 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-345f9091-794e-47dc-b62e-b116134dd539 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:51:08.280090 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-345f9091-794e-47dc-b62e-b116134dd539 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:51:08.782737 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-345f9091-794e-47dc-b62e-b116134dd539 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26ad0a8e94ab4bcfa8b01dc16ad08b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a6e2ee8a698471faedbb97fb2b936cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:51:08.791862 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-345f9091-794e-47dc-b62e-b116134dd539 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] 10.222.0.121 "GET /compute/v2.1/servers/60fd5618-274c-47e7-8c16-440d30c5f0a7" status: 200 len: 1361 microversion: 2.1 time: 0.526860 Aug 04 10:51:08.792803 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 581/1164] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:51:08 2022] GET /compute/v2.1/servers/60fd5618-274c-47e7-8c16-440d30c5f0a7 => generated 1361 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:51:09.097918 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [req-25770dcd-3447-4916-a06f-6d86a60f63cf req-e4619d91-4dc9-4da4-ab4c-113f6ccee28b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "60fd5618-274c-47e7-8c16-440d30c5f0a7", "tag": "f2136cf7-e870-43e3-95a5-3ca15b097a1f"}]} {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:51:09.112584 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [req-25770dcd-3447-4916-a06f-6d86a60f63cf req-e4619d91-4dc9-4da4-ab4c-113f6ccee28b service nova] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:51:09.113562 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [req-25770dcd-3447-4916-a06f-6d86a60f63cf req-e4619d91-4dc9-4da4-ab4c-113f6ccee28b service nova] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:51:09.130302 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.compute.server_external_events [req-25770dcd-3447-4916-a06f-6d86a60f63cf req-e4619d91-4dc9-4da4-ab4c-113f6ccee28b service nova] Creating event network-changed:f2136cf7-e870-43e3-95a5-3ca15b097a1f for instance 60fd5618-274c-47e7-8c16-440d30c5f0a7 on hv-cinder-85200 Aug 04 10:51:09.137062 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [req-25770dcd-3447-4916-a06f-6d86a60f63cf req-e4619d91-4dc9-4da4-ab4c-113f6ccee28b service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043441 Aug 04 10:51:09.137707 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 584/1165] 10.222.0.121 () {64 vars in 1322 bytes} [Thu Aug 4 10:51:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:51:09.813882 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-2c8b8a59-1caa-423e-b395-9b69255f0a45 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:51:09.814524 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-2c8b8a59-1caa-423e-b395-9b69255f0a45 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] [instance: 60fd5618-274c-47e7-8c16-440d30c5f0a7] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:51:09.821945 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-2c8b8a59-1caa-423e-b395-9b69255f0a45 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:51:09.822484 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-2c8b8a59-1caa-423e-b395-9b69255f0a45 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:51:09.823668 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-2c8b8a59-1caa-423e-b395-9b69255f0a45 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:51:09.824177 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-2c8b8a59-1caa-423e-b395-9b69255f0a45 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:51:09.964592 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-2c8b8a59-1caa-423e-b395-9b69255f0a45 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26ad0a8e94ab4bcfa8b01dc16ad08b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a6e2ee8a698471faedbb97fb2b936cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:51:09.972624 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-2c8b8a59-1caa-423e-b395-9b69255f0a45 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] 10.222.0.121 "GET /compute/v2.1/servers/60fd5618-274c-47e7-8c16-440d30c5f0a7" status: 200 len: 1361 microversion: 2.1 time: 0.162986 Aug 04 10:51:09.973228 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 582/1166] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:51:09 2022] GET /compute/v2.1/servers/60fd5618-274c-47e7-8c16-440d30c5f0a7 => generated 1361 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:51:10.996244 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-013fe7d1-5a5f-41e1-b1bc-5ff4dd838655 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:51:10.996950 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-013fe7d1-5a5f-41e1-b1bc-5ff4dd838655 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] [instance: 60fd5618-274c-47e7-8c16-440d30c5f0a7] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:51:11.004631 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-013fe7d1-5a5f-41e1-b1bc-5ff4dd838655 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:51:11.005102 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-013fe7d1-5a5f-41e1-b1bc-5ff4dd838655 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:51:11.005897 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-013fe7d1-5a5f-41e1-b1bc-5ff4dd838655 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:51:11.006351 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-013fe7d1-5a5f-41e1-b1bc-5ff4dd838655 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:51:11.159041 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-013fe7d1-5a5f-41e1-b1bc-5ff4dd838655 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26ad0a8e94ab4bcfa8b01dc16ad08b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a6e2ee8a698471faedbb97fb2b936cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:51:11.167602 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-013fe7d1-5a5f-41e1-b1bc-5ff4dd838655 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] 10.222.0.121 "GET /compute/v2.1/servers/60fd5618-274c-47e7-8c16-440d30c5f0a7" status: 200 len: 1361 microversion: 2.1 time: 0.175757 Aug 04 10:51:11.168310 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 585/1167] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:51:10 2022] GET /compute/v2.1/servers/60fd5618-274c-47e7-8c16-440d30c5f0a7 => generated 1361 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:51:12.188599 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-992ead39-07e8-4c7b-b4cc-8f65eb5ef6bc tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:51:12.189281 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-992ead39-07e8-4c7b-b4cc-8f65eb5ef6bc tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] [instance: 60fd5618-274c-47e7-8c16-440d30c5f0a7] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:51:12.196611 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-992ead39-07e8-4c7b-b4cc-8f65eb5ef6bc tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:51:12.197079 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-992ead39-07e8-4c7b-b4cc-8f65eb5ef6bc tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:51:12.198126 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-992ead39-07e8-4c7b-b4cc-8f65eb5ef6bc tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:51:12.198632 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-992ead39-07e8-4c7b-b4cc-8f65eb5ef6bc tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:51:12.422422 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-992ead39-07e8-4c7b-b4cc-8f65eb5ef6bc tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26ad0a8e94ab4bcfa8b01dc16ad08b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a6e2ee8a698471faedbb97fb2b936cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:51:12.430646 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-992ead39-07e8-4c7b-b4cc-8f65eb5ef6bc tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] 10.222.0.121 "GET /compute/v2.1/servers/60fd5618-274c-47e7-8c16-440d30c5f0a7" status: 200 len: 1361 microversion: 2.1 time: 0.246029 Aug 04 10:51:12.431271 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 583/1168] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:51:12 2022] GET /compute/v2.1/servers/60fd5618-274c-47e7-8c16-440d30c5f0a7 => generated 1361 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:51:13.452075 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-50d406b9-12e4-423b-b4b1-285cf647ba5f tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:51:13.452787 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-50d406b9-12e4-423b-b4b1-285cf647ba5f tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] [instance: 60fd5618-274c-47e7-8c16-440d30c5f0a7] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:51:13.460115 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-50d406b9-12e4-423b-b4b1-285cf647ba5f tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:51:13.460580 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-50d406b9-12e4-423b-b4b1-285cf647ba5f tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:51:13.461406 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-50d406b9-12e4-423b-b4b1-285cf647ba5f tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:51:13.461858 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-50d406b9-12e4-423b-b4b1-285cf647ba5f tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:51:13.601703 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-50d406b9-12e4-423b-b4b1-285cf647ba5f tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26ad0a8e94ab4bcfa8b01dc16ad08b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a6e2ee8a698471faedbb97fb2b936cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:51:13.610096 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-50d406b9-12e4-423b-b4b1-285cf647ba5f tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] 10.222.0.121 "GET /compute/v2.1/servers/60fd5618-274c-47e7-8c16-440d30c5f0a7" status: 200 len: 1361 microversion: 2.1 time: 0.162343 Aug 04 10:51:13.610683 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 586/1169] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:51:13 2022] GET /compute/v2.1/servers/60fd5618-274c-47e7-8c16-440d30c5f0a7 => generated 1361 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:51:14.181435 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [req-92ded7fb-c4a5-4f2d-a1bc-0e946df5c117 req-6d769c90-a528-41c9-a392-461e838ab293 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60fd5618-274c-47e7-8c16-440d30c5f0a7", "name": "network-vif-plugged", "status": "completed", "tag": "f2136cf7-e870-43e3-95a5-3ca15b097a1f"}]} {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:51:14.191738 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [req-92ded7fb-c4a5-4f2d-a1bc-0e946df5c117 req-6d769c90-a528-41c9-a392-461e838ab293 service nova] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:51:14.192230 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [req-92ded7fb-c4a5-4f2d-a1bc-0e946df5c117 req-6d769c90-a528-41c9-a392-461e838ab293 service nova] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:51:14.204246 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.compute.server_external_events [req-92ded7fb-c4a5-4f2d-a1bc-0e946df5c117 req-6d769c90-a528-41c9-a392-461e838ab293 service nova] Creating event network-vif-plugged:f2136cf7-e870-43e3-95a5-3ca15b097a1f for instance 60fd5618-274c-47e7-8c16-440d30c5f0a7 on hv-cinder-85200 Aug 04 10:51:14.209949 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [req-92ded7fb-c4a5-4f2d-a1bc-0e946df5c117 req-6d769c90-a528-41c9-a392-461e838ab293 service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.158963 Aug 04 10:51:14.210605 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 584/1170] 10.222.0.121 () {64 vars in 1322 bytes} [Thu Aug 4 10:51:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:51:14.631635 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-dc86d55b-4a4c-4e33-8e56-d52d1a06b57b tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:51:14.632392 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-dc86d55b-4a4c-4e33-8e56-d52d1a06b57b tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] [instance: 60fd5618-274c-47e7-8c16-440d30c5f0a7] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:51:14.639495 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-dc86d55b-4a4c-4e33-8e56-d52d1a06b57b tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:51:14.639931 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-dc86d55b-4a4c-4e33-8e56-d52d1a06b57b tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:51:14.640765 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-dc86d55b-4a4c-4e33-8e56-d52d1a06b57b tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:51:14.641205 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-dc86d55b-4a4c-4e33-8e56-d52d1a06b57b tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:51:14.780993 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-dc86d55b-4a4c-4e33-8e56-d52d1a06b57b tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26ad0a8e94ab4bcfa8b01dc16ad08b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a6e2ee8a698471faedbb97fb2b936cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:51:14.789070 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-dc86d55b-4a4c-4e33-8e56-d52d1a06b57b tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] 10.222.0.121 "GET /compute/v2.1/servers/60fd5618-274c-47e7-8c16-440d30c5f0a7" status: 200 len: 1361 microversion: 2.1 time: 0.161704 Aug 04 10:51:14.790034 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 587/1171] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:51:14 2022] GET /compute/v2.1/servers/60fd5618-274c-47e7-8c16-440d30c5f0a7 => generated 1361 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:51:15.815565 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-3155debb-fcc9-42ca-ba67-5defbbfeef8b tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:51:15.816501 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-3155debb-fcc9-42ca-ba67-5defbbfeef8b tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] [instance: 60fd5618-274c-47e7-8c16-440d30c5f0a7] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:51:15.823842 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-3155debb-fcc9-42ca-ba67-5defbbfeef8b tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:51:15.824321 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-3155debb-fcc9-42ca-ba67-5defbbfeef8b tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:51:15.825108 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-3155debb-fcc9-42ca-ba67-5defbbfeef8b tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:51:15.825540 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-3155debb-fcc9-42ca-ba67-5defbbfeef8b tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:51:15.967757 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-3155debb-fcc9-42ca-ba67-5defbbfeef8b tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26ad0a8e94ab4bcfa8b01dc16ad08b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a6e2ee8a698471faedbb97fb2b936cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:51:15.976463 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-3155debb-fcc9-42ca-ba67-5defbbfeef8b tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] 10.222.0.121 "GET /compute/v2.1/servers/60fd5618-274c-47e7-8c16-440d30c5f0a7" status: 200 len: 1361 microversion: 2.1 time: 0.166343 Aug 04 10:51:15.977038 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 585/1172] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:51:15 2022] GET /compute/v2.1/servers/60fd5618-274c-47e7-8c16-440d30c5f0a7 => generated 1361 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:51:16.998914 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-62a79363-4b37-4348-a1f7-abfea5e59dc7 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:51:16.999553 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-62a79363-4b37-4348-a1f7-abfea5e59dc7 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] [instance: 60fd5618-274c-47e7-8c16-440d30c5f0a7] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:51:17.006830 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-62a79363-4b37-4348-a1f7-abfea5e59dc7 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:51:17.007288 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-62a79363-4b37-4348-a1f7-abfea5e59dc7 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:51:17.008127 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-62a79363-4b37-4348-a1f7-abfea5e59dc7 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:51:17.008578 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-62a79363-4b37-4348-a1f7-abfea5e59dc7 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:51:17.157569 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-62a79363-4b37-4348-a1f7-abfea5e59dc7 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26ad0a8e94ab4bcfa8b01dc16ad08b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a6e2ee8a698471faedbb97fb2b936cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:51:17.166105 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-62a79363-4b37-4348-a1f7-abfea5e59dc7 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] 10.222.0.121 "GET /compute/v2.1/servers/60fd5618-274c-47e7-8c16-440d30c5f0a7" status: 200 len: 1551 microversion: 2.1 time: 0.171490 Aug 04 10:51:17.166711 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 588/1173] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:51:16 2022] GET /compute/v2.1/servers/60fd5618-274c-47e7-8c16-440d30c5f0a7 => generated 1551 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:51:17.187048 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-78b86e1a-a79b-4fed-9726-3ab2fecced6b tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:51:17.187743 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-78b86e1a-a79b-4fed-9726-3ab2fecced6b tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] [instance: 60fd5618-274c-47e7-8c16-440d30c5f0a7] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:51:17.195302 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-78b86e1a-a79b-4fed-9726-3ab2fecced6b tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:51:17.195764 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-78b86e1a-a79b-4fed-9726-3ab2fecced6b tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:51:17.196616 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-78b86e1a-a79b-4fed-9726-3ab2fecced6b tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:51:17.197071 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-78b86e1a-a79b-4fed-9726-3ab2fecced6b tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:51:17.338909 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-78b86e1a-a79b-4fed-9726-3ab2fecced6b tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26ad0a8e94ab4bcfa8b01dc16ad08b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a6e2ee8a698471faedbb97fb2b936cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:51:17.347427 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-78b86e1a-a79b-4fed-9726-3ab2fecced6b tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] 10.222.0.121 "GET /compute/v2.1/servers/60fd5618-274c-47e7-8c16-440d30c5f0a7" status: 200 len: 1551 microversion: 2.1 time: 0.164366 Aug 04 10:51:17.348315 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 586/1174] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:51:17 2022] GET /compute/v2.1/servers/60fd5618-274c-47e7-8c16-440d30c5f0a7 => generated 1551 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:51:17.369034 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-4be88dcf-2eb0-44f0-950a-32dc786ae9c4 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:51:17.374062 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-4be88dcf-2eb0-44f0-950a-32dc786ae9c4 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '26ad0a8e94ab4bcfa8b01dc16ad08b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a6e2ee8a698471faedbb97fb2b936cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:51:17.374841 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-4be88dcf-2eb0-44f0-950a-32dc786ae9c4 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Searching by: {'deleted': False, 'project_id': '9a6e2ee8a698471faedbb97fb2b936cd'} {{(pid=124457) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 04 10:51:17.382820 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-4be88dcf-2eb0-44f0-950a-32dc786ae9c4 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:51:17.383271 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-4be88dcf-2eb0-44f0-950a-32dc786ae9c4 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:51:17.384135 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-4be88dcf-2eb0-44f0-950a-32dc786ae9c4 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:51:17.384572 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-4be88dcf-2eb0-44f0-950a-32dc786ae9c4 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:51:17.477133 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.multi_cell_list [None req-4be88dcf-2eb0-44f0-950a-32dc786ae9c4 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=124457) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 04 10:51:17.575104 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-4be88dcf-2eb0-44f0-950a-32dc786ae9c4 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] 10.222.0.121 "GET /compute/v2.1/servers" status: 200 len: 344 microversion: 2.1 time: 0.210076 Aug 04 10:51:17.575746 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 589/1175] 10.222.0.121 () {58 vars in 1130 bytes} [Thu Aug 4 10:51:17 2022] GET /compute/v2.1/servers => generated 344 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:51:17.588157 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-36ea787c-709c-4a11-b558-485564d3e835 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:51:17.588792 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-36ea787c-709c-4a11-b558-485564d3e835 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] [instance: 60fd5618-274c-47e7-8c16-440d30c5f0a7] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:51:17.595746 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-36ea787c-709c-4a11-b558-485564d3e835 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:51:17.596245 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-36ea787c-709c-4a11-b558-485564d3e835 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:51:17.597034 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-36ea787c-709c-4a11-b558-485564d3e835 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:51:17.597475 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-36ea787c-709c-4a11-b558-485564d3e835 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:51:17.741669 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-36ea787c-709c-4a11-b558-485564d3e835 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26ad0a8e94ab4bcfa8b01dc16ad08b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a6e2ee8a698471faedbb97fb2b936cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:51:17.750373 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-36ea787c-709c-4a11-b558-485564d3e835 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] 10.222.0.121 "GET /compute/v2.1/servers/60fd5618-274c-47e7-8c16-440d30c5f0a7" status: 200 len: 1551 microversion: 2.1 time: 0.166601 Aug 04 10:51:17.751076 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 587/1176] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:51:17 2022] GET /compute/v2.1/servers/60fd5618-274c-47e7-8c16-440d30c5f0a7 => generated 1551 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:51:19.334197 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-6db71708-c42a-4716-a130-0441e5d3ce2c tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8abbc747-d704-4236-bf1a-1af961cb59f2"}} {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:51:19.336705 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-6db71708-c42a-4716-a130-0441e5d3ce2c tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] [instance: 60fd5618-274c-47e7-8c16-440d30c5f0a7] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:51:19.344541 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-6db71708-c42a-4716-a130-0441e5d3ce2c tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:51:19.345009 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-6db71708-c42a-4716-a130-0441e5d3ce2c tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:51:19.345859 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-6db71708-c42a-4716-a130-0441e5d3ce2c tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:51:19.346266 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-6db71708-c42a-4716-a130-0441e5d3ce2c tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:51:19.636332 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-6db71708-c42a-4716-a130-0441e5d3ce2c tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] 10.222.0.121 "POST /compute/v2.1/servers/60fd5618-274c-47e7-8c16-440d30c5f0a7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.306093 Aug 04 10:51:19.636981 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 590/1177] 10.222.0.121 () {60 vars in 1328 bytes} [Thu Aug 4 10:51:19 2022] POST /compute/v2.1/servers/60fd5618-274c-47e7-8c16-440d30c5f0a7/os-volume_attachments => generated 194 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:51:25.278109 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 10:51:25.279133 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: Thu Aug 4 10:51:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 10:51:27.319867 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-a12b588b-2fe5-4e0b-ad5e-2408dcf6bab7 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:51:27.321203 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-a12b588b-2fe5-4e0b-ad5e-2408dcf6bab7 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] [instance: 60fd5618-274c-47e7-8c16-440d30c5f0a7] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:51:27.323109 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG dbcounter [-] [124456] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=1 {{(pid=124456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:51:27.329362 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-a12b588b-2fe5-4e0b-ad5e-2408dcf6bab7 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:51:27.329750 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-a12b588b-2fe5-4e0b-ad5e-2408dcf6bab7 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:51:27.330539 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-a12b588b-2fe5-4e0b-ad5e-2408dcf6bab7 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:51:27.330996 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-a12b588b-2fe5-4e0b-ad5e-2408dcf6bab7 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:51:27.334311 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG dbcounter [-] [124456] Writing DB stats nova_cell1:SELECT=63 {{(pid=124456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:51:27.486901 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-a12b588b-2fe5-4e0b-ad5e-2408dcf6bab7 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26ad0a8e94ab4bcfa8b01dc16ad08b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a6e2ee8a698471faedbb97fb2b936cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:51:27.498634 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-a12b588b-2fe5-4e0b-ad5e-2408dcf6bab7 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] 10.222.0.121 "GET /compute/v2.1/servers/60fd5618-274c-47e7-8c16-440d30c5f0a7" status: 200 len: 1597 microversion: 2.1 time: 0.184650 Aug 04 10:51:27.499462 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 588/1178] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:51:27 2022] GET /compute/v2.1/servers/60fd5618-274c-47e7-8c16-440d30c5f0a7 => generated 1597 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:51:29.308849 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG dbcounter [-] [124457] Writing DB stats nova_cell0:SELECT=2 {{(pid=124457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:51:29.313683 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [req-29cd1525-d01a-4a66-9d05-f7fa92f4488f req-8c947ba2-0015-40f0-a8ac-61046551284a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "60fd5618-274c-47e7-8c16-440d30c5f0a7", "tag": "f2136cf7-e870-43e3-95a5-3ca15b097a1f"}]} {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:51:29.319771 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG dbcounter [-] [124457] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=3 {{(pid=124457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:51:29.327555 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [req-29cd1525-d01a-4a66-9d05-f7fa92f4488f req-8c947ba2-0015-40f0-a8ac-61046551284a service nova] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:51:29.328152 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [req-29cd1525-d01a-4a66-9d05-f7fa92f4488f req-8c947ba2-0015-40f0-a8ac-61046551284a service nova] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:51:29.332224 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG dbcounter [-] [124457] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:51:29.343822 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.compute.server_external_events [req-29cd1525-d01a-4a66-9d05-f7fa92f4488f req-8c947ba2-0015-40f0-a8ac-61046551284a service nova] Creating event network-changed:f2136cf7-e870-43e3-95a5-3ca15b097a1f for instance 60fd5618-274c-47e7-8c16-440d30c5f0a7 on hv-cinder-85200 Aug 04 10:51:29.349499 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [req-29cd1525-d01a-4a66-9d05-f7fa92f4488f req-8c947ba2-0015-40f0-a8ac-61046551284a service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042126 Aug 04 10:51:29.350620 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 591/1179] 10.222.0.121 () {64 vars in 1322 bytes} [Thu Aug 4 10:51:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:51:30.568528 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-5f641bf3-4460-4dcd-ac6b-d0bde1a92734 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-904453605"}} {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:51:30.569326 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-5f641bf3-4460-4dcd-ac6b-d0bde1a92734 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] [instance: 60fd5618-274c-47e7-8c16-440d30c5f0a7] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:51:30.579325 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-5f641bf3-4460-4dcd-ac6b-d0bde1a92734 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:51:30.579846 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-5f641bf3-4460-4dcd-ac6b-d0bde1a92734 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:51:30.580976 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-5f641bf3-4460-4dcd-ac6b-d0bde1a92734 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:51:30.581575 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-5f641bf3-4460-4dcd-ac6b-d0bde1a92734 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:51:30.728495 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.network.security_group_api [None req-5f641bf3-4460-4dcd-ac6b-d0bde1a92734 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Adding security group 93e3bccf-7aaa-401e-968a-8abef896e894 to port f2136cf7-e870-43e3-95a5-3ca15b097a1f Aug 04 10:51:31.077894 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-5f641bf3-4460-4dcd-ac6b-d0bde1a92734 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] 10.222.0.121 "POST /compute/v2.1/servers/60fd5618-274c-47e7-8c16-440d30c5f0a7/action" status: 202 len: 0 microversion: 2.1 time: 0.514454 Aug 04 10:51:31.082170 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 589/1180] 10.222.0.121 () {60 vars in 1283 bytes} [Thu Aug 4 10:51:30 2022] POST /compute/v2.1/servers/60fd5618-274c-47e7-8c16-440d30c5f0a7/action => generated 0 bytes in 516 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 10:51:31.089320 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-215f41c5-ee4f-4a00-a5e1-12cd381344e1 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:51:31.090065 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-215f41c5-ee4f-4a00-a5e1-12cd381344e1 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] [instance: 60fd5618-274c-47e7-8c16-440d30c5f0a7] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:51:31.099493 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-215f41c5-ee4f-4a00-a5e1-12cd381344e1 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:51:31.100086 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-215f41c5-ee4f-4a00-a5e1-12cd381344e1 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:51:31.101128 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-215f41c5-ee4f-4a00-a5e1-12cd381344e1 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:51:31.101795 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-215f41c5-ee4f-4a00-a5e1-12cd381344e1 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:51:31.286031 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-215f41c5-ee4f-4a00-a5e1-12cd381344e1 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26ad0a8e94ab4bcfa8b01dc16ad08b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a6e2ee8a698471faedbb97fb2b936cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:51:31.294877 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-215f41c5-ee4f-4a00-a5e1-12cd381344e1 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] 10.222.0.121 "GET /compute/v2.1/servers/60fd5618-274c-47e7-8c16-440d30c5f0a7" status: 200 len: 1762 microversion: 2.1 time: 0.210986 Aug 04 10:51:31.295483 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 592/1181] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:51:31 2022] GET /compute/v2.1/servers/60fd5618-274c-47e7-8c16-440d30c5f0a7 => generated 1762 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:51:31.369950 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [req-ae89cbfe-3574-4367-b7de-a04f675ff386 req-b5b57964-f655-4f0a-bda6-ffe30aa685b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "60fd5618-274c-47e7-8c16-440d30c5f0a7", "tag": "f2136cf7-e870-43e3-95a5-3ca15b097a1f"}]} {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:51:31.380794 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [req-ae89cbfe-3574-4367-b7de-a04f675ff386 req-b5b57964-f655-4f0a-bda6-ffe30aa685b4 service nova] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:51:31.381275 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [req-ae89cbfe-3574-4367-b7de-a04f675ff386 req-b5b57964-f655-4f0a-bda6-ffe30aa685b4 service nova] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:51:31.396043 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.compute.server_external_events [req-ae89cbfe-3574-4367-b7de-a04f675ff386 req-b5b57964-f655-4f0a-bda6-ffe30aa685b4 service nova] Creating event network-changed:f2136cf7-e870-43e3-95a5-3ca15b097a1f for instance 60fd5618-274c-47e7-8c16-440d30c5f0a7 on hv-cinder-85200 Aug 04 10:51:31.402105 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [req-ae89cbfe-3574-4367-b7de-a04f675ff386 req-b5b57964-f655-4f0a-bda6-ffe30aa685b4 service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036437 Aug 04 10:51:31.402801 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 590/1182] 10.222.0.121 () {64 vars in 1322 bytes} [Thu Aug 4 10:51:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:52:31.770587 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG dbcounter [-] [124457] Writing DB stats nova_api:SELECT=3 {{(pid=124457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:52:31.771562 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG dbcounter [-] [124457] Writing DB stats nova_cell1:SELECT=7 {{(pid=124457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:52:31.777288 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-fd7c7522-98ed-4998-9e64-218aa667f6e7 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:52:31.780089 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-fd7c7522-98ed-4998-9e64-218aa667f6e7 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] [instance: 60fd5618-274c-47e7-8c16-440d30c5f0a7] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:52:31.788960 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-fd7c7522-98ed-4998-9e64-218aa667f6e7 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:52:31.789527 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-fd7c7522-98ed-4998-9e64-218aa667f6e7 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:52:31.790485 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-fd7c7522-98ed-4998-9e64-218aa667f6e7 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:52:31.791069 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-fd7c7522-98ed-4998-9e64-218aa667f6e7 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:52:31.881412 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-fd7c7522-98ed-4998-9e64-218aa667f6e7 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] 10.222.0.121 "POST /compute/v2.1/servers/60fd5618-274c-47e7-8c16-440d30c5f0a7/action" status: 202 len: 0 microversion: 2.1 time: 0.112890 Aug 04 10:52:31.881985 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 593/1183] 10.222.0.121 () {60 vars in 1283 bytes} [Thu Aug 4 10:52:31 2022] POST /compute/v2.1/servers/60fd5618-274c-47e7-8c16-440d30c5f0a7/action => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 10:52:31.889157 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG dbcounter [-] [124456] Writing DB stats nova_api:SELECT=5 {{(pid=124456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:52:31.889925 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG dbcounter [-] [124456] Writing DB stats nova_cell1:SELECT=11 {{(pid=124456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:52:31.895171 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-8590ae2a-47d4-4f07-b9cc-d6d1947a2e6b tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:52:31.895886 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-8590ae2a-47d4-4f07-b9cc-d6d1947a2e6b tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] [instance: 60fd5618-274c-47e7-8c16-440d30c5f0a7] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:52:31.904546 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-8590ae2a-47d4-4f07-b9cc-d6d1947a2e6b tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:52:31.904999 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-8590ae2a-47d4-4f07-b9cc-d6d1947a2e6b tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:52:31.905851 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-8590ae2a-47d4-4f07-b9cc-d6d1947a2e6b tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:52:31.906213 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-8590ae2a-47d4-4f07-b9cc-d6d1947a2e6b tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:52:32.174599 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-8590ae2a-47d4-4f07-b9cc-d6d1947a2e6b tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26ad0a8e94ab4bcfa8b01dc16ad08b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a6e2ee8a698471faedbb97fb2b936cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:52:32.183758 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-8590ae2a-47d4-4f07-b9cc-d6d1947a2e6b tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] 10.222.0.121 "GET /compute/v2.1/servers/60fd5618-274c-47e7-8c16-440d30c5f0a7" status: 200 len: 1754 microversion: 2.1 time: 0.296716 Aug 04 10:52:32.184886 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 591/1184] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:52:31 2022] GET /compute/v2.1/servers/60fd5618-274c-47e7-8c16-440d30c5f0a7 => generated 1754 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:52:33.209769 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-7cd0b060-1ad9-4a77-903a-87da957c7d94 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:52:33.210440 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-7cd0b060-1ad9-4a77-903a-87da957c7d94 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] [instance: 60fd5618-274c-47e7-8c16-440d30c5f0a7] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:52:33.218002 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-7cd0b060-1ad9-4a77-903a-87da957c7d94 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:52:33.218474 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-7cd0b060-1ad9-4a77-903a-87da957c7d94 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:52:33.219262 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-7cd0b060-1ad9-4a77-903a-87da957c7d94 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:52:33.219704 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-7cd0b060-1ad9-4a77-903a-87da957c7d94 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:52:33.400463 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-7cd0b060-1ad9-4a77-903a-87da957c7d94 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26ad0a8e94ab4bcfa8b01dc16ad08b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a6e2ee8a698471faedbb97fb2b936cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:52:33.414214 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-7cd0b060-1ad9-4a77-903a-87da957c7d94 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] 10.222.0.121 "GET /compute/v2.1/servers/60fd5618-274c-47e7-8c16-440d30c5f0a7" status: 200 len: 1759 microversion: 2.1 time: 0.209693 Aug 04 10:52:33.415122 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 594/1185] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:52:33 2022] GET /compute/v2.1/servers/60fd5618-274c-47e7-8c16-440d30c5f0a7 => generated 1759 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:52:34.440143 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-809bfc5f-3cb2-4277-8deb-300dada54f57 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:52:34.440985 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-809bfc5f-3cb2-4277-8deb-300dada54f57 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] [instance: 60fd5618-274c-47e7-8c16-440d30c5f0a7] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:52:34.448506 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-809bfc5f-3cb2-4277-8deb-300dada54f57 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:52:34.449452 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-809bfc5f-3cb2-4277-8deb-300dada54f57 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:52:34.449763 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-809bfc5f-3cb2-4277-8deb-300dada54f57 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:52:34.450214 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-809bfc5f-3cb2-4277-8deb-300dada54f57 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:52:34.608348 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-809bfc5f-3cb2-4277-8deb-300dada54f57 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26ad0a8e94ab4bcfa8b01dc16ad08b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a6e2ee8a698471faedbb97fb2b936cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:52:34.617634 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-809bfc5f-3cb2-4277-8deb-300dada54f57 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] 10.222.0.121 "GET /compute/v2.1/servers/60fd5618-274c-47e7-8c16-440d30c5f0a7" status: 200 len: 1759 microversion: 2.1 time: 0.181591 Aug 04 10:52:34.618245 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 592/1186] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:52:34 2022] GET /compute/v2.1/servers/60fd5618-274c-47e7-8c16-440d30c5f0a7 => generated 1759 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:52:35.645157 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-ae79ba28-8800-478a-b995-1759bdb284d0 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:52:35.646137 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-ae79ba28-8800-478a-b995-1759bdb284d0 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] [instance: 60fd5618-274c-47e7-8c16-440d30c5f0a7] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:52:35.657738 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-ae79ba28-8800-478a-b995-1759bdb284d0 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:52:35.658509 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-ae79ba28-8800-478a-b995-1759bdb284d0 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:52:35.659874 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-ae79ba28-8800-478a-b995-1759bdb284d0 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:52:35.660352 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-ae79ba28-8800-478a-b995-1759bdb284d0 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:52:35.815829 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-ae79ba28-8800-478a-b995-1759bdb284d0 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26ad0a8e94ab4bcfa8b01dc16ad08b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a6e2ee8a698471faedbb97fb2b936cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:52:35.824323 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-ae79ba28-8800-478a-b995-1759bdb284d0 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] 10.222.0.121 "GET /compute/v2.1/servers/60fd5618-274c-47e7-8c16-440d30c5f0a7" status: 200 len: 1759 microversion: 2.1 time: 0.186187 Aug 04 10:52:35.824888 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 595/1187] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:52:35 2022] GET /compute/v2.1/servers/60fd5618-274c-47e7-8c16-440d30c5f0a7 => generated 1759 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:52:36.847030 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-459a7371-75cf-496a-be00-580b1c772d02 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:52:36.847791 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-459a7371-75cf-496a-be00-580b1c772d02 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] [instance: 60fd5618-274c-47e7-8c16-440d30c5f0a7] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:52:36.857187 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-459a7371-75cf-496a-be00-580b1c772d02 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:52:36.857647 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-459a7371-75cf-496a-be00-580b1c772d02 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:52:36.858875 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-459a7371-75cf-496a-be00-580b1c772d02 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:52:36.859534 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-459a7371-75cf-496a-be00-580b1c772d02 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:52:37.028755 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-459a7371-75cf-496a-be00-580b1c772d02 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26ad0a8e94ab4bcfa8b01dc16ad08b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a6e2ee8a698471faedbb97fb2b936cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:52:37.037766 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-459a7371-75cf-496a-be00-580b1c772d02 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] 10.222.0.121 "GET /compute/v2.1/servers/60fd5618-274c-47e7-8c16-440d30c5f0a7" status: 200 len: 1759 microversion: 2.1 time: 0.195016 Aug 04 10:52:37.038343 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 593/1188] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:52:36 2022] GET /compute/v2.1/servers/60fd5618-274c-47e7-8c16-440d30c5f0a7 => generated 1759 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:52:38.059515 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-2caaa2e9-efac-4e99-9929-806ed3cd4a6a tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:52:38.060631 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-2caaa2e9-efac-4e99-9929-806ed3cd4a6a tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] [instance: 60fd5618-274c-47e7-8c16-440d30c5f0a7] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:52:38.067142 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-2caaa2e9-efac-4e99-9929-806ed3cd4a6a tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:52:38.067813 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-2caaa2e9-efac-4e99-9929-806ed3cd4a6a tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:52:38.068634 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-2caaa2e9-efac-4e99-9929-806ed3cd4a6a tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:52:38.069072 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-2caaa2e9-efac-4e99-9929-806ed3cd4a6a tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:52:38.237459 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-2caaa2e9-efac-4e99-9929-806ed3cd4a6a tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26ad0a8e94ab4bcfa8b01dc16ad08b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a6e2ee8a698471faedbb97fb2b936cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:52:38.246230 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-2caaa2e9-efac-4e99-9929-806ed3cd4a6a tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] 10.222.0.121 "GET /compute/v2.1/servers/60fd5618-274c-47e7-8c16-440d30c5f0a7" status: 200 len: 1759 microversion: 2.1 time: 0.190864 Aug 04 10:52:38.246837 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 596/1189] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:52:38 2022] GET /compute/v2.1/servers/60fd5618-274c-47e7-8c16-440d30c5f0a7 => generated 1759 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:52:39.267883 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-17df5453-a841-4665-95f5-92dda5a19ad5 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:52:39.268619 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-17df5453-a841-4665-95f5-92dda5a19ad5 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] [instance: 60fd5618-274c-47e7-8c16-440d30c5f0a7] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:52:39.276121 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-17df5453-a841-4665-95f5-92dda5a19ad5 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:52:39.276595 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-17df5453-a841-4665-95f5-92dda5a19ad5 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:52:39.277393 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-17df5453-a841-4665-95f5-92dda5a19ad5 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:52:39.277845 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-17df5453-a841-4665-95f5-92dda5a19ad5 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:52:39.432092 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-17df5453-a841-4665-95f5-92dda5a19ad5 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26ad0a8e94ab4bcfa8b01dc16ad08b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a6e2ee8a698471faedbb97fb2b936cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:52:39.441464 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-17df5453-a841-4665-95f5-92dda5a19ad5 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] 10.222.0.121 "GET /compute/v2.1/servers/60fd5618-274c-47e7-8c16-440d30c5f0a7" status: 200 len: 1759 microversion: 2.1 time: 0.177656 Aug 04 10:52:39.442192 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 594/1190] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:52:39 2022] GET /compute/v2.1/servers/60fd5618-274c-47e7-8c16-440d30c5f0a7 => generated 1759 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:52:40.463854 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-84a5c087-478d-4898-9a84-aa31c001d263 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:52:40.464642 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-84a5c087-478d-4898-9a84-aa31c001d263 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] [instance: 60fd5618-274c-47e7-8c16-440d30c5f0a7] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:52:40.472779 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-84a5c087-478d-4898-9a84-aa31c001d263 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:52:40.473286 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-84a5c087-478d-4898-9a84-aa31c001d263 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:52:40.474089 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-84a5c087-478d-4898-9a84-aa31c001d263 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:52:40.474534 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-84a5c087-478d-4898-9a84-aa31c001d263 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:52:40.630189 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-84a5c087-478d-4898-9a84-aa31c001d263 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26ad0a8e94ab4bcfa8b01dc16ad08b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a6e2ee8a698471faedbb97fb2b936cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:52:40.638833 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-84a5c087-478d-4898-9a84-aa31c001d263 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] 10.222.0.121 "GET /compute/v2.1/servers/60fd5618-274c-47e7-8c16-440d30c5f0a7" status: 200 len: 1759 microversion: 2.1 time: 0.179435 Aug 04 10:52:40.639423 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 597/1191] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:52:40 2022] GET /compute/v2.1/servers/60fd5618-274c-47e7-8c16-440d30c5f0a7 => generated 1759 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:52:41.662695 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-7cd5606b-8fe2-4921-b413-f3705f044b97 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:52:41.663430 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-7cd5606b-8fe2-4921-b413-f3705f044b97 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] [instance: 60fd5618-274c-47e7-8c16-440d30c5f0a7] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:52:41.670647 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-7cd5606b-8fe2-4921-b413-f3705f044b97 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:52:41.671111 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-7cd5606b-8fe2-4921-b413-f3705f044b97 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:52:41.671900 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-7cd5606b-8fe2-4921-b413-f3705f044b97 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:52:41.672388 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-7cd5606b-8fe2-4921-b413-f3705f044b97 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:52:41.838862 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-7cd5606b-8fe2-4921-b413-f3705f044b97 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26ad0a8e94ab4bcfa8b01dc16ad08b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a6e2ee8a698471faedbb97fb2b936cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:52:41.848290 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-7cd5606b-8fe2-4921-b413-f3705f044b97 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] 10.222.0.121 "GET /compute/v2.1/servers/60fd5618-274c-47e7-8c16-440d30c5f0a7" status: 200 len: 1759 microversion: 2.1 time: 0.191166 Aug 04 10:52:41.848907 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 595/1192] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:52:41 2022] GET /compute/v2.1/servers/60fd5618-274c-47e7-8c16-440d30c5f0a7 => generated 1759 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:52:42.870721 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-16b30e4b-7507-4fac-a01e-ec5945819f73 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:52:42.871367 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-16b30e4b-7507-4fac-a01e-ec5945819f73 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] [instance: 60fd5618-274c-47e7-8c16-440d30c5f0a7] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:52:42.878943 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-16b30e4b-7507-4fac-a01e-ec5945819f73 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:52:42.879399 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-16b30e4b-7507-4fac-a01e-ec5945819f73 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:52:42.880245 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-16b30e4b-7507-4fac-a01e-ec5945819f73 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:52:42.880688 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-16b30e4b-7507-4fac-a01e-ec5945819f73 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:52:43.039797 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-16b30e4b-7507-4fac-a01e-ec5945819f73 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26ad0a8e94ab4bcfa8b01dc16ad08b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a6e2ee8a698471faedbb97fb2b936cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:52:43.049206 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-16b30e4b-7507-4fac-a01e-ec5945819f73 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] 10.222.0.121 "GET /compute/v2.1/servers/60fd5618-274c-47e7-8c16-440d30c5f0a7" status: 200 len: 1759 microversion: 2.1 time: 0.182640 Aug 04 10:52:43.049849 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 598/1193] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:52:42 2022] GET /compute/v2.1/servers/60fd5618-274c-47e7-8c16-440d30c5f0a7 => generated 1759 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:52:44.071357 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-0973dd4e-bc32-456e-8501-4452694ca7bf tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:52:44.072097 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-0973dd4e-bc32-456e-8501-4452694ca7bf tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] [instance: 60fd5618-274c-47e7-8c16-440d30c5f0a7] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:52:44.079522 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-0973dd4e-bc32-456e-8501-4452694ca7bf tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:52:44.079975 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-0973dd4e-bc32-456e-8501-4452694ca7bf tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:52:44.080817 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-0973dd4e-bc32-456e-8501-4452694ca7bf tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:52:44.081250 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-0973dd4e-bc32-456e-8501-4452694ca7bf tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:52:44.236995 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-0973dd4e-bc32-456e-8501-4452694ca7bf tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26ad0a8e94ab4bcfa8b01dc16ad08b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a6e2ee8a698471faedbb97fb2b936cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:52:44.245788 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-0973dd4e-bc32-456e-8501-4452694ca7bf tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] 10.222.0.121 "GET /compute/v2.1/servers/60fd5618-274c-47e7-8c16-440d30c5f0a7" status: 200 len: 1759 microversion: 2.1 time: 0.178573 Aug 04 10:52:44.246391 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 596/1194] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:52:44 2022] GET /compute/v2.1/servers/60fd5618-274c-47e7-8c16-440d30c5f0a7 => generated 1759 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:52:45.274249 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-11c3e202-7243-41b6-b63f-a130b84b3712 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:52:45.275221 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-11c3e202-7243-41b6-b63f-a130b84b3712 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] [instance: 60fd5618-274c-47e7-8c16-440d30c5f0a7] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:52:45.282535 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-11c3e202-7243-41b6-b63f-a130b84b3712 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:52:45.282951 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-11c3e202-7243-41b6-b63f-a130b84b3712 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:52:45.283770 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-11c3e202-7243-41b6-b63f-a130b84b3712 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:52:45.284310 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-11c3e202-7243-41b6-b63f-a130b84b3712 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:52:45.439017 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-11c3e202-7243-41b6-b63f-a130b84b3712 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26ad0a8e94ab4bcfa8b01dc16ad08b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a6e2ee8a698471faedbb97fb2b936cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:52:45.447685 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-11c3e202-7243-41b6-b63f-a130b84b3712 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] 10.222.0.121 "GET /compute/v2.1/servers/60fd5618-274c-47e7-8c16-440d30c5f0a7" status: 200 len: 1759 microversion: 2.1 time: 0.180361 Aug 04 10:52:45.448305 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 599/1195] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:52:45 2022] GET /compute/v2.1/servers/60fd5618-274c-47e7-8c16-440d30c5f0a7 => generated 1759 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:52:46.469827 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-33d69037-967f-43a7-a13c-8c7110495a6d tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:52:46.470625 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-33d69037-967f-43a7-a13c-8c7110495a6d tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] [instance: 60fd5618-274c-47e7-8c16-440d30c5f0a7] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:52:46.480086 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-33d69037-967f-43a7-a13c-8c7110495a6d tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:52:46.480536 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-33d69037-967f-43a7-a13c-8c7110495a6d tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:52:46.481331 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-33d69037-967f-43a7-a13c-8c7110495a6d tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:52:46.481775 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-33d69037-967f-43a7-a13c-8c7110495a6d tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:52:46.646788 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-33d69037-967f-43a7-a13c-8c7110495a6d tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26ad0a8e94ab4bcfa8b01dc16ad08b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a6e2ee8a698471faedbb97fb2b936cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:52:46.656891 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-33d69037-967f-43a7-a13c-8c7110495a6d tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] 10.222.0.121 "GET /compute/v2.1/servers/60fd5618-274c-47e7-8c16-440d30c5f0a7" status: 200 len: 1759 microversion: 2.1 time: 0.191215 Aug 04 10:52:46.657493 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 597/1196] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:52:46 2022] GET /compute/v2.1/servers/60fd5618-274c-47e7-8c16-440d30c5f0a7 => generated 1759 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:52:47.681826 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-47da8beb-b208-4ec3-b7e7-8e7e192c219b tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:52:47.682574 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-47da8beb-b208-4ec3-b7e7-8e7e192c219b tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] [instance: 60fd5618-274c-47e7-8c16-440d30c5f0a7] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:52:47.691731 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-47da8beb-b208-4ec3-b7e7-8e7e192c219b tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:52:47.692347 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-47da8beb-b208-4ec3-b7e7-8e7e192c219b tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:52:47.693379 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-47da8beb-b208-4ec3-b7e7-8e7e192c219b tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:52:47.694007 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-47da8beb-b208-4ec3-b7e7-8e7e192c219b tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:52:47.848528 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-47da8beb-b208-4ec3-b7e7-8e7e192c219b tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26ad0a8e94ab4bcfa8b01dc16ad08b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a6e2ee8a698471faedbb97fb2b936cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:52:47.857225 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-47da8beb-b208-4ec3-b7e7-8e7e192c219b tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] 10.222.0.121 "GET /compute/v2.1/servers/60fd5618-274c-47e7-8c16-440d30c5f0a7" status: 200 len: 1759 microversion: 2.1 time: 0.181734 Aug 04 10:52:47.857834 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 600/1197] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:52:47 2022] GET /compute/v2.1/servers/60fd5618-274c-47e7-8c16-440d30c5f0a7 => generated 1759 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:52:48.880846 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-e64960bb-bee7-4c8b-bcd2-356551b072a1 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:52:48.881489 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-e64960bb-bee7-4c8b-bcd2-356551b072a1 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] [instance: 60fd5618-274c-47e7-8c16-440d30c5f0a7] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:52:48.890110 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-e64960bb-bee7-4c8b-bcd2-356551b072a1 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:52:48.890862 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-e64960bb-bee7-4c8b-bcd2-356551b072a1 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:52:48.891888 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-e64960bb-bee7-4c8b-bcd2-356551b072a1 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:52:48.892366 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-e64960bb-bee7-4c8b-bcd2-356551b072a1 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:52:49.058633 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-e64960bb-bee7-4c8b-bcd2-356551b072a1 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26ad0a8e94ab4bcfa8b01dc16ad08b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a6e2ee8a698471faedbb97fb2b936cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:52:49.067164 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-e64960bb-bee7-4c8b-bcd2-356551b072a1 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] 10.222.0.121 "GET /compute/v2.1/servers/60fd5618-274c-47e7-8c16-440d30c5f0a7" status: 200 len: 1759 microversion: 2.1 time: 0.190549 Aug 04 10:52:49.067758 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 598/1198] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:52:48 2022] GET /compute/v2.1/servers/60fd5618-274c-47e7-8c16-440d30c5f0a7 => generated 1759 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:52:50.089773 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-6af72344-b701-4ea0-97a6-66c5a53cea97 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:52:50.090477 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-6af72344-b701-4ea0-97a6-66c5a53cea97 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] [instance: 60fd5618-274c-47e7-8c16-440d30c5f0a7] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:52:50.097751 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-6af72344-b701-4ea0-97a6-66c5a53cea97 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:52:50.098213 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-6af72344-b701-4ea0-97a6-66c5a53cea97 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:52:50.099209 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-6af72344-b701-4ea0-97a6-66c5a53cea97 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:52:50.099656 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-6af72344-b701-4ea0-97a6-66c5a53cea97 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:52:50.249720 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-6af72344-b701-4ea0-97a6-66c5a53cea97 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26ad0a8e94ab4bcfa8b01dc16ad08b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a6e2ee8a698471faedbb97fb2b936cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:52:50.258539 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-6af72344-b701-4ea0-97a6-66c5a53cea97 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] 10.222.0.121 "GET /compute/v2.1/servers/60fd5618-274c-47e7-8c16-440d30c5f0a7" status: 200 len: 1762 microversion: 2.1 time: 0.173240 Aug 04 10:52:50.259121 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 601/1199] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:52:50 2022] GET /compute/v2.1/servers/60fd5618-274c-47e7-8c16-440d30c5f0a7 => generated 1762 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:52:51.271610 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 10:52:51.272520 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: Thu Aug 4 10:52:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 10:53:04.695971 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 10:53:04.696714 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: Thu Aug 4 10:53:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 10:53:45.924974 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-072c3d2b-6f3c-4748-bf45-90301ce63881 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-904453605"}} {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:53:45.925686 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-072c3d2b-6f3c-4748-bf45-90301ce63881 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] [instance: 60fd5618-274c-47e7-8c16-440d30c5f0a7] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:53:45.927556 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG dbcounter [-] [124456] Writing DB stats nova_api:SELECT=16 {{(pid=124456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:53:45.928267 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG dbcounter [-] [124456] Writing DB stats nova_cell1:SELECT=48 {{(pid=124456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:53:45.934863 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-072c3d2b-6f3c-4748-bf45-90301ce63881 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:53:45.935321 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-072c3d2b-6f3c-4748-bf45-90301ce63881 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:53:45.936205 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-072c3d2b-6f3c-4748-bf45-90301ce63881 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:53:45.936650 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-072c3d2b-6f3c-4748-bf45-90301ce63881 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:53:46.196363 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.network.security_group_api [None req-072c3d2b-6f3c-4748-bf45-90301ce63881 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Removing security group 93e3bccf-7aaa-401e-968a-8abef896e894 from port f2136cf7-e870-43e3-95a5-3ca15b097a1f Aug 04 10:53:46.521167 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-072c3d2b-6f3c-4748-bf45-90301ce63881 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] 10.222.0.121 "POST /compute/v2.1/servers/60fd5618-274c-47e7-8c16-440d30c5f0a7/action" status: 202 len: 0 microversion: 2.1 time: 0.600668 Aug 04 10:53:46.521816 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 599/1200] 10.222.0.121 () {60 vars in 1283 bytes} [Thu Aug 4 10:53:45 2022] POST /compute/v2.1/servers/60fd5618-274c-47e7-8c16-440d30c5f0a7/action => generated 0 bytes in 602 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 10:53:46.533004 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [req-8faf8d72-71bd-4126-9e88-cc12522fc0d6 req-78c54d13-4999-443f-8efa-a6dd62683662 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "60fd5618-274c-47e7-8c16-440d30c5f0a7", "tag": "f2136cf7-e870-43e3-95a5-3ca15b097a1f"}]} {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:53:46.538560 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG dbcounter [-] [124457] Writing DB stats nova_api:SELECT=18 {{(pid=124457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:53:46.557571 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG dbcounter [-] [124457] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:53:46.564727 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [req-8faf8d72-71bd-4126-9e88-cc12522fc0d6 req-78c54d13-4999-443f-8efa-a6dd62683662 service nova] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:53:46.565184 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [req-8faf8d72-71bd-4126-9e88-cc12522fc0d6 req-78c54d13-4999-443f-8efa-a6dd62683662 service nova] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:53:46.588964 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.compute.server_external_events [req-8faf8d72-71bd-4126-9e88-cc12522fc0d6 req-78c54d13-4999-443f-8efa-a6dd62683662 service nova] Creating event network-changed:f2136cf7-e870-43e3-95a5-3ca15b097a1f for instance 60fd5618-274c-47e7-8c16-440d30c5f0a7 on hv-cinder-85200 Aug 04 10:53:46.615938 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [req-8faf8d72-71bd-4126-9e88-cc12522fc0d6 req-78c54d13-4999-443f-8efa-a6dd62683662 service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089874 Aug 04 10:53:46.620498 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 602/1201] 10.222.0.121 () {64 vars in 1322 bytes} [Thu Aug 4 10:53:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:53:48.291180 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-9591eb35-c183-4f21-b5b4-647d5d0a1330 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:53:48.291795 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-9591eb35-c183-4f21-b5b4-647d5d0a1330 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] [instance: 60fd5618-274c-47e7-8c16-440d30c5f0a7] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:53:48.299164 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-9591eb35-c183-4f21-b5b4-647d5d0a1330 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:53:48.299629 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-9591eb35-c183-4f21-b5b4-647d5d0a1330 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:53:48.300651 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-9591eb35-c183-4f21-b5b4-647d5d0a1330 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:53:48.300991 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-9591eb35-c183-4f21-b5b4-647d5d0a1330 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:53:48.398927 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.objects.instance [None req-9591eb35-c183-4f21-b5b4-647d5d0a1330 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Lazy-loading 'services' on Instance uuid 60fd5618-274c-47e7-8c16-440d30c5f0a7 {{(pid=124456) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 10:53:48.489621 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-9591eb35-c183-4f21-b5b4-647d5d0a1330 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] 10.222.0.121 "DELETE /compute/v2.1/servers/60fd5618-274c-47e7-8c16-440d30c5f0a7/os-volume_attachments/8abbc747-d704-4236-bf1a-1af961cb59f2" status: 202 len: 0 microversion: 2.1 time: 0.203069 Aug 04 10:53:48.490429 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 600/1202] 10.222.0.121 () {58 vars in 1421 bytes} [Thu Aug 4 10:53:48 2022] DELETE /compute/v2.1/servers/60fd5618-274c-47e7-8c16-440d30c5f0a7/os-volume_attachments/8abbc747-d704-4236-bf1a-1af961cb59f2 => generated 0 bytes in 205 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 10:53:48.500544 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-54e17bd1-e2d1-40ac-8a25-207fe7a9cbb5 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:53:48.502966 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-54e17bd1-e2d1-40ac-8a25-207fe7a9cbb5 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] [instance: 60fd5618-274c-47e7-8c16-440d30c5f0a7] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:53:48.511435 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-54e17bd1-e2d1-40ac-8a25-207fe7a9cbb5 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:53:48.512014 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-54e17bd1-e2d1-40ac-8a25-207fe7a9cbb5 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:53:48.513060 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-54e17bd1-e2d1-40ac-8a25-207fe7a9cbb5 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:53:48.513521 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-54e17bd1-e2d1-40ac-8a25-207fe7a9cbb5 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:53:48.548318 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-54e17bd1-e2d1-40ac-8a25-207fe7a9cbb5 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] 10.222.0.121 "GET /compute/v2.1/servers/60fd5618-274c-47e7-8c16-440d30c5f0a7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052751 Aug 04 10:53:48.553276 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 603/1203] 10.222.0.121 () {58 vars in 1307 bytes} [Thu Aug 4 10:53:48 2022] GET /compute/v2.1/servers/60fd5618-274c-47e7-8c16-440d30c5f0a7/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:53:48.635933 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [req-4b307f19-dccb-40de-b637-2acbcc9d528a req-1eeb2597-7056-40b1-bcb1-052c3f49cb8e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "60fd5618-274c-47e7-8c16-440d30c5f0a7", "tag": "f2136cf7-e870-43e3-95a5-3ca15b097a1f"}]} {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:53:48.646441 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [req-4b307f19-dccb-40de-b637-2acbcc9d528a req-1eeb2597-7056-40b1-bcb1-052c3f49cb8e service nova] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:53:48.646887 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [req-4b307f19-dccb-40de-b637-2acbcc9d528a req-1eeb2597-7056-40b1-bcb1-052c3f49cb8e service nova] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:53:48.658358 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.compute.server_external_events [req-4b307f19-dccb-40de-b637-2acbcc9d528a req-1eeb2597-7056-40b1-bcb1-052c3f49cb8e service nova] Creating event network-changed:f2136cf7-e870-43e3-95a5-3ca15b097a1f for instance 60fd5618-274c-47e7-8c16-440d30c5f0a7 on hv-cinder-85200 Aug 04 10:53:48.663471 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [req-4b307f19-dccb-40de-b637-2acbcc9d528a req-1eeb2597-7056-40b1-bcb1-052c3f49cb8e service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032376 Aug 04 10:53:48.664113 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 601/1204] 10.222.0.121 () {64 vars in 1322 bytes} [Thu Aug 4 10:53:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:53:49.565913 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-b4cf8e0d-ac5f-4ba4-8782-9ef0777caf63 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:53:49.569059 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-b4cf8e0d-ac5f-4ba4-8782-9ef0777caf63 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] [instance: 60fd5618-274c-47e7-8c16-440d30c5f0a7] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:53:49.576462 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-b4cf8e0d-ac5f-4ba4-8782-9ef0777caf63 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:53:49.577248 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-b4cf8e0d-ac5f-4ba4-8782-9ef0777caf63 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:53:49.578503 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-b4cf8e0d-ac5f-4ba4-8782-9ef0777caf63 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:53:49.579210 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-b4cf8e0d-ac5f-4ba4-8782-9ef0777caf63 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:53:49.613366 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-b4cf8e0d-ac5f-4ba4-8782-9ef0777caf63 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] 10.222.0.121 "GET /compute/v2.1/servers/60fd5618-274c-47e7-8c16-440d30c5f0a7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.055608 Aug 04 10:53:49.614837 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 604/1205] 10.222.0.121 () {58 vars in 1307 bytes} [Thu Aug 4 10:53:49 2022] GET /compute/v2.1/servers/60fd5618-274c-47e7-8c16-440d30c5f0a7/os-volume_attachments => generated 25 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 10:53:49.627088 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-7d216be9-a997-4f51-b959-9f9d7779f49c tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:53:49.627788 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-7d216be9-a997-4f51-b959-9f9d7779f49c tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] [instance: 60fd5618-274c-47e7-8c16-440d30c5f0a7] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:53:49.634561 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-7d216be9-a997-4f51-b959-9f9d7779f49c tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:53:49.635062 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-7d216be9-a997-4f51-b959-9f9d7779f49c tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:53:49.636174 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-7d216be9-a997-4f51-b959-9f9d7779f49c tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:53:49.636632 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-7d216be9-a997-4f51-b959-9f9d7779f49c tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:53:49.716930 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.wsgi [None req-7d216be9-a997-4f51-b959-9f9d7779f49c tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] HTTP exception thrown: Instance 60fd5618-274c-47e7-8c16-440d30c5f0a7 is not attached to volume 8abbc747-d704-4236-bf1a-1af961cb59f2 Aug 04 10:53:49.719401 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-7d216be9-a997-4f51-b959-9f9d7779f49c tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Request method failure captured: Aug 04 10:53:49.719401 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: request: DELETE /compute/v2.1/servers/60fd5618-274c-47e7-8c16-440d30c5f0a7/os-volume_attachments/8abbc747-d704-4236-bf1a-1af961cb59f2 HTTP/1.1 Aug 04 10:53:49.719401 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: Accept: application/json Aug 04 10:53:49.719401 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: Accept-Encoding: identity Aug 04 10:53:49.719401 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: Connection: close Aug 04 10:53:49.719401 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: Content-Length: 0 Aug 04 10:53:49.719401 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: Content-Type: application/json Aug 04 10:53:49.719401 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: Host: 10.222.0.121 Aug 04 10:53:49.719401 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: Openstack-System-Scope: None Aug 04 10:53:49.719401 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: User-Agent: python-urllib3/1.26.11 Aug 04 10:53:49.719401 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Auth-Token: gAAAAABi66SARpl2vA_nAE3_EcCH83X8G8kkjasaTwaLoA3rmsaEWW8j9_Usy348WBxzcWIRm2FbqTfCcnWCW5zUyOP5eCgX_6A54IQKonhp3CeY1pSZsErpfNKtupHfi9PU689LRl3VfwvFjQo9UHSITgj1YYsi7R1XIobaMr7WhdqvRGfhxlo Aug 04 10:53:49.719401 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Domain-Id: None Aug 04 10:53:49.719401 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Domain-Name: None Aug 04 10:53:49.719401 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Identity-Status: Confirmed Aug 04 10:53:49.719401 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Is-Admin-Project: True Aug 04 10:53:49.719401 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Project-Domain-Id: default Aug 04 10:53:49.719401 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Project-Domain-Name: Default Aug 04 10:53:49.719401 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Project-Id: 9a6e2ee8a698471faedbb97fb2b936cd Aug 04 10:53:49.719401 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Project-Name: tempest-TestMinimumBasicScenario-1913138961 Aug 04 10:53:49.719401 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Role: reader,member Aug 04 10:53:49.719401 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Roles: reader,member Aug 04 10:53:49.721348 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/9a6e2ee8a698471faedbb97fb2b936cd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/9a6e2ee8a698471faedbb97fb2b936cd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.121:8080", "publicURL": "http://10.222.0.121:8080/v1/AUTH_9a6e2ee8a698471faedbb97fb2b936cd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2/9a6e2ee8a698471faedbb97fb2b936cd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:9696/networking"}]}] Aug 04 10:53:49.721348 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Tenant: tempest-TestMinimumBasicScenario-1913138961 Aug 04 10:53:49.721348 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Tenant-Id: 9a6e2ee8a698471faedbb97fb2b936cd Aug 04 10:53:49.721348 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1913138961 Aug 04 10:53:49.721348 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-User: tempest-TestMinimumBasicScenario-1913138961-project Aug 04 10:53:49.721348 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-User-Domain-Id: default Aug 04 10:53:49.721348 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-User-Domain-Name: Default Aug 04 10:53:49.721348 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-User-Id: 26ad0a8e94ab4bcfa8b01dc16ad08b0f Aug 04 10:53:49.721348 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-User-Name: tempest-TestMinimumBasicScenario-1913138961-project Aug 04 10:53:49.721348 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: method: > Aug 04 10:53:49.721348 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: exception: Instance 60fd5618-274c-47e7-8c16-440d30c5f0a7 is not attached to volume 8abbc747-d704-4236-bf1a-1af961cb59f2 Aug 04 10:53:49.722551 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: action_args: {'server_id': '60fd5618-274c-47e7-8c16-440d30c5f0a7', 'id': '8abbc747-d704-4236-bf1a-1af961cb59f2'} Aug 04 10:53:49.722551 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 10:53:49.722551 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:53:49.722551 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 04 10:53:49.722551 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 04 10:53:49.722551 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 10:53:49.722551 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 10:53:49.722551 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Aug 04 10:53:49.722551 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 04 10:53:49.722551 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 8abbc747-d704-4236-bf1a-1af961cb59f2. Aug 04 10:53:49.722551 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi Aug 04 10:53:49.722551 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:53:49.722551 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi Aug 04 10:53:49.722551 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:53:49.722551 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:53:49.722551 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:53:49.722551 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 10:53:49.722551 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 10:53:49.722551 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 10:53:49.724266 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 10:53:49.724266 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 04 10:53:49.724266 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 04 10:53:49.724266 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 60fd5618-274c-47e7-8c16-440d30c5f0a7 is not attached to volume 8abbc747-d704-4236-bf1a-1af961cb59f2 Aug 04 10:53:49.724266 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi Aug 04 10:53:49.724266 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:53:49.724266 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi Aug 04 10:53:49.724266 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:53:49.724266 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:53:49.724266 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:53:49.724266 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 10:53:49.724266 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 10:53:49.724266 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 60fd5618-274c-47e7-8c16-440d30c5f0a7 is not attached to volume 8abbc747-d704-4236-bf1a-1af961cb59f2 Aug 04 10:53:49.724266 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi Aug 04 10:53:49.724266 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-7d216be9-a997-4f51-b959-9f9d7779f49c tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Returning 404 to user: Instance 60fd5618-274c-47e7-8c16-440d30c5f0a7 is not attached to volume 8abbc747-d704-4236-bf1a-1af961cb59f2 {{(pid=124456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 10:53:49.725661 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-7d216be9-a997-4f51-b959-9f9d7779f49c tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] 10.222.0.121 "DELETE /compute/v2.1/servers/60fd5618-274c-47e7-8c16-440d30c5f0a7/os-volume_attachments/8abbc747-d704-4236-bf1a-1af961cb59f2" status: 404 len: 154 microversion: 2.1 time: 0.099197 Aug 04 10:53:49.725661 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 602/1206] 10.222.0.121 () {58 vars in 1421 bytes} [Thu Aug 4 10:53:49 2022] DELETE /compute/v2.1/servers/60fd5618-274c-47e7-8c16-440d30c5f0a7/os-volume_attachments/8abbc747-d704-4236-bf1a-1af961cb59f2 => generated 154 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 10:53:50.879224 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-142f0905-0585-4a29-b536-676909711ad7 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:53:50.879854 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-142f0905-0585-4a29-b536-676909711ad7 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] [instance: 60fd5618-274c-47e7-8c16-440d30c5f0a7] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:53:50.887029 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-142f0905-0585-4a29-b536-676909711ad7 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:53:50.887475 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-142f0905-0585-4a29-b536-676909711ad7 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:53:50.888296 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-142f0905-0585-4a29-b536-676909711ad7 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:53:50.888760 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-142f0905-0585-4a29-b536-676909711ad7 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:53:50.915869 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-142f0905-0585-4a29-b536-676909711ad7 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] [instance: 60fd5618-274c-47e7-8c16-440d30c5f0a7] Going to try to terminate instance {{(pid=124457) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 10:53:50.993766 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-142f0905-0585-4a29-b536-676909711ad7 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] 10.222.0.121 "DELETE /compute/v2.1/servers/60fd5618-274c-47e7-8c16-440d30c5f0a7" status: 204 len: 0 microversion: 2.1 time: 0.118291 Aug 04 10:53:50.994603 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 605/1207] 10.222.0.121 () {58 vars in 1244 bytes} [Thu Aug 4 10:53:50 2022] DELETE /compute/v2.1/servers/60fd5618-274c-47e7-8c16-440d30c5f0a7 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 10:53:51.003667 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-bddc867b-b4f9-4a28-8234-8f7422dc034f tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:53:51.004297 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-bddc867b-b4f9-4a28-8234-8f7422dc034f tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] [instance: 60fd5618-274c-47e7-8c16-440d30c5f0a7] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:53:51.012274 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-bddc867b-b4f9-4a28-8234-8f7422dc034f tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:53:51.012745 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-bddc867b-b4f9-4a28-8234-8f7422dc034f tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:53:51.013527 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-bddc867b-b4f9-4a28-8234-8f7422dc034f tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:53:51.013971 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-bddc867b-b4f9-4a28-8234-8f7422dc034f tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:53:51.152584 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-bddc867b-b4f9-4a28-8234-8f7422dc034f tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26ad0a8e94ab4bcfa8b01dc16ad08b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a6e2ee8a698471faedbb97fb2b936cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:53:51.161009 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-bddc867b-b4f9-4a28-8234-8f7422dc034f tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] 10.222.0.121 "GET /compute/v2.1/servers/60fd5618-274c-47e7-8c16-440d30c5f0a7" status: 200 len: 1557 microversion: 2.1 time: 0.161525 Aug 04 10:53:51.161592 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 603/1208] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:53:50 2022] GET /compute/v2.1/servers/60fd5618-274c-47e7-8c16-440d30c5f0a7 => generated 1557 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:53:52.183340 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-36bd93a6-0741-4492-bce5-a28ff52b0aaf tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:53:52.184069 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-36bd93a6-0741-4492-bce5-a28ff52b0aaf tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] [instance: 60fd5618-274c-47e7-8c16-440d30c5f0a7] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:53:52.191012 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-36bd93a6-0741-4492-bce5-a28ff52b0aaf tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:53:52.191477 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-36bd93a6-0741-4492-bce5-a28ff52b0aaf tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:53:52.192318 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-36bd93a6-0741-4492-bce5-a28ff52b0aaf tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:53:52.192768 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-36bd93a6-0741-4492-bce5-a28ff52b0aaf tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:53:52.386546 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-36bd93a6-0741-4492-bce5-a28ff52b0aaf tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26ad0a8e94ab4bcfa8b01dc16ad08b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a6e2ee8a698471faedbb97fb2b936cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:53:52.394793 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-36bd93a6-0741-4492-bce5-a28ff52b0aaf tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] 10.222.0.121 "GET /compute/v2.1/servers/60fd5618-274c-47e7-8c16-440d30c5f0a7" status: 200 len: 1557 microversion: 2.1 time: 0.216103 Aug 04 10:53:52.395395 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 606/1209] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:53:52 2022] GET /compute/v2.1/servers/60fd5618-274c-47e7-8c16-440d30c5f0a7 => generated 1557 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:53:53.416598 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-cfa0f841-7a74-44b7-a84d-765f924b38e4 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:53:53.417293 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-cfa0f841-7a74-44b7-a84d-765f924b38e4 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] [instance: 60fd5618-274c-47e7-8c16-440d30c5f0a7] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:53:53.425771 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-cfa0f841-7a74-44b7-a84d-765f924b38e4 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:53:53.426329 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-cfa0f841-7a74-44b7-a84d-765f924b38e4 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:53:53.427198 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-cfa0f841-7a74-44b7-a84d-765f924b38e4 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:53:53.427709 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-cfa0f841-7a74-44b7-a84d-765f924b38e4 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:53:53.518297 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-cfa0f841-7a74-44b7-a84d-765f924b38e4 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26ad0a8e94ab4bcfa8b01dc16ad08b0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a6e2ee8a698471faedbb97fb2b936cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:53:53.527203 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-cfa0f841-7a74-44b7-a84d-765f924b38e4 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] 10.222.0.121 "GET /compute/v2.1/servers/60fd5618-274c-47e7-8c16-440d30c5f0a7" status: 200 len: 1515 microversion: 2.1 time: 0.114579 Aug 04 10:53:53.527965 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 604/1210] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:53:53 2022] GET /compute/v2.1/servers/60fd5618-274c-47e7-8c16-440d30c5f0a7 => generated 1515 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:53:53.572777 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [req-0ad33075-8767-41b8-b8a8-35196418f564 req-66a673f5-e667-4a0c-8daf-0c4d3c147d33 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60fd5618-274c-47e7-8c16-440d30c5f0a7", "name": "network-vif-deleted", "tag": "f2136cf7-e870-43e3-95a5-3ca15b097a1f"}]} {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:53:53.584590 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [req-0ad33075-8767-41b8-b8a8-35196418f564 req-66a673f5-e667-4a0c-8daf-0c4d3c147d33 service nova] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:53:53.586546 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [req-0ad33075-8767-41b8-b8a8-35196418f564 req-66a673f5-e667-4a0c-8daf-0c4d3c147d33 service nova] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:53:53.599276 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.compute.server_external_events [req-0ad33075-8767-41b8-b8a8-35196418f564 req-66a673f5-e667-4a0c-8daf-0c4d3c147d33 service nova] Creating event network-vif-deleted:f2136cf7-e870-43e3-95a5-3ca15b097a1f for instance 60fd5618-274c-47e7-8c16-440d30c5f0a7 on hv-cinder-85200 Aug 04 10:53:53.604743 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [req-0ad33075-8767-41b8-b8a8-35196418f564 req-66a673f5-e667-4a0c-8daf-0c4d3c147d33 service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035923 Aug 04 10:53:53.605377 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 607/1211] 10.222.0.121 () {64 vars in 1322 bytes} [Thu Aug 4 10:53:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:53:54.549616 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-71982693-cd07-449a-84b2-972b913e5e93 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:53:54.550302 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-71982693-cd07-449a-84b2-972b913e5e93 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] [instance: 60fd5618-274c-47e7-8c16-440d30c5f0a7] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:53:54.560466 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-71982693-cd07-449a-84b2-972b913e5e93 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:53:54.560878 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-71982693-cd07-449a-84b2-972b913e5e93 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:53:54.561702 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-71982693-cd07-449a-84b2-972b913e5e93 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:53:54.562436 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-71982693-cd07-449a-84b2-972b913e5e93 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:53:54.579408 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.wsgi [None req-71982693-cd07-449a-84b2-972b913e5e93 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] HTTP exception thrown: Instance 60fd5618-274c-47e7-8c16-440d30c5f0a7 could not be found. Aug 04 10:53:54.581210 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-71982693-cd07-449a-84b2-972b913e5e93 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Request method failure captured: Aug 04 10:53:54.581210 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: request: GET /compute/v2.1/servers/60fd5618-274c-47e7-8c16-440d30c5f0a7 HTTP/1.1 Aug 04 10:53:54.581210 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: Accept: application/json Aug 04 10:53:54.581210 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: Accept-Encoding: identity Aug 04 10:53:54.581210 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: Connection: close Aug 04 10:53:54.581210 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: Content-Length: 0 Aug 04 10:53:54.581210 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: Content-Type: application/json Aug 04 10:53:54.581210 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: Host: 10.222.0.121 Aug 04 10:53:54.581210 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: Openstack-System-Scope: None Aug 04 10:53:54.581210 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: User-Agent: python-urllib3/1.26.11 Aug 04 10:53:54.581210 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Auth-Token: gAAAAABi66SARpl2vA_nAE3_EcCH83X8G8kkjasaTwaLoA3rmsaEWW8j9_Usy348WBxzcWIRm2FbqTfCcnWCW5zUyOP5eCgX_6A54IQKonhp3CeY1pSZsErpfNKtupHfi9PU689LRl3VfwvFjQo9UHSITgj1YYsi7R1XIobaMr7WhdqvRGfhxlo Aug 04 10:53:54.581210 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Domain-Id: None Aug 04 10:53:54.581210 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Domain-Name: None Aug 04 10:53:54.581210 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Identity-Status: Confirmed Aug 04 10:53:54.581210 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Is-Admin-Project: True Aug 04 10:53:54.581210 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Project-Domain-Id: default Aug 04 10:53:54.581210 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Project-Domain-Name: Default Aug 04 10:53:54.581210 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Project-Id: 9a6e2ee8a698471faedbb97fb2b936cd Aug 04 10:53:54.581210 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Project-Name: tempest-TestMinimumBasicScenario-1913138961 Aug 04 10:53:54.581210 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Role: reader,member Aug 04 10:53:54.581210 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Roles: reader,member Aug 04 10:53:54.583047 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/9a6e2ee8a698471faedbb97fb2b936cd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/9a6e2ee8a698471faedbb97fb2b936cd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.121:8080", "publicURL": "http://10.222.0.121:8080/v1/AUTH_9a6e2ee8a698471faedbb97fb2b936cd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2/9a6e2ee8a698471faedbb97fb2b936cd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:9696/networking"}]}] Aug 04 10:53:54.583047 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Tenant: tempest-TestMinimumBasicScenario-1913138961 Aug 04 10:53:54.583047 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Tenant-Id: 9a6e2ee8a698471faedbb97fb2b936cd Aug 04 10:53:54.583047 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1913138961 Aug 04 10:53:54.583047 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-User: tempest-TestMinimumBasicScenario-1913138961-project Aug 04 10:53:54.583047 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-User-Domain-Id: default Aug 04 10:53:54.583047 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-User-Domain-Name: Default Aug 04 10:53:54.583047 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-User-Id: 26ad0a8e94ab4bcfa8b01dc16ad08b0f Aug 04 10:53:54.583047 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-User-Name: tempest-TestMinimumBasicScenario-1913138961-project Aug 04 10:53:54.583047 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: method: > Aug 04 10:53:54.583047 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: exception: Instance 60fd5618-274c-47e7-8c16-440d30c5f0a7 could not be found. Aug 04 10:53:54.583047 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: action_args: {'id': '60fd5618-274c-47e7-8c16-440d30c5f0a7'} Aug 04 10:53:54.584059 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 10:53:54.584059 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:53:54.584059 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 10:53:54.584059 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 10:53:54.584059 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 10:53:54.584059 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 10:53:54.584059 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 10:53:54.584059 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 10:53:54.584059 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 10:53:54.584059 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 10:53:54.584059 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 60fd5618-274c-47e7-8c16-440d30c5f0a7 could not be found. Aug 04 10:53:54.584059 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi Aug 04 10:53:54.584059 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:53:54.584059 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi Aug 04 10:53:54.584059 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:53:54.584059 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:53:54.584059 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:53:54.584059 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 10:53:54.584059 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 10:53:54.584059 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 10:53:54.586213 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 10:53:54.586213 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 10:53:54.586213 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 10:53:54.586213 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 10:53:54.586213 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 10:53:54.586213 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 10:53:54.586213 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 10:53:54.586213 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 60fd5618-274c-47e7-8c16-440d30c5f0a7 could not be found. Aug 04 10:53:54.586213 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi Aug 04 10:53:54.586213 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:53:54.586213 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi Aug 04 10:53:54.586213 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:53:54.586213 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:53:54.586213 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:53:54.586213 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 10:53:54.586213 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 10:53:54.586213 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 60fd5618-274c-47e7-8c16-440d30c5f0a7 could not be found. Aug 04 10:53:54.586213 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi Aug 04 10:53:54.588164 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-71982693-cd07-449a-84b2-972b913e5e93 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Returning 404 to user: Instance 60fd5618-274c-47e7-8c16-440d30c5f0a7 could not be found. {{(pid=124456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 10:53:54.588164 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-71982693-cd07-449a-84b2-972b913e5e93 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] 10.222.0.121 "GET /compute/v2.1/servers/60fd5618-274c-47e7-8c16-440d30c5f0a7" status: 404 len: 111 microversion: 2.1 time: 0.037146 Aug 04 10:53:54.588164 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 605/1212] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:53:54 2022] GET /compute/v2.1/servers/60fd5618-274c-47e7-8c16-440d30c5f0a7 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 10:53:54.593626 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-5e3784e0-c521-4aa6-8e26-4f0e3fdf9649 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] Calling method '.version_select at 0x7f6755a8fca0>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:53:54.620997 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-5e3784e0-c521-4aa6-8e26-4f0e3fdf9649 tempest-TestMinimumBasicScenario-1913138961 tempest-TestMinimumBasicScenario-1913138961-project] 10.222.0.121 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-756766779" status: 202 len: 0 microversion: 2.1 time: 0.032169 Aug 04 10:53:54.621766 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 608/1213] 10.222.0.121 () {58 vars in 1274 bytes} [Thu Aug 4 10:53:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-756766779 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 10:54:12.976786 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG dbcounter [-] [124456] Writing DB stats nova_api:SELECT=14 {{(pid=124456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:54:12.977639 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG dbcounter [-] [124456] Writing DB stats nova_cell1:SELECT=35,nova_cell1:INSERT=1 {{(pid=124456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:54:13.174106 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-d7512b04-14d2-45a6-a01c-e5f7296a9a11 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Action: 'create', calling method: .version_select at 0x7f67550bc430>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1596207310", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNboYY1EXLY3O+aHoD8PuimydwolOQYVqPo7R2AozN32PGwDybFIMYybITCufBZ/hOhCSktUK1EiSSUlYSX4cOWN9upUY04s37zOGXxlwWJD4B65Myww4oblQyh41DCgow=="}} {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:54:13.191104 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.quota [None req-d7512b04-14d2-45a6-a01c-e5f7296a9a11 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Getting quotas for project 400197e1b8db4603a2a036b3ee157baa. Resources: {'key_pairs'} {{(pid=124456) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 10:54:13.195694 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.quota [None req-d7512b04-14d2-45a6-a01c-e5f7296a9a11 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Getting quotas for user 921f73ae6c314135a57c1561de5fd9d1 and project 400197e1b8db4603a2a036b3ee157baa. Resources: {'key_pairs'} {{(pid=124456) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 10:54:13.223650 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-d7512b04-14d2-45a6-a01c-e5f7296a9a11 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] 10.222.0.121 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.254314 Aug 04 10:54:13.224350 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 606/1214] 10.222.0.121 () {60 vars in 1164 bytes} [Thu Aug 4 10:54:12 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:54:36.065053 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-e3dbe456-b70e-481b-b18d-bec5de9bc3ad tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1755469736", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1596207310", "security_groups": [{"name": "tempest-secgroup-smoke-1576076930"}], "block_device_mapping_v2": [{"uuid": "5da2be98-47b4-4d82-8aa7-d477593b8858", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "2e9a33b3-fabb-450d-8608-d2c3c857e172"}]}} {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:54:36.078043 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG dbcounter [-] [124457] Writing DB stats nova_cell1:SELECT=36,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:54:36.079232 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG dbcounter [-] [124457] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=124457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:54:36.198669 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.network.neutron [None req-e3dbe456-b70e-481b-b18d-bec5de9bc3ad tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] validate_networks() for [('2e9a33b3-fabb-450d-8608-d2c3c857e172', None, None, None, None, None)] {{(pid=124457) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 10:54:36.615928 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.virt.hardware [None req-e3dbe456-b70e-481b-b18d-bec5de9bc3ad tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Flavor limits 0:0:0 {{(pid=124457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 10:54:36.616526 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.virt.hardware [None req-e3dbe456-b70e-481b-b18d-bec5de9bc3ad tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Image limits 0:0:0 {{(pid=124457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 10:54:36.617196 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.virt.hardware [None req-e3dbe456-b70e-481b-b18d-bec5de9bc3ad tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Flavor pref 0:0:0 {{(pid=124457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 10:54:36.617602 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.virt.hardware [None req-e3dbe456-b70e-481b-b18d-bec5de9bc3ad tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Image pref 0:0:0 {{(pid=124457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 10:54:36.618122 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.virt.hardware [None req-e3dbe456-b70e-481b-b18d-bec5de9bc3ad tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124457) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 10:54:36.629032 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-e3dbe456-b70e-481b-b18d-bec5de9bc3ad tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:54:36.629595 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-e3dbe456-b70e-481b-b18d-bec5de9bc3ad tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:54:36.630863 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-e3dbe456-b70e-481b-b18d-bec5de9bc3ad tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:54:36.631476 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-e3dbe456-b70e-481b-b18d-bec5de9bc3ad tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:54:36.654609 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.quota [None req-e3dbe456-b70e-481b-b18d-bec5de9bc3ad tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Getting quotas for project 400197e1b8db4603a2a036b3ee157baa. Resources: {'ram', 'instances', 'cores'} {{(pid=124457) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 10:54:36.660226 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.quota [None req-e3dbe456-b70e-481b-b18d-bec5de9bc3ad tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Getting quotas for user 921f73ae6c314135a57c1561de5fd9d1 and project 400197e1b8db4603a2a036b3ee157baa. Resources: {'ram', 'instances', 'cores'} {{(pid=124457) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 10:54:36.722199 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-e3dbe456-b70e-481b-b18d-bec5de9bc3ad tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Going to run 1 instances... {{(pid=124457) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 10:54:36.724537 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-e3dbe456-b70e-481b-b18d-bec5de9bc3ad tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] [instance: 81551e3b-0b6c-4f69-bc1c-1e752b601ef5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='5da2be98-47b4-4d82-8aa7-d477593b8858',volume_size=None,volume_type=None)] {{(pid=124457) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 10:54:36.860195 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-e3dbe456-b70e-481b-b18d-bec5de9bc3ad tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] 10.222.0.121 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.800100 Aug 04 10:54:36.860874 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 609/1215] 10.222.0.121 () {60 vars in 1152 bytes} [Thu Aug 4 10:54:36 2022] POST /compute/v2.1/servers => generated 408 bytes in 802 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 04 10:54:36.873206 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG dbcounter [-] [124456] Writing DB stats nova_cell0:SELECT=4 {{(pid=124456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:54:36.874824 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG dbcounter [-] [124456] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=124456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:54:36.879633 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-99108c74-a255-44f9-a7f9-29d761c21d8d tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:54:36.880355 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-99108c74-a255-44f9-a7f9-29d761c21d8d tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] [instance: 81551e3b-0b6c-4f69-bc1c-1e752b601ef5] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:54:36.935995 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-99108c74-a255-44f9-a7f9-29d761c21d8d tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921f73ae6c314135a57c1561de5fd9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400197e1b8db4603a2a036b3ee157baa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:54:36.944596 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-99108c74-a255-44f9-a7f9-29d761c21d8d tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] 10.222.0.121 "GET /compute/v2.1/servers/81551e3b-0b6c-4f69-bc1c-1e752b601ef5" status: 200 len: 1098 microversion: 2.1 time: 0.074138 Aug 04 10:54:36.945205 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 607/1216] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:54:36 2022] GET /compute/v2.1/servers/81551e3b-0b6c-4f69-bc1c-1e752b601ef5 => generated 1098 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:54:37.968734 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-32542e58-9c06-4243-b73d-a44205c91da1 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:54:37.969519 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-32542e58-9c06-4243-b73d-a44205c91da1 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] [instance: 81551e3b-0b6c-4f69-bc1c-1e752b601ef5] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:54:38.031721 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-32542e58-9c06-4243-b73d-a44205c91da1 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921f73ae6c314135a57c1561de5fd9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400197e1b8db4603a2a036b3ee157baa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:54:38.039171 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-32542e58-9c06-4243-b73d-a44205c91da1 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] 10.222.0.121 "GET /compute/v2.1/servers/81551e3b-0b6c-4f69-bc1c-1e752b601ef5" status: 200 len: 1098 microversion: 2.1 time: 0.077178 Aug 04 10:54:38.039771 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 610/1217] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:54:37 2022] GET /compute/v2.1/servers/81551e3b-0b6c-4f69-bc1c-1e752b601ef5 => generated 1098 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:54:39.062336 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-03a3cf81-49c2-444e-8a81-c6afad3619c1 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:54:39.062978 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-03a3cf81-49c2-444e-8a81-c6afad3619c1 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] [instance: 81551e3b-0b6c-4f69-bc1c-1e752b601ef5] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:54:39.120642 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-03a3cf81-49c2-444e-8a81-c6afad3619c1 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921f73ae6c314135a57c1561de5fd9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400197e1b8db4603a2a036b3ee157baa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:54:39.127725 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-03a3cf81-49c2-444e-8a81-c6afad3619c1 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] 10.222.0.121 "GET /compute/v2.1/servers/81551e3b-0b6c-4f69-bc1c-1e752b601ef5" status: 200 len: 1098 microversion: 2.1 time: 0.069460 Aug 04 10:54:39.141632 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 608/1218] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:54:39 2022] GET /compute/v2.1/servers/81551e3b-0b6c-4f69-bc1c-1e752b601ef5 => generated 1098 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:54:40.149126 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-5a081bee-37ad-4a9e-802a-14f882b17eef tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:54:40.149852 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-5a081bee-37ad-4a9e-802a-14f882b17eef tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] [instance: 81551e3b-0b6c-4f69-bc1c-1e752b601ef5] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:54:40.210467 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-5a081bee-37ad-4a9e-802a-14f882b17eef tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921f73ae6c314135a57c1561de5fd9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400197e1b8db4603a2a036b3ee157baa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:54:40.218177 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-5a081bee-37ad-4a9e-802a-14f882b17eef tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] 10.222.0.121 "GET /compute/v2.1/servers/81551e3b-0b6c-4f69-bc1c-1e752b601ef5" status: 200 len: 1098 microversion: 2.1 time: 0.073009 Aug 04 10:54:40.218763 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 611/1219] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:54:40 2022] GET /compute/v2.1/servers/81551e3b-0b6c-4f69-bc1c-1e752b601ef5 => generated 1098 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:54:41.243328 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-fae23c5d-a25d-4d55-af22-54dccf08b13d tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:54:41.243914 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-fae23c5d-a25d-4d55-af22-54dccf08b13d tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] [instance: 81551e3b-0b6c-4f69-bc1c-1e752b601ef5] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:54:41.251913 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-fae23c5d-a25d-4d55-af22-54dccf08b13d tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:54:41.252621 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-fae23c5d-a25d-4d55-af22-54dccf08b13d tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:54:41.253414 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-fae23c5d-a25d-4d55-af22-54dccf08b13d tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:54:41.253848 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-fae23c5d-a25d-4d55-af22-54dccf08b13d tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:54:41.319175 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-fae23c5d-a25d-4d55-af22-54dccf08b13d tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921f73ae6c314135a57c1561de5fd9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400197e1b8db4603a2a036b3ee157baa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:54:41.327654 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-fae23c5d-a25d-4d55-af22-54dccf08b13d tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] 10.222.0.121 "GET /compute/v2.1/servers/81551e3b-0b6c-4f69-bc1c-1e752b601ef5" status: 200 len: 1148 microversion: 2.1 time: 0.089149 Aug 04 10:54:41.328264 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 609/1220] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:54:41 2022] GET /compute/v2.1/servers/81551e3b-0b6c-4f69-bc1c-1e752b601ef5 => generated 1148 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:54:42.351515 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-e9868008-dbd3-4529-9537-5eca5f5b262a tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:54:42.352210 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-e9868008-dbd3-4529-9537-5eca5f5b262a tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] [instance: 81551e3b-0b6c-4f69-bc1c-1e752b601ef5] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:54:42.360051 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-e9868008-dbd3-4529-9537-5eca5f5b262a tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:54:42.360622 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-e9868008-dbd3-4529-9537-5eca5f5b262a tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:54:42.361575 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-e9868008-dbd3-4529-9537-5eca5f5b262a tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:54:42.362022 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-e9868008-dbd3-4529-9537-5eca5f5b262a tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:54:42.495402 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-e9868008-dbd3-4529-9537-5eca5f5b262a tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921f73ae6c314135a57c1561de5fd9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400197e1b8db4603a2a036b3ee157baa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:54:42.503528 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-e9868008-dbd3-4529-9537-5eca5f5b262a tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] 10.222.0.121 "GET /compute/v2.1/servers/81551e3b-0b6c-4f69-bc1c-1e752b601ef5" status: 200 len: 1214 microversion: 2.1 time: 0.156461 Aug 04 10:54:42.504162 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 612/1221] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:54:42 2022] GET /compute/v2.1/servers/81551e3b-0b6c-4f69-bc1c-1e752b601ef5 => generated 1214 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:54:43.524674 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-f7418422-ad8d-4fe0-a519-9949c6e1ea3f tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:54:43.525388 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-f7418422-ad8d-4fe0-a519-9949c6e1ea3f tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] [instance: 81551e3b-0b6c-4f69-bc1c-1e752b601ef5] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:54:43.532764 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-f7418422-ad8d-4fe0-a519-9949c6e1ea3f tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:54:43.533218 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-f7418422-ad8d-4fe0-a519-9949c6e1ea3f tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:54:43.534025 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-f7418422-ad8d-4fe0-a519-9949c6e1ea3f tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:54:43.534468 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-f7418422-ad8d-4fe0-a519-9949c6e1ea3f tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:54:43.730299 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-f7418422-ad8d-4fe0-a519-9949c6e1ea3f tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921f73ae6c314135a57c1561de5fd9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400197e1b8db4603a2a036b3ee157baa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:54:43.739068 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-f7418422-ad8d-4fe0-a519-9949c6e1ea3f tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] 10.222.0.121 "GET /compute/v2.1/servers/81551e3b-0b6c-4f69-bc1c-1e752b601ef5" status: 200 len: 1270 microversion: 2.1 time: 0.218296 Aug 04 10:54:43.739682 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 610/1222] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:54:43 2022] GET /compute/v2.1/servers/81551e3b-0b6c-4f69-bc1c-1e752b601ef5 => generated 1270 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:54:44.020747 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [req-74ed101e-303e-479a-960e-a2a3f749f931 req-a7131fa5-00b8-4e4a-b9bf-5dba0dcf464d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "81551e3b-0b6c-4f69-bc1c-1e752b601ef5", "tag": "38eb1084-28d5-4c95-8ab5-698f4ee684b1"}]} {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:54:44.032233 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [req-74ed101e-303e-479a-960e-a2a3f749f931 req-a7131fa5-00b8-4e4a-b9bf-5dba0dcf464d service nova] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:54:44.032971 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [req-74ed101e-303e-479a-960e-a2a3f749f931 req-a7131fa5-00b8-4e4a-b9bf-5dba0dcf464d service nova] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:54:44.045007 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.compute.server_external_events [req-74ed101e-303e-479a-960e-a2a3f749f931 req-a7131fa5-00b8-4e4a-b9bf-5dba0dcf464d service nova] Creating event network-changed:38eb1084-28d5-4c95-8ab5-698f4ee684b1 for instance 81551e3b-0b6c-4f69-bc1c-1e752b601ef5 on hv-cinder-85200 Aug 04 10:54:44.050598 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [req-74ed101e-303e-479a-960e-a2a3f749f931 req-a7131fa5-00b8-4e4a-b9bf-5dba0dcf464d service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033790 Aug 04 10:54:44.051349 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 613/1223] 10.222.0.121 () {64 vars in 1322 bytes} [Thu Aug 4 10:54:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 10:54:44.761037 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-e905e3d8-78d3-4dd9-9e17-519e5f963847 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:54:44.761683 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-e905e3d8-78d3-4dd9-9e17-519e5f963847 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] [instance: 81551e3b-0b6c-4f69-bc1c-1e752b601ef5] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:54:44.769053 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-e905e3d8-78d3-4dd9-9e17-519e5f963847 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:54:44.769508 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-e905e3d8-78d3-4dd9-9e17-519e5f963847 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:54:44.770290 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-e905e3d8-78d3-4dd9-9e17-519e5f963847 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:54:44.770728 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-e905e3d8-78d3-4dd9-9e17-519e5f963847 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:54:44.910752 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-e905e3d8-78d3-4dd9-9e17-519e5f963847 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921f73ae6c314135a57c1561de5fd9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400197e1b8db4603a2a036b3ee157baa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:54:44.919492 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-e905e3d8-78d3-4dd9-9e17-519e5f963847 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] 10.222.0.121 "GET /compute/v2.1/servers/81551e3b-0b6c-4f69-bc1c-1e752b601ef5" status: 200 len: 1270 microversion: 2.1 time: 0.162624 Aug 04 10:54:44.920166 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 611/1224] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:54:44 2022] GET /compute/v2.1/servers/81551e3b-0b6c-4f69-bc1c-1e752b601ef5 => generated 1270 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:54:45.290751 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 10:54:45.291049 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: Thu Aug 4 10:54:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 10:54:45.942650 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-72fe5cd1-9975-4fb8-ba52-5adaa80f8fb7 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:54:45.943392 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-72fe5cd1-9975-4fb8-ba52-5adaa80f8fb7 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] [instance: 81551e3b-0b6c-4f69-bc1c-1e752b601ef5] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:54:45.953935 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-72fe5cd1-9975-4fb8-ba52-5adaa80f8fb7 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:54:45.954390 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-72fe5cd1-9975-4fb8-ba52-5adaa80f8fb7 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:54:45.955177 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-72fe5cd1-9975-4fb8-ba52-5adaa80f8fb7 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:54:45.955619 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-72fe5cd1-9975-4fb8-ba52-5adaa80f8fb7 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:54:46.101873 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-72fe5cd1-9975-4fb8-ba52-5adaa80f8fb7 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921f73ae6c314135a57c1561de5fd9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400197e1b8db4603a2a036b3ee157baa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:54:46.109852 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-72fe5cd1-9975-4fb8-ba52-5adaa80f8fb7 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] 10.222.0.121 "GET /compute/v2.1/servers/81551e3b-0b6c-4f69-bc1c-1e752b601ef5" status: 200 len: 1270 microversion: 2.1 time: 0.172145 Aug 04 10:54:46.110448 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 614/1225] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:54:45 2022] GET /compute/v2.1/servers/81551e3b-0b6c-4f69-bc1c-1e752b601ef5 => generated 1270 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:54:47.131728 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-9842b559-ab51-4228-a461-3159a47b35f3 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:54:47.132484 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-9842b559-ab51-4228-a461-3159a47b35f3 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] [instance: 81551e3b-0b6c-4f69-bc1c-1e752b601ef5] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:54:47.140163 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-9842b559-ab51-4228-a461-3159a47b35f3 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:54:47.140659 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-9842b559-ab51-4228-a461-3159a47b35f3 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:54:47.141447 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-9842b559-ab51-4228-a461-3159a47b35f3 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:54:47.141896 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-9842b559-ab51-4228-a461-3159a47b35f3 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:54:47.285045 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-9842b559-ab51-4228-a461-3159a47b35f3 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921f73ae6c314135a57c1561de5fd9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400197e1b8db4603a2a036b3ee157baa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:54:47.293518 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-9842b559-ab51-4228-a461-3159a47b35f3 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] 10.222.0.121 "GET /compute/v2.1/servers/81551e3b-0b6c-4f69-bc1c-1e752b601ef5" status: 200 len: 1270 microversion: 2.1 time: 0.166057 Aug 04 10:54:47.294084 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 612/1226] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:54:47 2022] GET /compute/v2.1/servers/81551e3b-0b6c-4f69-bc1c-1e752b601ef5 => generated 1270 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:54:48.314930 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-31a86304-34de-4105-960a-b7df453848e7 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:54:48.315656 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-31a86304-34de-4105-960a-b7df453848e7 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] [instance: 81551e3b-0b6c-4f69-bc1c-1e752b601ef5] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:54:48.317588 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG dbcounter [-] [124457] Writing DB stats nova_cell0:SELECT=2 {{(pid=124457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:54:48.323886 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-31a86304-34de-4105-960a-b7df453848e7 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:54:48.324392 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-31a86304-34de-4105-960a-b7df453848e7 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:54:48.325163 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-31a86304-34de-4105-960a-b7df453848e7 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:54:48.325598 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-31a86304-34de-4105-960a-b7df453848e7 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:54:48.468504 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-31a86304-34de-4105-960a-b7df453848e7 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921f73ae6c314135a57c1561de5fd9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400197e1b8db4603a2a036b3ee157baa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:54:48.480764 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-31a86304-34de-4105-960a-b7df453848e7 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] 10.222.0.121 "GET /compute/v2.1/servers/81551e3b-0b6c-4f69-bc1c-1e752b601ef5" status: 200 len: 1270 microversion: 2.1 time: 0.169240 Aug 04 10:54:48.481422 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 615/1227] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:54:48 2022] GET /compute/v2.1/servers/81551e3b-0b6c-4f69-bc1c-1e752b601ef5 => generated 1270 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:54:49.502080 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-83a87fe4-e65a-4cdf-97b0-0fe62b5befe9 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:54:49.502797 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-83a87fe4-e65a-4cdf-97b0-0fe62b5befe9 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] [instance: 81551e3b-0b6c-4f69-bc1c-1e752b601ef5] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:54:49.505361 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG dbcounter [-] [124456] Writing DB stats nova_cell0:SELECT=4 {{(pid=124456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:54:49.512426 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-83a87fe4-e65a-4cdf-97b0-0fe62b5befe9 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:54:49.513079 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-83a87fe4-e65a-4cdf-97b0-0fe62b5befe9 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:54:49.513957 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-83a87fe4-e65a-4cdf-97b0-0fe62b5befe9 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:54:49.514541 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-83a87fe4-e65a-4cdf-97b0-0fe62b5befe9 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:54:49.654932 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-83a87fe4-e65a-4cdf-97b0-0fe62b5befe9 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921f73ae6c314135a57c1561de5fd9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400197e1b8db4603a2a036b3ee157baa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:54:49.663298 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-83a87fe4-e65a-4cdf-97b0-0fe62b5befe9 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] 10.222.0.121 "GET /compute/v2.1/servers/81551e3b-0b6c-4f69-bc1c-1e752b601ef5" status: 200 len: 1270 microversion: 2.1 time: 0.165318 Aug 04 10:54:49.663877 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 613/1228] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:54:49 2022] GET /compute/v2.1/servers/81551e3b-0b6c-4f69-bc1c-1e752b601ef5 => generated 1270 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:54:50.684705 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-c83d3545-b836-4c1e-afac-3fd2c786b37c tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:54:50.685430 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-c83d3545-b836-4c1e-afac-3fd2c786b37c tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] [instance: 81551e3b-0b6c-4f69-bc1c-1e752b601ef5] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:54:50.687971 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG dbcounter [-] [124457] Writing DB stats nova_cell0:SELECT=10 {{(pid=124457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:54:50.694339 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-c83d3545-b836-4c1e-afac-3fd2c786b37c tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:54:50.694778 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-c83d3545-b836-4c1e-afac-3fd2c786b37c tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:54:50.695578 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-c83d3545-b836-4c1e-afac-3fd2c786b37c tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:54:50.696046 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-c83d3545-b836-4c1e-afac-3fd2c786b37c tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:54:50.856117 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-c83d3545-b836-4c1e-afac-3fd2c786b37c tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921f73ae6c314135a57c1561de5fd9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400197e1b8db4603a2a036b3ee157baa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:54:50.864104 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-c83d3545-b836-4c1e-afac-3fd2c786b37c tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] 10.222.0.121 "GET /compute/v2.1/servers/81551e3b-0b6c-4f69-bc1c-1e752b601ef5" status: 200 len: 1270 microversion: 2.1 time: 0.183453 Aug 04 10:54:50.864735 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 616/1229] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:54:50 2022] GET /compute/v2.1/servers/81551e3b-0b6c-4f69-bc1c-1e752b601ef5 => generated 1270 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:54:51.885859 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-0e87eef5-46d8-4602-810b-a284e6c4ae4e tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:54:51.886572 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-0e87eef5-46d8-4602-810b-a284e6c4ae4e tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] [instance: 81551e3b-0b6c-4f69-bc1c-1e752b601ef5] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:54:51.894111 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-0e87eef5-46d8-4602-810b-a284e6c4ae4e tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:54:51.894575 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-0e87eef5-46d8-4602-810b-a284e6c4ae4e tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:54:51.895450 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-0e87eef5-46d8-4602-810b-a284e6c4ae4e tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:54:51.895926 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-0e87eef5-46d8-4602-810b-a284e6c4ae4e tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:54:52.042067 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-0e87eef5-46d8-4602-810b-a284e6c4ae4e tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921f73ae6c314135a57c1561de5fd9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400197e1b8db4603a2a036b3ee157baa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:54:52.050539 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-0e87eef5-46d8-4602-810b-a284e6c4ae4e tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] 10.222.0.121 "GET /compute/v2.1/servers/81551e3b-0b6c-4f69-bc1c-1e752b601ef5" status: 200 len: 1270 microversion: 2.1 time: 0.168813 Aug 04 10:54:52.051196 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 614/1230] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:54:51 2022] GET /compute/v2.1/servers/81551e3b-0b6c-4f69-bc1c-1e752b601ef5 => generated 1270 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:54:53.071936 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-7e851a12-e57a-49ee-9ae1-fdb5c5ba3cb6 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:54:53.072745 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-7e851a12-e57a-49ee-9ae1-fdb5c5ba3cb6 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] [instance: 81551e3b-0b6c-4f69-bc1c-1e752b601ef5] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:54:53.079886 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-7e851a12-e57a-49ee-9ae1-fdb5c5ba3cb6 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:54:53.080373 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-7e851a12-e57a-49ee-9ae1-fdb5c5ba3cb6 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:54:53.081170 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-7e851a12-e57a-49ee-9ae1-fdb5c5ba3cb6 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:54:53.081597 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-7e851a12-e57a-49ee-9ae1-fdb5c5ba3cb6 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:54:53.226956 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-7e851a12-e57a-49ee-9ae1-fdb5c5ba3cb6 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921f73ae6c314135a57c1561de5fd9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400197e1b8db4603a2a036b3ee157baa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:54:53.235003 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-7e851a12-e57a-49ee-9ae1-fdb5c5ba3cb6 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] 10.222.0.121 "GET /compute/v2.1/servers/81551e3b-0b6c-4f69-bc1c-1e752b601ef5" status: 200 len: 1270 microversion: 2.1 time: 0.167483 Aug 04 10:54:53.235652 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 617/1231] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:54:53 2022] GET /compute/v2.1/servers/81551e3b-0b6c-4f69-bc1c-1e752b601ef5 => generated 1270 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:54:54.256094 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-cdda6769-5046-49f7-ac14-adcfd716cf52 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:54:54.256817 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-cdda6769-5046-49f7-ac14-adcfd716cf52 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] [instance: 81551e3b-0b6c-4f69-bc1c-1e752b601ef5] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:54:54.264208 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-cdda6769-5046-49f7-ac14-adcfd716cf52 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:54:54.264670 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-cdda6769-5046-49f7-ac14-adcfd716cf52 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:54:54.265463 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-cdda6769-5046-49f7-ac14-adcfd716cf52 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:54:54.265906 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-cdda6769-5046-49f7-ac14-adcfd716cf52 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:54:54.414024 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-cdda6769-5046-49f7-ac14-adcfd716cf52 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921f73ae6c314135a57c1561de5fd9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400197e1b8db4603a2a036b3ee157baa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:54:54.422154 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-cdda6769-5046-49f7-ac14-adcfd716cf52 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] 10.222.0.121 "GET /compute/v2.1/servers/81551e3b-0b6c-4f69-bc1c-1e752b601ef5" status: 200 len: 1270 microversion: 2.1 time: 0.170250 Aug 04 10:54:54.422769 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 615/1232] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:54:54 2022] GET /compute/v2.1/servers/81551e3b-0b6c-4f69-bc1c-1e752b601ef5 => generated 1270 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:54:55.141056 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [req-cd6a1d44-b115-4c19-9ed6-da7bb07800e3 req-d6827dc3-faaa-453e-b8af-b3fa5f8a8c45 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81551e3b-0b6c-4f69-bc1c-1e752b601ef5", "name": "network-vif-plugged", "status": "completed", "tag": "38eb1084-28d5-4c95-8ab5-698f4ee684b1"}]} {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:54:55.152016 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [req-cd6a1d44-b115-4c19-9ed6-da7bb07800e3 req-d6827dc3-faaa-453e-b8af-b3fa5f8a8c45 service nova] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:54:55.152435 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [req-cd6a1d44-b115-4c19-9ed6-da7bb07800e3 req-d6827dc3-faaa-453e-b8af-b3fa5f8a8c45 service nova] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:54:55.165056 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.compute.server_external_events [req-cd6a1d44-b115-4c19-9ed6-da7bb07800e3 req-d6827dc3-faaa-453e-b8af-b3fa5f8a8c45 service nova] Creating event network-vif-plugged:38eb1084-28d5-4c95-8ab5-698f4ee684b1 for instance 81551e3b-0b6c-4f69-bc1c-1e752b601ef5 on hv-cinder-85200 Aug 04 10:54:55.170776 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [req-cd6a1d44-b115-4c19-9ed6-da7bb07800e3 req-d6827dc3-faaa-453e-b8af-b3fa5f8a8c45 service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033717 Aug 04 10:54:55.171426 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 618/1233] 10.222.0.121 () {64 vars in 1322 bytes} [Thu Aug 4 10:54:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:54:55.443398 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-5fc7a674-fe5b-4bf4-a5e7-1bec4106b7a8 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:54:55.444134 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-5fc7a674-fe5b-4bf4-a5e7-1bec4106b7a8 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] [instance: 81551e3b-0b6c-4f69-bc1c-1e752b601ef5] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:54:55.451400 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-5fc7a674-fe5b-4bf4-a5e7-1bec4106b7a8 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:54:55.452072 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-5fc7a674-fe5b-4bf4-a5e7-1bec4106b7a8 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:54:55.452830 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-5fc7a674-fe5b-4bf4-a5e7-1bec4106b7a8 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:54:55.453280 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-5fc7a674-fe5b-4bf4-a5e7-1bec4106b7a8 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:54:55.599663 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-5fc7a674-fe5b-4bf4-a5e7-1bec4106b7a8 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921f73ae6c314135a57c1561de5fd9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400197e1b8db4603a2a036b3ee157baa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:54:55.607659 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-5fc7a674-fe5b-4bf4-a5e7-1bec4106b7a8 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] 10.222.0.121 "GET /compute/v2.1/servers/81551e3b-0b6c-4f69-bc1c-1e752b601ef5" status: 200 len: 1270 microversion: 2.1 time: 0.168506 Aug 04 10:54:55.608324 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 616/1234] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:54:55 2022] GET /compute/v2.1/servers/81551e3b-0b6c-4f69-bc1c-1e752b601ef5 => generated 1270 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:54:56.633832 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-a9182279-acce-4833-9688-22d0b7b03850 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:54:56.634897 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-a9182279-acce-4833-9688-22d0b7b03850 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] [instance: 81551e3b-0b6c-4f69-bc1c-1e752b601ef5] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:54:56.645161 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-a9182279-acce-4833-9688-22d0b7b03850 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:54:56.645738 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-a9182279-acce-4833-9688-22d0b7b03850 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:54:56.646523 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-a9182279-acce-4833-9688-22d0b7b03850 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:54:56.646960 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-a9182279-acce-4833-9688-22d0b7b03850 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:54:56.792409 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-a9182279-acce-4833-9688-22d0b7b03850 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921f73ae6c314135a57c1561de5fd9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400197e1b8db4603a2a036b3ee157baa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:54:56.801066 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-a9182279-acce-4833-9688-22d0b7b03850 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] 10.222.0.121 "GET /compute/v2.1/servers/81551e3b-0b6c-4f69-bc1c-1e752b601ef5" status: 200 len: 1270 microversion: 2.1 time: 0.175004 Aug 04 10:54:56.801786 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 619/1235] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:54:56 2022] GET /compute/v2.1/servers/81551e3b-0b6c-4f69-bc1c-1e752b601ef5 => generated 1270 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:54:57.822827 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-19971032-048a-45c2-8013-28fa99b1ad4a tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:54:57.823476 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-19971032-048a-45c2-8013-28fa99b1ad4a tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] [instance: 81551e3b-0b6c-4f69-bc1c-1e752b601ef5] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:54:57.830826 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-19971032-048a-45c2-8013-28fa99b1ad4a tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:54:57.831278 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-19971032-048a-45c2-8013-28fa99b1ad4a tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:54:57.832092 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-19971032-048a-45c2-8013-28fa99b1ad4a tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:54:57.832532 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-19971032-048a-45c2-8013-28fa99b1ad4a tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:54:57.977332 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-19971032-048a-45c2-8013-28fa99b1ad4a tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921f73ae6c314135a57c1561de5fd9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400197e1b8db4603a2a036b3ee157baa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:54:57.985697 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-19971032-048a-45c2-8013-28fa99b1ad4a tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] 10.222.0.121 "GET /compute/v2.1/servers/81551e3b-0b6c-4f69-bc1c-1e752b601ef5" status: 200 len: 1458 microversion: 2.1 time: 0.167094 Aug 04 10:54:57.986289 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 617/1236] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:54:57 2022] GET /compute/v2.1/servers/81551e3b-0b6c-4f69-bc1c-1e752b601ef5 => generated 1458 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:54:58.006766 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-0c23a9b4-e434-4b63-b0d4-bb6d6111a0e9 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:54:58.007462 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-0c23a9b4-e434-4b63-b0d4-bb6d6111a0e9 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] [instance: 81551e3b-0b6c-4f69-bc1c-1e752b601ef5] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:54:58.014770 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-0c23a9b4-e434-4b63-b0d4-bb6d6111a0e9 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:54:58.015228 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-0c23a9b4-e434-4b63-b0d4-bb6d6111a0e9 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:54:58.016100 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-0c23a9b4-e434-4b63-b0d4-bb6d6111a0e9 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:54:58.016641 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-0c23a9b4-e434-4b63-b0d4-bb6d6111a0e9 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:54:58.155567 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-0c23a9b4-e434-4b63-b0d4-bb6d6111a0e9 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921f73ae6c314135a57c1561de5fd9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400197e1b8db4603a2a036b3ee157baa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:54:58.164324 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-0c23a9b4-e434-4b63-b0d4-bb6d6111a0e9 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] 10.222.0.121 "GET /compute/v2.1/servers/81551e3b-0b6c-4f69-bc1c-1e752b601ef5" status: 200 len: 1458 microversion: 2.1 time: 0.161538 Aug 04 10:54:58.164898 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 620/1237] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:54:58 2022] GET /compute/v2.1/servers/81551e3b-0b6c-4f69-bc1c-1e752b601ef5 => generated 1458 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:54:59.946443 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [req-574fea6d-984c-47c8-87d7-5b9702552957 req-9095901f-a76f-4834-83ea-e011c5c5c693 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "81551e3b-0b6c-4f69-bc1c-1e752b601ef5", "tag": "38eb1084-28d5-4c95-8ab5-698f4ee684b1"}]} {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:54:59.956392 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [req-574fea6d-984c-47c8-87d7-5b9702552957 req-9095901f-a76f-4834-83ea-e011c5c5c693 service nova] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:54:59.956841 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [req-574fea6d-984c-47c8-87d7-5b9702552957 req-9095901f-a76f-4834-83ea-e011c5c5c693 service nova] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:54:59.970085 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.compute.server_external_events [req-574fea6d-984c-47c8-87d7-5b9702552957 req-9095901f-a76f-4834-83ea-e011c5c5c693 service nova] Creating event network-changed:38eb1084-28d5-4c95-8ab5-698f4ee684b1 for instance 81551e3b-0b6c-4f69-bc1c-1e752b601ef5 on hv-cinder-85200 Aug 04 10:54:59.975831 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [req-574fea6d-984c-47c8-87d7-5b9702552957 req-9095901f-a76f-4834-83ea-e011c5c5c693 service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092528 Aug 04 10:54:59.976514 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 618/1238] 10.222.0.121 () {64 vars in 1322 bytes} [Thu Aug 4 10:54:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:57:14.208806 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ff73ca27-32c4-4048-b311-e0fe8ce0290e] AMQP server on 10.222.0.121:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 04 10:57:14.210343 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG dbcounter [-] [124457] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=124457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:57:14.211674 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG dbcounter [-] [124457] Writing DB stats nova_cell1:SELECT=48 {{(pid=124457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:57:14.218052 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-86cadf97-f9c9-49ef-8a77-9ffdebd1910b tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:57:14.218569 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-86cadf97-f9c9-49ef-8a77-9ffdebd1910b tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] [instance: 81551e3b-0b6c-4f69-bc1c-1e752b601ef5] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:57:14.226328 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-86cadf97-f9c9-49ef-8a77-9ffdebd1910b tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:57:14.226801 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-86cadf97-f9c9-49ef-8a77-9ffdebd1910b tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:57:14.227586 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-86cadf97-f9c9-49ef-8a77-9ffdebd1910b tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:57:14.228065 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-86cadf97-f9c9-49ef-8a77-9ffdebd1910b tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:57:14.254103 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-86cadf97-f9c9-49ef-8a77-9ffdebd1910b tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] [instance: 81551e3b-0b6c-4f69-bc1c-1e752b601ef5] Going to try to terminate instance {{(pid=124457) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 10:57:14.345577 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-86cadf97-f9c9-49ef-8a77-9ffdebd1910b tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] 10.222.0.121 "DELETE /compute/v2.1/servers/81551e3b-0b6c-4f69-bc1c-1e752b601ef5" status: 204 len: 0 microversion: 2.1 time: 0.140593 Aug 04 10:57:14.346195 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 621/1239] 10.222.0.121 () {58 vars in 1244 bytes} [Thu Aug 4 10:57:14 2022] DELETE /compute/v2.1/servers/81551e3b-0b6c-4f69-bc1c-1e752b601ef5 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 10:57:14.353289 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR oslo.messaging._drivers.impl_rabbit [-] [dd8834f0-e294-4e6c-8d02-79028cbbd08c] AMQP server on 10.222.0.121:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Aug 04 10:57:14.353975 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG dbcounter [-] [124456] Writing DB stats nova_api:SELECT=28 {{(pid=124456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:57:14.354746 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG dbcounter [-] [124456] Writing DB stats nova_cell1:SELECT=56 {{(pid=124456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:57:14.359579 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-441cfeff-69c6-441b-821d-ec95e8a18a26 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:57:14.360323 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-441cfeff-69c6-441b-821d-ec95e8a18a26 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] [instance: 81551e3b-0b6c-4f69-bc1c-1e752b601ef5] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:57:14.367701 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-441cfeff-69c6-441b-821d-ec95e8a18a26 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:57:14.368202 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-441cfeff-69c6-441b-821d-ec95e8a18a26 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:57:14.368981 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-441cfeff-69c6-441b-821d-ec95e8a18a26 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:57:14.369414 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-441cfeff-69c6-441b-821d-ec95e8a18a26 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:57:14.508306 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-441cfeff-69c6-441b-821d-ec95e8a18a26 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921f73ae6c314135a57c1561de5fd9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400197e1b8db4603a2a036b3ee157baa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:57:14.516687 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-441cfeff-69c6-441b-821d-ec95e8a18a26 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] 10.222.0.121 "GET /compute/v2.1/servers/81551e3b-0b6c-4f69-bc1c-1e752b601ef5" status: 200 len: 1583 microversion: 2.1 time: 0.165665 Aug 04 10:57:14.517264 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 619/1240] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:57:14 2022] GET /compute/v2.1/servers/81551e3b-0b6c-4f69-bc1c-1e752b601ef5 => generated 1583 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:57:15.542621 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-3c67bd54-46c3-4d21-8734-e88a60ac7599 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:57:15.543715 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-3c67bd54-46c3-4d21-8734-e88a60ac7599 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] [instance: 81551e3b-0b6c-4f69-bc1c-1e752b601ef5] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:57:15.554373 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-3c67bd54-46c3-4d21-8734-e88a60ac7599 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:57:15.554975 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-3c67bd54-46c3-4d21-8734-e88a60ac7599 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:57:15.555773 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-3c67bd54-46c3-4d21-8734-e88a60ac7599 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:57:15.556386 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-3c67bd54-46c3-4d21-8734-e88a60ac7599 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:57:15.562527 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO oslo.messaging._drivers.impl_rabbit [-] [ff73ca27-32c4-4048-b311-e0fe8ce0290e] Reconnected to AMQP server on 10.222.0.121:5672 via [amqp] client with port 41698. Aug 04 10:57:15.702784 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-3c67bd54-46c3-4d21-8734-e88a60ac7599 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921f73ae6c314135a57c1561de5fd9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400197e1b8db4603a2a036b3ee157baa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:57:15.711694 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-3c67bd54-46c3-4d21-8734-e88a60ac7599 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] 10.222.0.121 "GET /compute/v2.1/servers/81551e3b-0b6c-4f69-bc1c-1e752b601ef5" status: 200 len: 1583 microversion: 2.1 time: 0.176182 Aug 04 10:57:15.712612 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 622/1241] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:57:15 2022] GET /compute/v2.1/servers/81551e3b-0b6c-4f69-bc1c-1e752b601ef5 => generated 1583 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:57:16.735561 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-fcd5e16c-76d4-47ba-aea5-c629616f42a6 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:57:16.736256 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-fcd5e16c-76d4-47ba-aea5-c629616f42a6 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] [instance: 81551e3b-0b6c-4f69-bc1c-1e752b601ef5] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:57:16.744434 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-fcd5e16c-76d4-47ba-aea5-c629616f42a6 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:57:16.744878 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-fcd5e16c-76d4-47ba-aea5-c629616f42a6 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:57:16.745672 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-fcd5e16c-76d4-47ba-aea5-c629616f42a6 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:57:16.746116 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-fcd5e16c-76d4-47ba-aea5-c629616f42a6 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:57:16.752652 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO oslo.messaging._drivers.impl_rabbit [-] [dd8834f0-e294-4e6c-8d02-79028cbbd08c] Reconnected to AMQP server on 10.222.0.121:5672 via [amqp] client with port 41702. Aug 04 10:57:16.934228 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-fcd5e16c-76d4-47ba-aea5-c629616f42a6 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921f73ae6c314135a57c1561de5fd9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400197e1b8db4603a2a036b3ee157baa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:57:16.942574 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-fcd5e16c-76d4-47ba-aea5-c629616f42a6 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] 10.222.0.121 "GET /compute/v2.1/servers/81551e3b-0b6c-4f69-bc1c-1e752b601ef5" status: 200 len: 1583 microversion: 2.1 time: 0.212183 Aug 04 10:57:16.943148 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 620/1242] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:57:16 2022] GET /compute/v2.1/servers/81551e3b-0b6c-4f69-bc1c-1e752b601ef5 => generated 1583 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:57:17.632738 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [req-958d475b-4dde-43f3-ab83-80c3dc72f74c req-e6d7bb87-f38b-4cd6-bc24-b6b28d51ce5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81551e3b-0b6c-4f69-bc1c-1e752b601ef5", "name": "network-vif-deleted", "tag": "38eb1084-28d5-4c95-8ab5-698f4ee684b1"}]} {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:57:17.642926 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [req-958d475b-4dde-43f3-ab83-80c3dc72f74c req-e6d7bb87-f38b-4cd6-bc24-b6b28d51ce5f service nova] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:57:17.643603 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [req-958d475b-4dde-43f3-ab83-80c3dc72f74c req-e6d7bb87-f38b-4cd6-bc24-b6b28d51ce5f service nova] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:57:17.655807 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.compute.server_external_events [req-958d475b-4dde-43f3-ab83-80c3dc72f74c req-e6d7bb87-f38b-4cd6-bc24-b6b28d51ce5f service nova] Creating event network-vif-deleted:38eb1084-28d5-4c95-8ab5-698f4ee684b1 for instance 81551e3b-0b6c-4f69-bc1c-1e752b601ef5 on hv-cinder-85200 Aug 04 10:57:17.661569 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [req-958d475b-4dde-43f3-ab83-80c3dc72f74c req-e6d7bb87-f38b-4cd6-bc24-b6b28d51ce5f service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101606 Aug 04 10:57:17.662484 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 623/1243] 10.222.0.121 () {64 vars in 1322 bytes} [Thu Aug 4 10:57:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:57:17.964700 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-ab1f4d9a-c8c6-4293-9998-84b0d2b8694b tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:57:17.965322 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-ab1f4d9a-c8c6-4293-9998-84b0d2b8694b tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] [instance: 81551e3b-0b6c-4f69-bc1c-1e752b601ef5] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:57:17.972849 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-ab1f4d9a-c8c6-4293-9998-84b0d2b8694b tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:57:17.973308 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-ab1f4d9a-c8c6-4293-9998-84b0d2b8694b tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:57:17.974148 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-ab1f4d9a-c8c6-4293-9998-84b0d2b8694b tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:57:17.974600 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-ab1f4d9a-c8c6-4293-9998-84b0d2b8694b tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:57:18.044061 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-ab1f4d9a-c8c6-4293-9998-84b0d2b8694b tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921f73ae6c314135a57c1561de5fd9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400197e1b8db4603a2a036b3ee157baa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:57:18.052350 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-ab1f4d9a-c8c6-4293-9998-84b0d2b8694b tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] 10.222.0.121 "GET /compute/v2.1/servers/81551e3b-0b6c-4f69-bc1c-1e752b601ef5" status: 200 len: 1229 microversion: 2.1 time: 0.091860 Aug 04 10:57:18.052943 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 621/1244] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:57:17 2022] GET /compute/v2.1/servers/81551e3b-0b6c-4f69-bc1c-1e752b601ef5 => generated 1229 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:57:19.074891 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-22574dfd-fd55-4539-a3da-58355b3f5619 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:57:19.075966 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-22574dfd-fd55-4539-a3da-58355b3f5619 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] [instance: 81551e3b-0b6c-4f69-bc1c-1e752b601ef5] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:57:19.083499 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-22574dfd-fd55-4539-a3da-58355b3f5619 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:57:19.084097 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-22574dfd-fd55-4539-a3da-58355b3f5619 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:57:19.084790 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-22574dfd-fd55-4539-a3da-58355b3f5619 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:57:19.085235 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-22574dfd-fd55-4539-a3da-58355b3f5619 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:57:19.098984 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.wsgi [None req-22574dfd-fd55-4539-a3da-58355b3f5619 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] HTTP exception thrown: Instance 81551e3b-0b6c-4f69-bc1c-1e752b601ef5 could not be found. Aug 04 10:57:19.100694 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-22574dfd-fd55-4539-a3da-58355b3f5619 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Request method failure captured: Aug 04 10:57:19.100694 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: request: GET /compute/v2.1/servers/81551e3b-0b6c-4f69-bc1c-1e752b601ef5 HTTP/1.1 Aug 04 10:57:19.100694 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: Accept: application/json Aug 04 10:57:19.100694 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: Accept-Encoding: identity Aug 04 10:57:19.100694 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: Connection: close Aug 04 10:57:19.100694 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: Content-Length: 0 Aug 04 10:57:19.100694 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: Content-Type: application/json Aug 04 10:57:19.100694 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: Host: 10.222.0.121 Aug 04 10:57:19.100694 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: Openstack-System-Scope: None Aug 04 10:57:19.100694 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: User-Agent: python-urllib3/1.26.11 Aug 04 10:57:19.100694 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Auth-Token: gAAAAABi66VP91pDAZgpsTym-Qk06oM7Hft9GpRAElCyhXzMRv32O5_5w86QkS38v5jDso_DnLdASmtwIzsakg-AzTladSDP-DW7AWMHONObeEHsYe1tnx_a_r6joHvLUMd3vaMIxiUOO2AsoEubzFE1fM4k0768VI293PpO92iEGp44cBMi4gk Aug 04 10:57:19.100694 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Domain-Id: None Aug 04 10:57:19.100694 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Domain-Name: None Aug 04 10:57:19.100694 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Identity-Status: Confirmed Aug 04 10:57:19.100694 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Is-Admin-Project: True Aug 04 10:57:19.100694 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Project-Domain-Id: default Aug 04 10:57:19.100694 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Project-Domain-Name: Default Aug 04 10:57:19.100694 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Project-Id: 400197e1b8db4603a2a036b3ee157baa Aug 04 10:57:19.100694 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Project-Name: tempest-TestVolumeBootPattern-1089519314 Aug 04 10:57:19.100694 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Role: reader,member Aug 04 10:57:19.100694 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Roles: reader,member Aug 04 10:57:19.102601 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/400197e1b8db4603a2a036b3ee157baa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/400197e1b8db4603a2a036b3ee157baa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.121:8080", "publicURL": "http://10.222.0.121:8080/v1/AUTH_400197e1b8db4603a2a036b3ee157baa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2/400197e1b8db4603a2a036b3ee157baa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:9696/networking"}]}] Aug 04 10:57:19.102601 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Tenant: tempest-TestVolumeBootPattern-1089519314 Aug 04 10:57:19.102601 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Tenant-Id: 400197e1b8db4603a2a036b3ee157baa Aug 04 10:57:19.102601 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Tenant-Name: tempest-TestVolumeBootPattern-1089519314 Aug 04 10:57:19.102601 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-User: tempest-TestVolumeBootPattern-1089519314-project Aug 04 10:57:19.102601 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-User-Domain-Id: default Aug 04 10:57:19.102601 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-User-Domain-Name: Default Aug 04 10:57:19.102601 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-User-Id: 921f73ae6c314135a57c1561de5fd9d1 Aug 04 10:57:19.102601 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-User-Name: tempest-TestVolumeBootPattern-1089519314-project Aug 04 10:57:19.102601 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: method: > Aug 04 10:57:19.102601 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: exception: Instance 81551e3b-0b6c-4f69-bc1c-1e752b601ef5 could not be found. Aug 04 10:57:19.102601 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: action_args: {'id': '81551e3b-0b6c-4f69-bc1c-1e752b601ef5'} Aug 04 10:57:19.103733 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 10:57:19.103733 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:57:19.103733 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 10:57:19.103733 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 10:57:19.103733 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 10:57:19.103733 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 10:57:19.103733 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 10:57:19.103733 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 10:57:19.103733 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 10:57:19.103733 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 10:57:19.103733 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 81551e3b-0b6c-4f69-bc1c-1e752b601ef5 could not be found. Aug 04 10:57:19.103733 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Aug 04 10:57:19.103733 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:57:19.103733 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Aug 04 10:57:19.103733 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:57:19.103733 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:57:19.103733 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:57:19.103733 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 10:57:19.103733 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 10:57:19.103733 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 10:57:19.105537 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 10:57:19.105537 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 10:57:19.105537 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 10:57:19.105537 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 10:57:19.105537 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 10:57:19.105537 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 10:57:19.105537 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 10:57:19.105537 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 81551e3b-0b6c-4f69-bc1c-1e752b601ef5 could not be found. Aug 04 10:57:19.105537 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Aug 04 10:57:19.105537 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 10:57:19.105537 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Aug 04 10:57:19.105537 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 10:57:19.105537 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 10:57:19.105537 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 10:57:19.105537 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 10:57:19.105537 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 10:57:19.105537 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 81551e3b-0b6c-4f69-bc1c-1e752b601ef5 could not be found. Aug 04 10:57:19.105537 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Aug 04 10:57:19.107090 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-22574dfd-fd55-4539-a3da-58355b3f5619 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Returning 404 to user: Instance 81551e3b-0b6c-4f69-bc1c-1e752b601ef5 could not be found. {{(pid=124457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 10:57:19.107090 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-22574dfd-fd55-4539-a3da-58355b3f5619 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] 10.222.0.121 "GET /compute/v2.1/servers/81551e3b-0b6c-4f69-bc1c-1e752b601ef5" status: 404 len: 111 microversion: 2.1 time: 0.032306 Aug 04 10:57:19.107090 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 624/1245] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:57:19 2022] GET /compute/v2.1/servers/81551e3b-0b6c-4f69-bc1c-1e752b601ef5 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 10:57:19.156496 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-01bb5d74-4837-4986-bc62-3fc267c6aadb tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-512776460", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1596207310", "security_groups": [{"name": "tempest-secgroup-smoke-1576076930"}], "block_device_mapping_v2": [{"uuid": "5da2be98-47b4-4d82-8aa7-d477593b8858", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "2e9a33b3-fabb-450d-8608-d2c3c857e172"}]}} {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:57:19.289272 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.network.neutron [None req-01bb5d74-4837-4986-bc62-3fc267c6aadb tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] validate_networks() for [('2e9a33b3-fabb-450d-8608-d2c3c857e172', None, None, None, None, None)] {{(pid=124456) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 10:57:19.766443 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.virt.hardware [None req-01bb5d74-4837-4986-bc62-3fc267c6aadb tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Flavor limits 0:0:0 {{(pid=124456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 10:57:19.766884 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.virt.hardware [None req-01bb5d74-4837-4986-bc62-3fc267c6aadb tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Image limits 0:0:0 {{(pid=124456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 10:57:19.767373 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.virt.hardware [None req-01bb5d74-4837-4986-bc62-3fc267c6aadb tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Flavor pref 0:0:0 {{(pid=124456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 10:57:19.767785 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.virt.hardware [None req-01bb5d74-4837-4986-bc62-3fc267c6aadb tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Image pref 0:0:0 {{(pid=124456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 10:57:19.768249 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.virt.hardware [None req-01bb5d74-4837-4986-bc62-3fc267c6aadb tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 10:57:19.777681 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-01bb5d74-4837-4986-bc62-3fc267c6aadb tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:57:19.778143 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-01bb5d74-4837-4986-bc62-3fc267c6aadb tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:57:19.778967 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-01bb5d74-4837-4986-bc62-3fc267c6aadb tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:57:19.779426 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-01bb5d74-4837-4986-bc62-3fc267c6aadb tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:57:19.796750 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.quota [None req-01bb5d74-4837-4986-bc62-3fc267c6aadb tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Getting quotas for project 400197e1b8db4603a2a036b3ee157baa. Resources: {'ram', 'instances', 'cores'} {{(pid=124456) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 10:57:19.801583 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.quota [None req-01bb5d74-4837-4986-bc62-3fc267c6aadb tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Getting quotas for user 921f73ae6c314135a57c1561de5fd9d1 and project 400197e1b8db4603a2a036b3ee157baa. Resources: {'ram', 'instances', 'cores'} {{(pid=124456) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 10:57:19.866868 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-01bb5d74-4837-4986-bc62-3fc267c6aadb tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Going to run 1 instances... {{(pid=124456) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 10:57:19.869031 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-01bb5d74-4837-4986-bc62-3fc267c6aadb tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] [instance: 0ed09af4-e83c-4249-be20-9b6fd928dfa7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='5da2be98-47b4-4d82-8aa7-d477593b8858',volume_size=None,volume_type=None)] {{(pid=124456) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 10:57:20.018305 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-01bb5d74-4837-4986-bc62-3fc267c6aadb tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] 10.222.0.121 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.865848 Aug 04 10:57:20.019006 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 622/1246] 10.222.0.121 () {60 vars in 1152 bytes} [Thu Aug 4 10:57:19 2022] POST /compute/v2.1/servers => generated 408 bytes in 867 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 04 10:57:20.030645 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-526b05ef-dab6-4cb4-ae82-25254ba4723a tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:57:20.031273 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-526b05ef-dab6-4cb4-ae82-25254ba4723a tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] [instance: 0ed09af4-e83c-4249-be20-9b6fd928dfa7] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:57:20.093234 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-526b05ef-dab6-4cb4-ae82-25254ba4723a tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921f73ae6c314135a57c1561de5fd9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400197e1b8db4603a2a036b3ee157baa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:57:20.100516 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-526b05ef-dab6-4cb4-ae82-25254ba4723a tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] 10.222.0.121 "GET /compute/v2.1/servers/0ed09af4-e83c-4249-be20-9b6fd928dfa7" status: 200 len: 1097 microversion: 2.1 time: 0.073837 Aug 04 10:57:20.101906 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 625/1247] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:57:20 2022] GET /compute/v2.1/servers/0ed09af4-e83c-4249-be20-9b6fd928dfa7 => generated 1097 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:57:21.123292 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-eadd6606-efe5-4f42-870c-5a10eac9f1bb tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:57:21.123983 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-eadd6606-efe5-4f42-870c-5a10eac9f1bb tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] [instance: 0ed09af4-e83c-4249-be20-9b6fd928dfa7] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:57:21.131791 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-eadd6606-efe5-4f42-870c-5a10eac9f1bb tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:57:21.132296 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-eadd6606-efe5-4f42-870c-5a10eac9f1bb tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:57:21.133146 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-eadd6606-efe5-4f42-870c-5a10eac9f1bb tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:57:21.133688 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-eadd6606-efe5-4f42-870c-5a10eac9f1bb tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:57:21.230016 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-eadd6606-efe5-4f42-870c-5a10eac9f1bb tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921f73ae6c314135a57c1561de5fd9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400197e1b8db4603a2a036b3ee157baa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:57:21.238141 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-eadd6606-efe5-4f42-870c-5a10eac9f1bb tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] 10.222.0.121 "GET /compute/v2.1/servers/0ed09af4-e83c-4249-be20-9b6fd928dfa7" status: 200 len: 1203 microversion: 2.1 time: 0.119478 Aug 04 10:57:21.238737 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 623/1248] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:57:21 2022] GET /compute/v2.1/servers/0ed09af4-e83c-4249-be20-9b6fd928dfa7 => generated 1203 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:57:22.261000 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-cbda9893-ccb8-43cc-baae-d3728fbe44e2 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:57:22.262418 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-cbda9893-ccb8-43cc-baae-d3728fbe44e2 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] [instance: 0ed09af4-e83c-4249-be20-9b6fd928dfa7] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:57:22.270626 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-cbda9893-ccb8-43cc-baae-d3728fbe44e2 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:57:22.271112 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-cbda9893-ccb8-43cc-baae-d3728fbe44e2 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:57:22.271926 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-cbda9893-ccb8-43cc-baae-d3728fbe44e2 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:57:22.272398 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-cbda9893-ccb8-43cc-baae-d3728fbe44e2 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:57:22.491458 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-cbda9893-ccb8-43cc-baae-d3728fbe44e2 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921f73ae6c314135a57c1561de5fd9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400197e1b8db4603a2a036b3ee157baa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:57:22.500507 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-cbda9893-ccb8-43cc-baae-d3728fbe44e2 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] 10.222.0.121 "GET /compute/v2.1/servers/0ed09af4-e83c-4249-be20-9b6fd928dfa7" status: 200 len: 1269 microversion: 2.1 time: 0.243547 Aug 04 10:57:22.501155 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 626/1249] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:57:22 2022] GET /compute/v2.1/servers/0ed09af4-e83c-4249-be20-9b6fd928dfa7 => generated 1269 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:57:22.723378 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [req-5b0dee56-284a-4437-8e55-373da7c472c7 req-47541fcb-2789-44d5-9461-fa0ae8e06393 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ed09af4-e83c-4249-be20-9b6fd928dfa7", "tag": "f131173c-d65f-445b-91c4-70d2eee04db8"}]} {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:57:22.735282 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [req-5b0dee56-284a-4437-8e55-373da7c472c7 req-47541fcb-2789-44d5-9461-fa0ae8e06393 service nova] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:57:22.735822 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [req-5b0dee56-284a-4437-8e55-373da7c472c7 req-47541fcb-2789-44d5-9461-fa0ae8e06393 service nova] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:57:22.748643 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.compute.server_external_events [req-5b0dee56-284a-4437-8e55-373da7c472c7 req-47541fcb-2789-44d5-9461-fa0ae8e06393 service nova] Creating event network-changed:f131173c-d65f-445b-91c4-70d2eee04db8 for instance 0ed09af4-e83c-4249-be20-9b6fd928dfa7 on hv-cinder-85200 Aug 04 10:57:22.753902 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [req-5b0dee56-284a-4437-8e55-373da7c472c7 req-47541fcb-2789-44d5-9461-fa0ae8e06393 service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034628 Aug 04 10:57:22.754680 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 624/1250] 10.222.0.121 () {64 vars in 1322 bytes} [Thu Aug 4 10:57:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:57:23.522010 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-ff6314b5-309b-4c02-a7d3-a2eb60b17fde tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:57:23.522812 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-ff6314b5-309b-4c02-a7d3-a2eb60b17fde tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] [instance: 0ed09af4-e83c-4249-be20-9b6fd928dfa7] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:57:23.529849 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-ff6314b5-309b-4c02-a7d3-a2eb60b17fde tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:57:23.530304 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-ff6314b5-309b-4c02-a7d3-a2eb60b17fde tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:57:23.531087 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-ff6314b5-309b-4c02-a7d3-a2eb60b17fde tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:57:23.531527 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-ff6314b5-309b-4c02-a7d3-a2eb60b17fde tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:57:23.670725 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-ff6314b5-309b-4c02-a7d3-a2eb60b17fde tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921f73ae6c314135a57c1561de5fd9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400197e1b8db4603a2a036b3ee157baa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:57:23.679024 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-ff6314b5-309b-4c02-a7d3-a2eb60b17fde tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] 10.222.0.121 "GET /compute/v2.1/servers/0ed09af4-e83c-4249-be20-9b6fd928dfa7" status: 200 len: 1269 microversion: 2.1 time: 0.161059 Aug 04 10:57:23.679638 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 627/1251] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:57:23 2022] GET /compute/v2.1/servers/0ed09af4-e83c-4249-be20-9b6fd928dfa7 => generated 1269 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:57:24.701844 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-3b05a897-4dfa-48b6-be2e-8c52d6cb26af tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:57:24.702459 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-3b05a897-4dfa-48b6-be2e-8c52d6cb26af tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] [instance: 0ed09af4-e83c-4249-be20-9b6fd928dfa7] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:57:24.710225 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-3b05a897-4dfa-48b6-be2e-8c52d6cb26af tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:57:24.710684 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-3b05a897-4dfa-48b6-be2e-8c52d6cb26af tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:57:24.711472 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-3b05a897-4dfa-48b6-be2e-8c52d6cb26af tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:57:24.711916 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-3b05a897-4dfa-48b6-be2e-8c52d6cb26af tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:57:24.863979 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-3b05a897-4dfa-48b6-be2e-8c52d6cb26af tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921f73ae6c314135a57c1561de5fd9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400197e1b8db4603a2a036b3ee157baa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:57:24.872881 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-3b05a897-4dfa-48b6-be2e-8c52d6cb26af tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] 10.222.0.121 "GET /compute/v2.1/servers/0ed09af4-e83c-4249-be20-9b6fd928dfa7" status: 200 len: 1269 microversion: 2.1 time: 0.176082 Aug 04 10:57:24.873480 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 625/1252] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:57:24 2022] GET /compute/v2.1/servers/0ed09af4-e83c-4249-be20-9b6fd928dfa7 => generated 1269 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:57:25.897035 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-2c79ea31-a81d-4077-af49-e2c9d4234efc tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:57:25.897747 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-2c79ea31-a81d-4077-af49-e2c9d4234efc tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] [instance: 0ed09af4-e83c-4249-be20-9b6fd928dfa7] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:57:25.905179 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-2c79ea31-a81d-4077-af49-e2c9d4234efc tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:57:25.905635 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-2c79ea31-a81d-4077-af49-e2c9d4234efc tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:57:25.906425 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-2c79ea31-a81d-4077-af49-e2c9d4234efc tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:57:25.906879 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-2c79ea31-a81d-4077-af49-e2c9d4234efc tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:57:26.048298 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-2c79ea31-a81d-4077-af49-e2c9d4234efc tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921f73ae6c314135a57c1561de5fd9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400197e1b8db4603a2a036b3ee157baa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:57:26.056229 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-2c79ea31-a81d-4077-af49-e2c9d4234efc tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] 10.222.0.121 "GET /compute/v2.1/servers/0ed09af4-e83c-4249-be20-9b6fd928dfa7" status: 200 len: 1269 microversion: 2.1 time: 0.163318 Aug 04 10:57:26.056822 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 628/1253] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:57:25 2022] GET /compute/v2.1/servers/0ed09af4-e83c-4249-be20-9b6fd928dfa7 => generated 1269 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:57:27.077514 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-024f965e-2e43-477d-a9a9-4d30cee8aff6 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:57:27.078213 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-024f965e-2e43-477d-a9a9-4d30cee8aff6 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] [instance: 0ed09af4-e83c-4249-be20-9b6fd928dfa7] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:57:27.085897 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-024f965e-2e43-477d-a9a9-4d30cee8aff6 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:57:27.086356 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-024f965e-2e43-477d-a9a9-4d30cee8aff6 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:57:27.087138 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-024f965e-2e43-477d-a9a9-4d30cee8aff6 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:57:27.087581 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-024f965e-2e43-477d-a9a9-4d30cee8aff6 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:57:27.224184 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-024f965e-2e43-477d-a9a9-4d30cee8aff6 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921f73ae6c314135a57c1561de5fd9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400197e1b8db4603a2a036b3ee157baa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:57:27.232595 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-024f965e-2e43-477d-a9a9-4d30cee8aff6 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] 10.222.0.121 "GET /compute/v2.1/servers/0ed09af4-e83c-4249-be20-9b6fd928dfa7" status: 200 len: 1269 microversion: 2.1 time: 0.159207 Aug 04 10:57:27.233184 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 626/1254] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:57:27 2022] GET /compute/v2.1/servers/0ed09af4-e83c-4249-be20-9b6fd928dfa7 => generated 1269 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:57:28.254494 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-8df83cbe-095e-4abd-8846-c49f4beef167 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:57:28.255246 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-8df83cbe-095e-4abd-8846-c49f4beef167 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] [instance: 0ed09af4-e83c-4249-be20-9b6fd928dfa7] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:57:28.262449 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-8df83cbe-095e-4abd-8846-c49f4beef167 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:57:28.262960 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-8df83cbe-095e-4abd-8846-c49f4beef167 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:57:28.263751 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-8df83cbe-095e-4abd-8846-c49f4beef167 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:57:28.264245 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-8df83cbe-095e-4abd-8846-c49f4beef167 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:57:28.418082 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-8df83cbe-095e-4abd-8846-c49f4beef167 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921f73ae6c314135a57c1561de5fd9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400197e1b8db4603a2a036b3ee157baa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:57:28.426746 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-8df83cbe-095e-4abd-8846-c49f4beef167 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] 10.222.0.121 "GET /compute/v2.1/servers/0ed09af4-e83c-4249-be20-9b6fd928dfa7" status: 200 len: 1269 microversion: 2.1 time: 0.176302 Aug 04 10:57:28.427409 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 629/1255] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:57:28 2022] GET /compute/v2.1/servers/0ed09af4-e83c-4249-be20-9b6fd928dfa7 => generated 1269 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:57:29.448117 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-4e2ef143-284f-4c85-8b2b-d06762b6424d tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:57:29.448819 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-4e2ef143-284f-4c85-8b2b-d06762b6424d tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] [instance: 0ed09af4-e83c-4249-be20-9b6fd928dfa7] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:57:29.456237 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-4e2ef143-284f-4c85-8b2b-d06762b6424d tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:57:29.456704 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-4e2ef143-284f-4c85-8b2b-d06762b6424d tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:57:29.457502 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-4e2ef143-284f-4c85-8b2b-d06762b6424d tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:57:29.458303 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-4e2ef143-284f-4c85-8b2b-d06762b6424d tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:57:29.602868 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-4e2ef143-284f-4c85-8b2b-d06762b6424d tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921f73ae6c314135a57c1561de5fd9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400197e1b8db4603a2a036b3ee157baa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:57:29.611188 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-4e2ef143-284f-4c85-8b2b-d06762b6424d tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] 10.222.0.121 "GET /compute/v2.1/servers/0ed09af4-e83c-4249-be20-9b6fd928dfa7" status: 200 len: 1269 microversion: 2.1 time: 0.167314 Aug 04 10:57:29.611786 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 627/1256] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:57:29 2022] GET /compute/v2.1/servers/0ed09af4-e83c-4249-be20-9b6fd928dfa7 => generated 1269 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:57:30.633259 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-4b4e03a6-fca9-457f-a4bc-717b0739f3aa tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:57:30.633908 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-4b4e03a6-fca9-457f-a4bc-717b0739f3aa tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] [instance: 0ed09af4-e83c-4249-be20-9b6fd928dfa7] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:57:30.636491 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG dbcounter [-] [124457] Writing DB stats nova_cell0:SELECT=2 {{(pid=124457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:57:30.642434 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-4b4e03a6-fca9-457f-a4bc-717b0739f3aa tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:57:30.642895 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-4b4e03a6-fca9-457f-a4bc-717b0739f3aa tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:57:30.643696 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-4b4e03a6-fca9-457f-a4bc-717b0739f3aa tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:57:30.644175 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-4b4e03a6-fca9-457f-a4bc-717b0739f3aa tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:57:30.781875 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-4b4e03a6-fca9-457f-a4bc-717b0739f3aa tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921f73ae6c314135a57c1561de5fd9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400197e1b8db4603a2a036b3ee157baa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:57:30.789900 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-4b4e03a6-fca9-457f-a4bc-717b0739f3aa tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] 10.222.0.121 "GET /compute/v2.1/servers/0ed09af4-e83c-4249-be20-9b6fd928dfa7" status: 200 len: 1269 microversion: 2.1 time: 0.160846 Aug 04 10:57:30.790480 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 630/1257] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:57:30 2022] GET /compute/v2.1/servers/0ed09af4-e83c-4249-be20-9b6fd928dfa7 => generated 1269 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:57:31.811340 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-be45a76c-fc1d-4252-a823-e8eaba918043 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:57:31.812104 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-be45a76c-fc1d-4252-a823-e8eaba918043 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] [instance: 0ed09af4-e83c-4249-be20-9b6fd928dfa7] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:57:31.814056 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG dbcounter [-] [124456] Writing DB stats nova_cell0:SELECT=2 {{(pid=124456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:57:31.814743 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG dbcounter [-] [124456] Writing DB stats nova_cell0:SELECT=6 {{(pid=124456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:57:31.821779 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-be45a76c-fc1d-4252-a823-e8eaba918043 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:57:31.822240 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-be45a76c-fc1d-4252-a823-e8eaba918043 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:57:31.823026 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-be45a76c-fc1d-4252-a823-e8eaba918043 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:57:31.823468 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-be45a76c-fc1d-4252-a823-e8eaba918043 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:57:31.970856 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-be45a76c-fc1d-4252-a823-e8eaba918043 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921f73ae6c314135a57c1561de5fd9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400197e1b8db4603a2a036b3ee157baa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:57:31.979063 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-be45a76c-fc1d-4252-a823-e8eaba918043 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] 10.222.0.121 "GET /compute/v2.1/servers/0ed09af4-e83c-4249-be20-9b6fd928dfa7" status: 200 len: 1269 microversion: 2.1 time: 0.171817 Aug 04 10:57:31.979726 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 628/1258] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:57:31 2022] GET /compute/v2.1/servers/0ed09af4-e83c-4249-be20-9b6fd928dfa7 => generated 1269 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:57:33.001007 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-e383abed-c5e0-4fbc-8ab9-fde3689cc428 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:57:33.001685 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-e383abed-c5e0-4fbc-8ab9-fde3689cc428 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] [instance: 0ed09af4-e83c-4249-be20-9b6fd928dfa7] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:57:33.008928 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-e383abed-c5e0-4fbc-8ab9-fde3689cc428 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:57:33.009381 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-e383abed-c5e0-4fbc-8ab9-fde3689cc428 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:57:33.010163 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-e383abed-c5e0-4fbc-8ab9-fde3689cc428 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:57:33.010597 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-e383abed-c5e0-4fbc-8ab9-fde3689cc428 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:57:33.146765 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-e383abed-c5e0-4fbc-8ab9-fde3689cc428 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921f73ae6c314135a57c1561de5fd9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400197e1b8db4603a2a036b3ee157baa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:57:33.154857 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-e383abed-c5e0-4fbc-8ab9-fde3689cc428 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] 10.222.0.121 "GET /compute/v2.1/servers/0ed09af4-e83c-4249-be20-9b6fd928dfa7" status: 200 len: 1269 microversion: 2.1 time: 0.157971 Aug 04 10:57:33.155446 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 631/1259] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:57:32 2022] GET /compute/v2.1/servers/0ed09af4-e83c-4249-be20-9b6fd928dfa7 => generated 1269 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:57:33.984646 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [req-0f5dc61c-728a-4675-b6dd-5fbfad80d683 req-8db818b3-c670-4cd5-bbf9-c863e5a76e18 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ed09af4-e83c-4249-be20-9b6fd928dfa7", "name": "network-vif-plugged", "status": "completed", "tag": "f131173c-d65f-445b-91c4-70d2eee04db8"}]} {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:57:33.995864 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [req-0f5dc61c-728a-4675-b6dd-5fbfad80d683 req-8db818b3-c670-4cd5-bbf9-c863e5a76e18 service nova] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:57:33.996331 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [req-0f5dc61c-728a-4675-b6dd-5fbfad80d683 req-8db818b3-c670-4cd5-bbf9-c863e5a76e18 service nova] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:57:34.007658 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.compute.server_external_events [req-0f5dc61c-728a-4675-b6dd-5fbfad80d683 req-8db818b3-c670-4cd5-bbf9-c863e5a76e18 service nova] Creating event network-vif-plugged:f131173c-d65f-445b-91c4-70d2eee04db8 for instance 0ed09af4-e83c-4249-be20-9b6fd928dfa7 on hv-cinder-85200 Aug 04 10:57:34.013271 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [req-0f5dc61c-728a-4675-b6dd-5fbfad80d683 req-8db818b3-c670-4cd5-bbf9-c863e5a76e18 service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094687 Aug 04 10:57:34.013807 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 629/1260] 10.222.0.121 () {64 vars in 1322 bytes} [Thu Aug 4 10:57:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:57:34.175661 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-8ec32788-0323-4422-a76a-5fcd4d62a066 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:57:34.176453 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-8ec32788-0323-4422-a76a-5fcd4d62a066 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] [instance: 0ed09af4-e83c-4249-be20-9b6fd928dfa7] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:57:34.184438 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-8ec32788-0323-4422-a76a-5fcd4d62a066 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:57:34.184890 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-8ec32788-0323-4422-a76a-5fcd4d62a066 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:57:34.185795 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-8ec32788-0323-4422-a76a-5fcd4d62a066 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:57:34.186343 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-8ec32788-0323-4422-a76a-5fcd4d62a066 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:57:34.391859 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-8ec32788-0323-4422-a76a-5fcd4d62a066 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921f73ae6c314135a57c1561de5fd9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400197e1b8db4603a2a036b3ee157baa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:57:34.400571 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-8ec32788-0323-4422-a76a-5fcd4d62a066 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] 10.222.0.121 "GET /compute/v2.1/servers/0ed09af4-e83c-4249-be20-9b6fd928dfa7" status: 200 len: 1269 microversion: 2.1 time: 0.229134 Aug 04 10:57:34.401223 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 632/1261] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:57:34 2022] GET /compute/v2.1/servers/0ed09af4-e83c-4249-be20-9b6fd928dfa7 => generated 1269 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:57:35.426128 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-40155246-7c42-44aa-bb67-228a5c6676b7 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:57:35.426854 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-40155246-7c42-44aa-bb67-228a5c6676b7 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] [instance: 0ed09af4-e83c-4249-be20-9b6fd928dfa7] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:57:35.434951 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-40155246-7c42-44aa-bb67-228a5c6676b7 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:57:35.435410 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-40155246-7c42-44aa-bb67-228a5c6676b7 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:57:35.436257 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-40155246-7c42-44aa-bb67-228a5c6676b7 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:57:35.436703 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-40155246-7c42-44aa-bb67-228a5c6676b7 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:57:35.594811 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-40155246-7c42-44aa-bb67-228a5c6676b7 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921f73ae6c314135a57c1561de5fd9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400197e1b8db4603a2a036b3ee157baa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:57:35.603996 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-40155246-7c42-44aa-bb67-228a5c6676b7 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] 10.222.0.121 "GET /compute/v2.1/servers/0ed09af4-e83c-4249-be20-9b6fd928dfa7" status: 200 len: 1269 microversion: 2.1 time: 0.183131 Aug 04 10:57:35.604616 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 630/1262] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:57:35 2022] GET /compute/v2.1/servers/0ed09af4-e83c-4249-be20-9b6fd928dfa7 => generated 1269 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:57:36.630617 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-e9cef526-acf7-404a-a389-7fbefb65b6c6 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:57:36.631339 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-e9cef526-acf7-404a-a389-7fbefb65b6c6 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] [instance: 0ed09af4-e83c-4249-be20-9b6fd928dfa7] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:57:36.638999 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-e9cef526-acf7-404a-a389-7fbefb65b6c6 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:57:36.639539 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-e9cef526-acf7-404a-a389-7fbefb65b6c6 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:57:36.640315 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-e9cef526-acf7-404a-a389-7fbefb65b6c6 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:57:36.640737 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-e9cef526-acf7-404a-a389-7fbefb65b6c6 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:57:36.790030 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-e9cef526-acf7-404a-a389-7fbefb65b6c6 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921f73ae6c314135a57c1561de5fd9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400197e1b8db4603a2a036b3ee157baa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:57:36.799068 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-e9cef526-acf7-404a-a389-7fbefb65b6c6 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] 10.222.0.121 "GET /compute/v2.1/servers/0ed09af4-e83c-4249-be20-9b6fd928dfa7" status: 200 len: 1456 microversion: 2.1 time: 0.173280 Aug 04 10:57:36.799699 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 633/1263] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:57:36 2022] GET /compute/v2.1/servers/0ed09af4-e83c-4249-be20-9b6fd928dfa7 => generated 1456 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:57:36.823802 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-1644a4c2-3d67-4f06-8af8-607578c3811f tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:57:36.824495 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-1644a4c2-3d67-4f06-8af8-607578c3811f tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] [instance: 0ed09af4-e83c-4249-be20-9b6fd928dfa7] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:57:36.832725 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-1644a4c2-3d67-4f06-8af8-607578c3811f tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:57:36.833619 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-1644a4c2-3d67-4f06-8af8-607578c3811f tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:57:36.834416 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-1644a4c2-3d67-4f06-8af8-607578c3811f tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:57:36.835068 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-1644a4c2-3d67-4f06-8af8-607578c3811f tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:57:36.980869 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-1644a4c2-3d67-4f06-8af8-607578c3811f tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921f73ae6c314135a57c1561de5fd9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400197e1b8db4603a2a036b3ee157baa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:57:36.989260 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-1644a4c2-3d67-4f06-8af8-607578c3811f tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] 10.222.0.121 "GET /compute/v2.1/servers/0ed09af4-e83c-4249-be20-9b6fd928dfa7" status: 200 len: 1456 microversion: 2.1 time: 0.169594 Aug 04 10:57:36.989864 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 631/1264] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:57:36 2022] GET /compute/v2.1/servers/0ed09af4-e83c-4249-be20-9b6fd928dfa7 => generated 1456 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:57:38.970276 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [req-b6923717-e4e7-4a15-89a6-9f5aade6af2f req-b428b7f9-bc80-447c-bf98-db196bf32ba0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ed09af4-e83c-4249-be20-9b6fd928dfa7", "tag": "f131173c-d65f-445b-91c4-70d2eee04db8"}]} {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:57:38.981146 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [req-b6923717-e4e7-4a15-89a6-9f5aade6af2f req-b428b7f9-bc80-447c-bf98-db196bf32ba0 service nova] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:57:38.981588 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [req-b6923717-e4e7-4a15-89a6-9f5aade6af2f req-b428b7f9-bc80-447c-bf98-db196bf32ba0 service nova] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:57:38.994424 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.compute.server_external_events [req-b6923717-e4e7-4a15-89a6-9f5aade6af2f req-b428b7f9-bc80-447c-bf98-db196bf32ba0 service nova] Creating event network-changed:f131173c-d65f-445b-91c4-70d2eee04db8 for instance 0ed09af4-e83c-4249-be20-9b6fd928dfa7 on hv-cinder-85200 Aug 04 10:57:39.000226 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [req-b6923717-e4e7-4a15-89a6-9f5aade6af2f req-b428b7f9-bc80-447c-bf98-db196bf32ba0 service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033915 Aug 04 10:57:39.000868 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 634/1265] 10.222.0.121 () {64 vars in 1322 bytes} [Thu Aug 4 10:57:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:59:29.884025 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 10:59:29.885109 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: Thu Aug 4 10:59:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 10:59:31.286042 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 10:59:31.286823 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: Thu Aug 4 10:59:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 10:59:40.199176 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG dbcounter [-] [124456] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=124456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:59:40.200260 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG dbcounter [-] [124456] Writing DB stats nova_cell1:SELECT=66 {{(pid=124456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:59:40.205904 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-455175fd-e5d7-42f3-98d2-b99fa07e7918 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1335973381", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1596207310", "security_groups": [{"name": "tempest-secgroup-smoke-1576076930"}], "block_device_mapping_v2": [{"uuid": "b3f3afe4-9bc7-4e60-829b-16c5e5eb6a2d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "2e9a33b3-fabb-450d-8608-d2c3c857e172"}]}} {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:59:40.402174 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.network.neutron [None req-455175fd-e5d7-42f3-98d2-b99fa07e7918 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] validate_networks() for [('2e9a33b3-fabb-450d-8608-d2c3c857e172', None, None, None, None, None)] {{(pid=124456) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 10:59:40.865402 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.virt.hardware [None req-455175fd-e5d7-42f3-98d2-b99fa07e7918 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Flavor limits 0:0:0 {{(pid=124456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 10:59:40.865913 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.virt.hardware [None req-455175fd-e5d7-42f3-98d2-b99fa07e7918 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Image limits 0:0:0 {{(pid=124456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 10:59:40.866471 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.virt.hardware [None req-455175fd-e5d7-42f3-98d2-b99fa07e7918 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Flavor pref 0:0:0 {{(pid=124456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 10:59:40.866936 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.virt.hardware [None req-455175fd-e5d7-42f3-98d2-b99fa07e7918 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Image pref 0:0:0 {{(pid=124456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 10:59:40.867403 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.virt.hardware [None req-455175fd-e5d7-42f3-98d2-b99fa07e7918 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124456) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 10:59:40.878810 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-455175fd-e5d7-42f3-98d2-b99fa07e7918 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:59:40.879318 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-455175fd-e5d7-42f3-98d2-b99fa07e7918 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:59:40.880235 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-455175fd-e5d7-42f3-98d2-b99fa07e7918 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:59:40.880818 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-455175fd-e5d7-42f3-98d2-b99fa07e7918 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:59:40.899581 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.quota [None req-455175fd-e5d7-42f3-98d2-b99fa07e7918 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Getting quotas for project 400197e1b8db4603a2a036b3ee157baa. Resources: {'ram', 'instances', 'cores'} {{(pid=124456) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 10:59:40.904340 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.quota [None req-455175fd-e5d7-42f3-98d2-b99fa07e7918 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Getting quotas for user 921f73ae6c314135a57c1561de5fd9d1 and project 400197e1b8db4603a2a036b3ee157baa. Resources: {'ram', 'instances', 'cores'} {{(pid=124456) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 10:59:40.978388 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-455175fd-e5d7-42f3-98d2-b99fa07e7918 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Going to run 1 instances... {{(pid=124456) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 10:59:40.980613 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-455175fd-e5d7-42f3-98d2-b99fa07e7918 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] [instance: 433f7501-26cb-4fb4-8fbd-31fda18a1708] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b3f3afe4-9bc7-4e60-829b-16c5e5eb6a2d',volume_size=None,volume_type=None)] {{(pid=124456) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 10:59:41.145391 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-455175fd-e5d7-42f3-98d2-b99fa07e7918 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] 10.222.0.121 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.948069 Aug 04 10:59:41.146444 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 632/1266] 10.222.0.121 () {60 vars in 1152 bytes} [Thu Aug 4 10:59:40 2022] POST /compute/v2.1/servers => generated 408 bytes in 951 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 04 10:59:41.162913 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ff73ca27-32c4-4048-b311-e0fe8ce0290e] AMQP server on 10.222.0.121:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Aug 04 10:59:41.164098 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG dbcounter [-] [124457] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=124457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:59:41.165595 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG dbcounter [-] [124457] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:59:41.174380 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-fdc8d84b-b818-4124-8f27-0c969842b253 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:59:41.175673 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-fdc8d84b-b818-4124-8f27-0c969842b253 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] [instance: 433f7501-26cb-4fb4-8fbd-31fda18a1708] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:59:41.341205 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-fdc8d84b-b818-4124-8f27-0c969842b253 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921f73ae6c314135a57c1561de5fd9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400197e1b8db4603a2a036b3ee157baa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:59:41.350070 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-fdc8d84b-b818-4124-8f27-0c969842b253 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] 10.222.0.121 "GET /compute/v2.1/servers/433f7501-26cb-4fb4-8fbd-31fda18a1708" status: 200 len: 1098 microversion: 2.1 time: 0.191056 Aug 04 10:59:41.350737 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 635/1267] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:59:41 2022] GET /compute/v2.1/servers/433f7501-26cb-4fb4-8fbd-31fda18a1708 => generated 1098 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:59:42.373467 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-0b471c46-92ea-4949-9324-e3db1ea508d6 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:59:42.374510 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-0b471c46-92ea-4949-9324-e3db1ea508d6 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] [instance: 433f7501-26cb-4fb4-8fbd-31fda18a1708] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:59:42.438381 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-0b471c46-92ea-4949-9324-e3db1ea508d6 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921f73ae6c314135a57c1561de5fd9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400197e1b8db4603a2a036b3ee157baa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:59:42.448681 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-0b471c46-92ea-4949-9324-e3db1ea508d6 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] 10.222.0.121 "GET /compute/v2.1/servers/433f7501-26cb-4fb4-8fbd-31fda18a1708" status: 200 len: 1098 microversion: 2.1 time: 0.080099 Aug 04 10:59:42.449335 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 633/1268] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:59:42 2022] GET /compute/v2.1/servers/433f7501-26cb-4fb4-8fbd-31fda18a1708 => generated 1098 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:59:43.473653 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-af53071d-7db8-49d3-82c7-0839018b51c6 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:59:43.474682 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-af53071d-7db8-49d3-82c7-0839018b51c6 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] [instance: 433f7501-26cb-4fb4-8fbd-31fda18a1708] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:59:43.502222 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO oslo.messaging._drivers.impl_rabbit [-] [ff73ca27-32c4-4048-b311-e0fe8ce0290e] Reconnected to AMQP server on 10.222.0.121:5672 via [amqp] client with port 41890. Aug 04 10:59:43.551202 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-af53071d-7db8-49d3-82c7-0839018b51c6 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921f73ae6c314135a57c1561de5fd9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400197e1b8db4603a2a036b3ee157baa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:59:43.560195 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-af53071d-7db8-49d3-82c7-0839018b51c6 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] 10.222.0.121 "GET /compute/v2.1/servers/433f7501-26cb-4fb4-8fbd-31fda18a1708" status: 200 len: 1098 microversion: 2.1 time: 0.090683 Aug 04 10:59:43.560806 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 636/1269] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:59:43 2022] GET /compute/v2.1/servers/433f7501-26cb-4fb4-8fbd-31fda18a1708 => generated 1098 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:59:44.595601 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-42aaee2d-aae1-49f4-ac01-2b7f189124f3 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:59:44.596601 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-42aaee2d-aae1-49f4-ac01-2b7f189124f3 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] [instance: 433f7501-26cb-4fb4-8fbd-31fda18a1708] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:59:44.669054 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-42aaee2d-aae1-49f4-ac01-2b7f189124f3 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921f73ae6c314135a57c1561de5fd9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400197e1b8db4603a2a036b3ee157baa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:59:44.677829 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-42aaee2d-aae1-49f4-ac01-2b7f189124f3 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] 10.222.0.121 "GET /compute/v2.1/servers/433f7501-26cb-4fb4-8fbd-31fda18a1708" status: 200 len: 1098 microversion: 2.1 time: 0.087044 Aug 04 10:59:44.678434 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 634/1270] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:59:44 2022] GET /compute/v2.1/servers/433f7501-26cb-4fb4-8fbd-31fda18a1708 => generated 1098 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:59:44.709828 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 10:59:44.710488 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: Thu Aug 4 10:59:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 10:59:45.700686 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-d33dc6a5-6b84-40f2-9d07-c84c4e21f5c4 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:59:45.701576 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-d33dc6a5-6b84-40f2-9d07-c84c4e21f5c4 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] [instance: 433f7501-26cb-4fb4-8fbd-31fda18a1708] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:59:45.711741 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-d33dc6a5-6b84-40f2-9d07-c84c4e21f5c4 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:59:45.713102 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-d33dc6a5-6b84-40f2-9d07-c84c4e21f5c4 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:59:45.713891 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-d33dc6a5-6b84-40f2-9d07-c84c4e21f5c4 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:59:45.714576 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-d33dc6a5-6b84-40f2-9d07-c84c4e21f5c4 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:59:45.808194 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-d33dc6a5-6b84-40f2-9d07-c84c4e21f5c4 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921f73ae6c314135a57c1561de5fd9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400197e1b8db4603a2a036b3ee157baa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:59:45.822860 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-d33dc6a5-6b84-40f2-9d07-c84c4e21f5c4 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] 10.222.0.121 "GET /compute/v2.1/servers/433f7501-26cb-4fb4-8fbd-31fda18a1708" status: 200 len: 1148 microversion: 2.1 time: 0.126729 Aug 04 10:59:45.824006 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 637/1271] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:59:45 2022] GET /compute/v2.1/servers/433f7501-26cb-4fb4-8fbd-31fda18a1708 => generated 1148 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:59:46.847974 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-67888e53-b5e2-4fbd-90b5-0e7cc44f223b tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:59:46.849023 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-67888e53-b5e2-4fbd-90b5-0e7cc44f223b tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] [instance: 433f7501-26cb-4fb4-8fbd-31fda18a1708] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:59:46.858605 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-67888e53-b5e2-4fbd-90b5-0e7cc44f223b tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:59:46.859410 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-67888e53-b5e2-4fbd-90b5-0e7cc44f223b tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:59:46.860915 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-67888e53-b5e2-4fbd-90b5-0e7cc44f223b tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:59:46.862645 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-67888e53-b5e2-4fbd-90b5-0e7cc44f223b tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:59:46.985835 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-67888e53-b5e2-4fbd-90b5-0e7cc44f223b tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921f73ae6c314135a57c1561de5fd9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400197e1b8db4603a2a036b3ee157baa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:59:46.996903 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-67888e53-b5e2-4fbd-90b5-0e7cc44f223b tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] 10.222.0.121 "GET /compute/v2.1/servers/433f7501-26cb-4fb4-8fbd-31fda18a1708" status: 200 len: 1214 microversion: 2.1 time: 0.154192 Aug 04 10:59:46.997955 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 635/1272] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:59:46 2022] GET /compute/v2.1/servers/433f7501-26cb-4fb4-8fbd-31fda18a1708 => generated 1214 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:59:48.025736 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-ce995f04-b6d0-457f-8463-fa2224b1651d tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:59:48.026698 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-ce995f04-b6d0-457f-8463-fa2224b1651d tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] [instance: 433f7501-26cb-4fb4-8fbd-31fda18a1708] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:59:48.036342 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-ce995f04-b6d0-457f-8463-fa2224b1651d tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:59:48.037361 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-ce995f04-b6d0-457f-8463-fa2224b1651d tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:59:48.038606 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-ce995f04-b6d0-457f-8463-fa2224b1651d tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:59:48.039392 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-ce995f04-b6d0-457f-8463-fa2224b1651d tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:59:48.309102 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [req-e319ad7d-ec60-407a-b929-1fdbe88c3c63 req-42fae600-ea4d-4550-959a-ff59a112d4df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "433f7501-26cb-4fb4-8fbd-31fda18a1708", "tag": "0a220e88-3223-4d66-be20-4a8db65c2916"}]} {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 10:59:48.316991 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-ce995f04-b6d0-457f-8463-fa2224b1651d tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921f73ae6c314135a57c1561de5fd9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400197e1b8db4603a2a036b3ee157baa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:59:48.327898 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [req-e319ad7d-ec60-407a-b929-1fdbe88c3c63 req-42fae600-ea4d-4550-959a-ff59a112d4df service nova] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:59:48.328692 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [req-e319ad7d-ec60-407a-b929-1fdbe88c3c63 req-42fae600-ea4d-4550-959a-ff59a112d4df service nova] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:59:48.334355 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-ce995f04-b6d0-457f-8463-fa2224b1651d tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] 10.222.0.121 "GET /compute/v2.1/servers/433f7501-26cb-4fb4-8fbd-31fda18a1708" status: 200 len: 1270 microversion: 2.1 time: 0.314695 Aug 04 10:59:48.335910 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 638/1273] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:59:48 2022] GET /compute/v2.1/servers/433f7501-26cb-4fb4-8fbd-31fda18a1708 => generated 1270 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:59:48.350481 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.compute.server_external_events [req-e319ad7d-ec60-407a-b929-1fdbe88c3c63 req-42fae600-ea4d-4550-959a-ff59a112d4df service nova] Creating event network-changed:0a220e88-3223-4d66-be20-4a8db65c2916 for instance 433f7501-26cb-4fb4-8fbd-31fda18a1708 on hv-cinder-85200 Aug 04 10:59:48.356663 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [req-e319ad7d-ec60-407a-b929-1fdbe88c3c63 req-42fae600-ea4d-4550-959a-ff59a112d4df service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053266 Aug 04 10:59:48.357479 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 636/1274] 10.222.0.121 () {64 vars in 1322 bytes} [Thu Aug 4 10:59:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 10:59:49.371637 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-d258a523-76f3-40c6-89a3-9245c102ddee tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:59:49.372430 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-d258a523-76f3-40c6-89a3-9245c102ddee tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] [instance: 433f7501-26cb-4fb4-8fbd-31fda18a1708] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:59:49.380392 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-d258a523-76f3-40c6-89a3-9245c102ddee tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:59:49.380855 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-d258a523-76f3-40c6-89a3-9245c102ddee tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:59:49.381678 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-d258a523-76f3-40c6-89a3-9245c102ddee tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:59:49.382129 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-d258a523-76f3-40c6-89a3-9245c102ddee tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:59:49.557924 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-d258a523-76f3-40c6-89a3-9245c102ddee tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921f73ae6c314135a57c1561de5fd9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400197e1b8db4603a2a036b3ee157baa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:59:49.570031 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-d258a523-76f3-40c6-89a3-9245c102ddee tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] 10.222.0.121 "GET /compute/v2.1/servers/433f7501-26cb-4fb4-8fbd-31fda18a1708" status: 200 len: 1270 microversion: 2.1 time: 0.201524 Aug 04 10:59:49.570634 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 639/1275] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:59:49 2022] GET /compute/v2.1/servers/433f7501-26cb-4fb4-8fbd-31fda18a1708 => generated 1270 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:59:50.592399 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-93c6d6aa-6c65-4f2c-af2a-9192f5281567 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:59:50.593225 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-93c6d6aa-6c65-4f2c-af2a-9192f5281567 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] [instance: 433f7501-26cb-4fb4-8fbd-31fda18a1708] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:59:50.601188 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-93c6d6aa-6c65-4f2c-af2a-9192f5281567 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:59:50.601736 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-93c6d6aa-6c65-4f2c-af2a-9192f5281567 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:59:50.602565 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-93c6d6aa-6c65-4f2c-af2a-9192f5281567 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:59:50.603095 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-93c6d6aa-6c65-4f2c-af2a-9192f5281567 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:59:50.765753 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-93c6d6aa-6c65-4f2c-af2a-9192f5281567 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921f73ae6c314135a57c1561de5fd9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400197e1b8db4603a2a036b3ee157baa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:59:50.775006 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-93c6d6aa-6c65-4f2c-af2a-9192f5281567 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] 10.222.0.121 "GET /compute/v2.1/servers/433f7501-26cb-4fb4-8fbd-31fda18a1708" status: 200 len: 1270 microversion: 2.1 time: 0.187747 Aug 04 10:59:50.775738 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 637/1276] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:59:50 2022] GET /compute/v2.1/servers/433f7501-26cb-4fb4-8fbd-31fda18a1708 => generated 1270 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:59:51.798191 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-8df90044-03db-4555-9bec-2a5cf131ca7a tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:59:51.799189 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-8df90044-03db-4555-9bec-2a5cf131ca7a tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] [instance: 433f7501-26cb-4fb4-8fbd-31fda18a1708] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:59:51.807231 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-8df90044-03db-4555-9bec-2a5cf131ca7a tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:59:51.807802 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-8df90044-03db-4555-9bec-2a5cf131ca7a tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:59:51.808756 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-8df90044-03db-4555-9bec-2a5cf131ca7a tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:59:51.809304 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-8df90044-03db-4555-9bec-2a5cf131ca7a tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:59:51.990277 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-8df90044-03db-4555-9bec-2a5cf131ca7a tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921f73ae6c314135a57c1561de5fd9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400197e1b8db4603a2a036b3ee157baa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:59:51.999766 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-8df90044-03db-4555-9bec-2a5cf131ca7a tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] 10.222.0.121 "GET /compute/v2.1/servers/433f7501-26cb-4fb4-8fbd-31fda18a1708" status: 200 len: 1270 microversion: 2.1 time: 0.205671 Aug 04 10:59:52.000436 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 640/1277] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:59:51 2022] GET /compute/v2.1/servers/433f7501-26cb-4fb4-8fbd-31fda18a1708 => generated 1270 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:59:53.022685 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-36beaf05-4a88-4094-8c70-c702f6d82530 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:59:53.023733 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-36beaf05-4a88-4094-8c70-c702f6d82530 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] [instance: 433f7501-26cb-4fb4-8fbd-31fda18a1708] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:59:53.026728 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG dbcounter [-] [124456] Writing DB stats nova_cell0:SELECT=2 {{(pid=124456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:59:53.034445 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-36beaf05-4a88-4094-8c70-c702f6d82530 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:59:53.034900 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-36beaf05-4a88-4094-8c70-c702f6d82530 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:59:53.035728 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-36beaf05-4a88-4094-8c70-c702f6d82530 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:59:53.036231 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-36beaf05-4a88-4094-8c70-c702f6d82530 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:59:53.192238 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-36beaf05-4a88-4094-8c70-c702f6d82530 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921f73ae6c314135a57c1561de5fd9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400197e1b8db4603a2a036b3ee157baa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:59:53.201106 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-36beaf05-4a88-4094-8c70-c702f6d82530 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] 10.222.0.121 "GET /compute/v2.1/servers/433f7501-26cb-4fb4-8fbd-31fda18a1708" status: 200 len: 1270 microversion: 2.1 time: 0.183108 Aug 04 10:59:53.201729 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 638/1278] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:59:53 2022] GET /compute/v2.1/servers/433f7501-26cb-4fb4-8fbd-31fda18a1708 => generated 1270 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:59:54.224058 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-edc19051-3fed-42d5-9af1-8a3edc756caf tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:59:54.225187 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-edc19051-3fed-42d5-9af1-8a3edc756caf tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] [instance: 433f7501-26cb-4fb4-8fbd-31fda18a1708] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:59:54.227988 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG dbcounter [-] [124457] Writing DB stats nova_cell0:SELECT=4 {{(pid=124457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:59:54.235004 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-edc19051-3fed-42d5-9af1-8a3edc756caf tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:59:54.236505 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-edc19051-3fed-42d5-9af1-8a3edc756caf tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:59:54.236660 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-edc19051-3fed-42d5-9af1-8a3edc756caf tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:59:54.237066 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-edc19051-3fed-42d5-9af1-8a3edc756caf tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:59:54.435515 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-edc19051-3fed-42d5-9af1-8a3edc756caf tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921f73ae6c314135a57c1561de5fd9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400197e1b8db4603a2a036b3ee157baa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:59:54.444893 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-edc19051-3fed-42d5-9af1-8a3edc756caf tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] 10.222.0.121 "GET /compute/v2.1/servers/433f7501-26cb-4fb4-8fbd-31fda18a1708" status: 200 len: 1270 microversion: 2.1 time: 0.225341 Aug 04 10:59:54.445628 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 641/1279] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:59:54 2022] GET /compute/v2.1/servers/433f7501-26cb-4fb4-8fbd-31fda18a1708 => generated 1270 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:59:55.466791 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-b57ddf3f-561b-4415-b939-1638da536c83 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:59:55.467653 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-b57ddf3f-561b-4415-b939-1638da536c83 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] [instance: 433f7501-26cb-4fb4-8fbd-31fda18a1708] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:59:55.470022 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG dbcounter [-] [124456] Writing DB stats nova_cell0:SELECT=10 {{(pid=124456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 10:59:55.476241 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-b57ddf3f-561b-4415-b939-1638da536c83 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:59:55.476787 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-b57ddf3f-561b-4415-b939-1638da536c83 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:59:55.477592 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-b57ddf3f-561b-4415-b939-1638da536c83 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:59:55.478040 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-b57ddf3f-561b-4415-b939-1638da536c83 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:59:55.634808 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-b57ddf3f-561b-4415-b939-1638da536c83 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921f73ae6c314135a57c1561de5fd9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400197e1b8db4603a2a036b3ee157baa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:59:55.644267 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-b57ddf3f-561b-4415-b939-1638da536c83 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] 10.222.0.121 "GET /compute/v2.1/servers/433f7501-26cb-4fb4-8fbd-31fda18a1708" status: 200 len: 1270 microversion: 2.1 time: 0.181456 Aug 04 10:59:55.644879 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 639/1280] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:59:55 2022] GET /compute/v2.1/servers/433f7501-26cb-4fb4-8fbd-31fda18a1708 => generated 1270 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:59:56.679326 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-1afb670b-11bc-4f48-9758-b8c9596be582 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:59:56.680088 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-1afb670b-11bc-4f48-9758-b8c9596be582 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] [instance: 433f7501-26cb-4fb4-8fbd-31fda18a1708] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:59:56.688521 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-1afb670b-11bc-4f48-9758-b8c9596be582 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:59:56.689052 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-1afb670b-11bc-4f48-9758-b8c9596be582 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:59:56.690036 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-1afb670b-11bc-4f48-9758-b8c9596be582 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:59:56.690593 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-1afb670b-11bc-4f48-9758-b8c9596be582 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:59:56.850673 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-1afb670b-11bc-4f48-9758-b8c9596be582 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921f73ae6c314135a57c1561de5fd9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400197e1b8db4603a2a036b3ee157baa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:59:56.859372 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-1afb670b-11bc-4f48-9758-b8c9596be582 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] 10.222.0.121 "GET /compute/v2.1/servers/433f7501-26cb-4fb4-8fbd-31fda18a1708" status: 200 len: 1270 microversion: 2.1 time: 0.184144 Aug 04 10:59:56.860110 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 642/1281] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:59:56 2022] GET /compute/v2.1/servers/433f7501-26cb-4fb4-8fbd-31fda18a1708 => generated 1270 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:59:57.893275 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-067338cf-01ba-4c54-a01d-387950e9da34 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:59:57.894005 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-067338cf-01ba-4c54-a01d-387950e9da34 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] [instance: 433f7501-26cb-4fb4-8fbd-31fda18a1708] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:59:57.901806 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-067338cf-01ba-4c54-a01d-387950e9da34 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:59:57.902316 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-067338cf-01ba-4c54-a01d-387950e9da34 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:59:57.903400 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-067338cf-01ba-4c54-a01d-387950e9da34 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:59:57.903906 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-067338cf-01ba-4c54-a01d-387950e9da34 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:59:58.083972 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-067338cf-01ba-4c54-a01d-387950e9da34 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921f73ae6c314135a57c1561de5fd9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400197e1b8db4603a2a036b3ee157baa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:59:58.093117 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-067338cf-01ba-4c54-a01d-387950e9da34 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] 10.222.0.121 "GET /compute/v2.1/servers/433f7501-26cb-4fb4-8fbd-31fda18a1708" status: 200 len: 1270 microversion: 2.1 time: 0.204306 Aug 04 10:59:58.094052 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 640/1282] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:59:57 2022] GET /compute/v2.1/servers/433f7501-26cb-4fb4-8fbd-31fda18a1708 => generated 1270 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 10:59:59.123677 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-1f08ec4d-da25-478e-b48c-8d179e4c245a tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 10:59:59.124542 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-1f08ec4d-da25-478e-b48c-8d179e4c245a tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] [instance: 433f7501-26cb-4fb4-8fbd-31fda18a1708] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 10:59:59.131789 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-1f08ec4d-da25-478e-b48c-8d179e4c245a tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:59:59.132271 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-1f08ec4d-da25-478e-b48c-8d179e4c245a tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:59:59.133154 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-1f08ec4d-da25-478e-b48c-8d179e4c245a tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 10:59:59.133619 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-1f08ec4d-da25-478e-b48c-8d179e4c245a tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 10:59:59.292842 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-1f08ec4d-da25-478e-b48c-8d179e4c245a tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921f73ae6c314135a57c1561de5fd9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400197e1b8db4603a2a036b3ee157baa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 10:59:59.307564 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-1f08ec4d-da25-478e-b48c-8d179e4c245a tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] 10.222.0.121 "GET /compute/v2.1/servers/433f7501-26cb-4fb4-8fbd-31fda18a1708" status: 200 len: 1270 microversion: 2.1 time: 0.187497 Aug 04 10:59:59.308635 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 643/1283] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 10:59:59 2022] GET /compute/v2.1/servers/433f7501-26cb-4fb4-8fbd-31fda18a1708 => generated 1270 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 11:00:00.338794 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-af4b4904-4e8c-4276-9687-b87d2aaf8cb0 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 11:00:00.339511 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-af4b4904-4e8c-4276-9687-b87d2aaf8cb0 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] [instance: 433f7501-26cb-4fb4-8fbd-31fda18a1708] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 11:00:00.349577 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-af4b4904-4e8c-4276-9687-b87d2aaf8cb0 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 11:00:00.350420 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-af4b4904-4e8c-4276-9687-b87d2aaf8cb0 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 11:00:00.351792 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-af4b4904-4e8c-4276-9687-b87d2aaf8cb0 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 11:00:00.352603 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-af4b4904-4e8c-4276-9687-b87d2aaf8cb0 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 11:00:00.530514 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-af4b4904-4e8c-4276-9687-b87d2aaf8cb0 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921f73ae6c314135a57c1561de5fd9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400197e1b8db4603a2a036b3ee157baa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 11:00:00.538938 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-af4b4904-4e8c-4276-9687-b87d2aaf8cb0 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] 10.222.0.121 "GET /compute/v2.1/servers/433f7501-26cb-4fb4-8fbd-31fda18a1708" status: 200 len: 1270 microversion: 2.1 time: 0.204557 Aug 04 11:00:00.539654 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 641/1284] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 11:00:00 2022] GET /compute/v2.1/servers/433f7501-26cb-4fb4-8fbd-31fda18a1708 => generated 1270 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 11:00:00.687644 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [req-d918904b-621f-48ea-93ca-8b2dd6274679 req-f95e5bd4-6a63-4627-af9f-573ae40401b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "433f7501-26cb-4fb4-8fbd-31fda18a1708", "name": "network-vif-plugged", "status": "completed", "tag": "0a220e88-3223-4d66-be20-4a8db65c2916"}]} {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 11:00:00.699678 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [req-d918904b-621f-48ea-93ca-8b2dd6274679 req-f95e5bd4-6a63-4627-af9f-573ae40401b3 service nova] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 11:00:00.700281 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [req-d918904b-621f-48ea-93ca-8b2dd6274679 req-f95e5bd4-6a63-4627-af9f-573ae40401b3 service nova] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 11:00:00.720806 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.compute.server_external_events [req-d918904b-621f-48ea-93ca-8b2dd6274679 req-f95e5bd4-6a63-4627-af9f-573ae40401b3 service nova] Creating event network-vif-plugged:0a220e88-3223-4d66-be20-4a8db65c2916 for instance 433f7501-26cb-4fb4-8fbd-31fda18a1708 on hv-cinder-85200 Aug 04 11:00:00.727455 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [req-d918904b-621f-48ea-93ca-8b2dd6274679 req-f95e5bd4-6a63-4627-af9f-573ae40401b3 service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043858 Aug 04 11:00:00.728496 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 644/1285] 10.222.0.121 () {64 vars in 1322 bytes} [Thu Aug 4 11:00:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 11:00:01.561654 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-8b1e0324-0d1e-49d6-b0b3-de9f33310881 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 11:00:01.562419 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-8b1e0324-0d1e-49d6-b0b3-de9f33310881 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] [instance: 433f7501-26cb-4fb4-8fbd-31fda18a1708] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 11:00:01.570341 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-8b1e0324-0d1e-49d6-b0b3-de9f33310881 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 11:00:01.570795 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-8b1e0324-0d1e-49d6-b0b3-de9f33310881 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 11:00:01.571614 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-8b1e0324-0d1e-49d6-b0b3-de9f33310881 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 11:00:01.572101 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-8b1e0324-0d1e-49d6-b0b3-de9f33310881 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 11:00:01.725950 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-8b1e0324-0d1e-49d6-b0b3-de9f33310881 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921f73ae6c314135a57c1561de5fd9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400197e1b8db4603a2a036b3ee157baa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 11:00:01.735107 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-8b1e0324-0d1e-49d6-b0b3-de9f33310881 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] 10.222.0.121 "GET /compute/v2.1/servers/433f7501-26cb-4fb4-8fbd-31fda18a1708" status: 200 len: 1270 microversion: 2.1 time: 0.177257 Aug 04 11:00:01.736022 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 642/1286] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 11:00:01 2022] GET /compute/v2.1/servers/433f7501-26cb-4fb4-8fbd-31fda18a1708 => generated 1270 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 11:00:02.760281 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-0027b38b-d55d-4ede-847a-494971029b4c tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 11:00:02.761366 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-0027b38b-d55d-4ede-847a-494971029b4c tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] [instance: 433f7501-26cb-4fb4-8fbd-31fda18a1708] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 11:00:02.769917 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-0027b38b-d55d-4ede-847a-494971029b4c tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 11:00:02.770562 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-0027b38b-d55d-4ede-847a-494971029b4c tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 11:00:02.771561 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-0027b38b-d55d-4ede-847a-494971029b4c tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 11:00:02.772231 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-0027b38b-d55d-4ede-847a-494971029b4c tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 11:00:02.959920 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-0027b38b-d55d-4ede-847a-494971029b4c tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921f73ae6c314135a57c1561de5fd9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400197e1b8db4603a2a036b3ee157baa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 11:00:02.972347 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-0027b38b-d55d-4ede-847a-494971029b4c tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] 10.222.0.121 "GET /compute/v2.1/servers/433f7501-26cb-4fb4-8fbd-31fda18a1708" status: 200 len: 1270 microversion: 2.1 time: 0.217399 Aug 04 11:00:02.973206 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 645/1287] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 11:00:02 2022] GET /compute/v2.1/servers/433f7501-26cb-4fb4-8fbd-31fda18a1708 => generated 1270 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 11:00:04.013655 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-93a9ce6e-59e9-41b4-b244-b85366d297c8 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 11:00:04.016467 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-93a9ce6e-59e9-41b4-b244-b85366d297c8 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] [instance: 433f7501-26cb-4fb4-8fbd-31fda18a1708] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 11:00:04.022032 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-93a9ce6e-59e9-41b4-b244-b85366d297c8 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 11:00:04.022495 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-93a9ce6e-59e9-41b4-b244-b85366d297c8 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 11:00:04.023522 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-93a9ce6e-59e9-41b4-b244-b85366d297c8 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 11:00:04.023995 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-93a9ce6e-59e9-41b4-b244-b85366d297c8 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 11:00:04.203237 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-93a9ce6e-59e9-41b4-b244-b85366d297c8 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921f73ae6c314135a57c1561de5fd9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400197e1b8db4603a2a036b3ee157baa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 11:00:04.212775 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-93a9ce6e-59e9-41b4-b244-b85366d297c8 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] 10.222.0.121 "GET /compute/v2.1/servers/433f7501-26cb-4fb4-8fbd-31fda18a1708" status: 200 len: 1458 microversion: 2.1 time: 0.203263 Aug 04 11:00:04.213366 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 643/1288] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 11:00:04 2022] GET /compute/v2.1/servers/433f7501-26cb-4fb4-8fbd-31fda18a1708 => generated 1458 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 11:00:04.234716 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-fb19d22d-cfe0-45b7-b001-f2910b75ce5e tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 11:00:04.235416 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-fb19d22d-cfe0-45b7-b001-f2910b75ce5e tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] [instance: 433f7501-26cb-4fb4-8fbd-31fda18a1708] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 11:00:04.243597 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-fb19d22d-cfe0-45b7-b001-f2910b75ce5e tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 11:00:04.244175 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-fb19d22d-cfe0-45b7-b001-f2910b75ce5e tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 11:00:04.245081 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-fb19d22d-cfe0-45b7-b001-f2910b75ce5e tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 11:00:04.245582 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-fb19d22d-cfe0-45b7-b001-f2910b75ce5e tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 11:00:04.425087 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-fb19d22d-cfe0-45b7-b001-f2910b75ce5e tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921f73ae6c314135a57c1561de5fd9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400197e1b8db4603a2a036b3ee157baa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 11:00:04.433900 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-fb19d22d-cfe0-45b7-b001-f2910b75ce5e tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] 10.222.0.121 "GET /compute/v2.1/servers/433f7501-26cb-4fb4-8fbd-31fda18a1708" status: 200 len: 1458 microversion: 2.1 time: 0.203471 Aug 04 11:00:04.434526 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 646/1289] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 11:00:04 2022] GET /compute/v2.1/servers/433f7501-26cb-4fb4-8fbd-31fda18a1708 => generated 1458 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 11:00:06.463507 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [req-c7ef0809-1319-4dce-a707-229227a50235 req-ef0ed5b0-2b76-4c74-a6c0-c152aeeb2638 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "433f7501-26cb-4fb4-8fbd-31fda18a1708", "tag": "0a220e88-3223-4d66-be20-4a8db65c2916"}]} {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 11:00:06.480514 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [req-c7ef0809-1319-4dce-a707-229227a50235 req-ef0ed5b0-2b76-4c74-a6c0-c152aeeb2638 service nova] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 11:00:06.480798 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [req-c7ef0809-1319-4dce-a707-229227a50235 req-ef0ed5b0-2b76-4c74-a6c0-c152aeeb2638 service nova] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 11:00:06.497490 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.compute.server_external_events [req-c7ef0809-1319-4dce-a707-229227a50235 req-ef0ed5b0-2b76-4c74-a6c0-c152aeeb2638 service nova] Creating event network-changed:0a220e88-3223-4d66-be20-4a8db65c2916 for instance 433f7501-26cb-4fb4-8fbd-31fda18a1708 on hv-cinder-85200 Aug 04 11:00:06.504227 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [req-c7ef0809-1319-4dce-a707-229227a50235 req-ef0ed5b0-2b76-4c74-a6c0-c152aeeb2638 service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.126283 Aug 04 11:00:06.505120 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 644/1290] 10.222.0.121 () {64 vars in 1322 bytes} [Thu Aug 4 11:00:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 11:01:57.138538 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG dbcounter [-] [124457] Writing DB stats nova_api:SELECT=28 {{(pid=124457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 11:01:57.139547 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG dbcounter [-] [124457] Writing DB stats nova_cell1:SELECT=56 {{(pid=124457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 11:01:57.139797 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR oslo.messaging._drivers.impl_rabbit [-] [dd8834f0-e294-4e6c-8d02-79028cbbd08c] AMQP server on 10.222.0.121:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Aug 04 11:01:57.140465 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG dbcounter [-] [124456] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=3 {{(pid=124456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 11:01:57.141294 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG dbcounter [-] [124456] Writing DB stats nova_cell1:SELECT=54 {{(pid=124456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 11:01:57.145031 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-92830522-8242-41a1-903c-9277021bdf9a tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 11:01:57.145550 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-92830522-8242-41a1-903c-9277021bdf9a tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] [instance: 433f7501-26cb-4fb4-8fbd-31fda18a1708] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 11:01:57.146177 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [req-a58433be-27e6-4926-b144-e7269f8283b2 req-36e3b841-5212-4081-ac78-a852d2b966c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "433f7501-26cb-4fb4-8fbd-31fda18a1708", "tag": "0a220e88-3223-4d66-be20-4a8db65c2916"}]} {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 11:01:57.152406 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-92830522-8242-41a1-903c-9277021bdf9a tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 11:01:57.152858 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-92830522-8242-41a1-903c-9277021bdf9a tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 11:01:57.153659 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-92830522-8242-41a1-903c-9277021bdf9a tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 11:01:57.154100 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-92830522-8242-41a1-903c-9277021bdf9a tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 11:01:57.156697 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [req-a58433be-27e6-4926-b144-e7269f8283b2 req-36e3b841-5212-4081-ac78-a852d2b966c9 service nova] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 11:01:57.157143 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [req-a58433be-27e6-4926-b144-e7269f8283b2 req-36e3b841-5212-4081-ac78-a852d2b966c9 service nova] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 11:01:57.169978 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.compute.server_external_events [req-a58433be-27e6-4926-b144-e7269f8283b2 req-36e3b841-5212-4081-ac78-a852d2b966c9 service nova] Creating event network-changed:0a220e88-3223-4d66-be20-4a8db65c2916 for instance 433f7501-26cb-4fb4-8fbd-31fda18a1708 on hv-cinder-85200 Aug 04 11:01:57.175729 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [req-a58433be-27e6-4926-b144-e7269f8283b2 req-36e3b841-5212-4081-ac78-a852d2b966c9 service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037683 Aug 04 11:01:57.176690 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 645/1291] 10.222.0.121 () {64 vars in 1322 bytes} [Thu Aug 4 11:01:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 11:01:57.186266 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-92830522-8242-41a1-903c-9277021bdf9a tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] [instance: 433f7501-26cb-4fb4-8fbd-31fda18a1708] Going to try to terminate instance {{(pid=124457) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 11:01:57.284578 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-92830522-8242-41a1-903c-9277021bdf9a tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] 10.222.0.121 "DELETE /compute/v2.1/servers/433f7501-26cb-4fb4-8fbd-31fda18a1708" status: 204 len: 0 microversion: 2.1 time: 0.148740 Aug 04 11:01:57.285671 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 647/1292] 10.222.0.121 () {58 vars in 1244 bytes} [Thu Aug 4 11:01:57 2022] DELETE /compute/v2.1/servers/433f7501-26cb-4fb4-8fbd-31fda18a1708 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 11:01:57.296699 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-dcb2c308-e9b8-4fd5-88d6-7076353bdec1 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 11:01:57.297424 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-dcb2c308-e9b8-4fd5-88d6-7076353bdec1 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] [instance: 433f7501-26cb-4fb4-8fbd-31fda18a1708] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 11:01:57.305344 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-dcb2c308-e9b8-4fd5-88d6-7076353bdec1 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 11:01:57.305821 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-dcb2c308-e9b8-4fd5-88d6-7076353bdec1 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 11:01:57.306600 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-dcb2c308-e9b8-4fd5-88d6-7076353bdec1 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 11:01:57.307046 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-dcb2c308-e9b8-4fd5-88d6-7076353bdec1 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 11:01:57.471358 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-dcb2c308-e9b8-4fd5-88d6-7076353bdec1 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921f73ae6c314135a57c1561de5fd9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400197e1b8db4603a2a036b3ee157baa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 11:01:57.479700 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-dcb2c308-e9b8-4fd5-88d6-7076353bdec1 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] 10.222.0.121 "GET /compute/v2.1/servers/433f7501-26cb-4fb4-8fbd-31fda18a1708" status: 200 len: 1582 microversion: 2.1 time: 0.187964 Aug 04 11:01:57.480358 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 646/1293] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 11:01:57 2022] GET /compute/v2.1/servers/433f7501-26cb-4fb4-8fbd-31fda18a1708 => generated 1582 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 11:01:58.503527 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-606173e0-1049-493a-ae9d-9b2bbdec4108 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 11:01:58.504261 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-606173e0-1049-493a-ae9d-9b2bbdec4108 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] [instance: 433f7501-26cb-4fb4-8fbd-31fda18a1708] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 11:01:58.511695 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-606173e0-1049-493a-ae9d-9b2bbdec4108 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 11:01:58.512191 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-606173e0-1049-493a-ae9d-9b2bbdec4108 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 11:01:58.512965 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-606173e0-1049-493a-ae9d-9b2bbdec4108 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 11:01:58.513424 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-606173e0-1049-493a-ae9d-9b2bbdec4108 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 11:01:58.735446 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-606173e0-1049-493a-ae9d-9b2bbdec4108 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921f73ae6c314135a57c1561de5fd9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400197e1b8db4603a2a036b3ee157baa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 11:01:58.744540 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-606173e0-1049-493a-ae9d-9b2bbdec4108 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] 10.222.0.121 "GET /compute/v2.1/servers/433f7501-26cb-4fb4-8fbd-31fda18a1708" status: 200 len: 1582 microversion: 2.1 time: 0.245168 Aug 04 11:01:58.745292 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 648/1294] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 11:01:58 2022] GET /compute/v2.1/servers/433f7501-26cb-4fb4-8fbd-31fda18a1708 => generated 1582 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 11:01:59.766813 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-dcba7499-f9a3-447e-9f61-d61608f08ce8 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 11:01:59.767468 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-dcba7499-f9a3-447e-9f61-d61608f08ce8 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] [instance: 433f7501-26cb-4fb4-8fbd-31fda18a1708] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 11:01:59.775144 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-dcba7499-f9a3-447e-9f61-d61608f08ce8 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 11:01:59.775611 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-dcba7499-f9a3-447e-9f61-d61608f08ce8 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 11:01:59.776448 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-dcba7499-f9a3-447e-9f61-d61608f08ce8 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 11:01:59.776921 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-dcba7499-f9a3-447e-9f61-d61608f08ce8 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 11:01:59.798402 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO oslo.messaging._drivers.impl_rabbit [-] [dd8834f0-e294-4e6c-8d02-79028cbbd08c] Reconnected to AMQP server on 10.222.0.121:5672 via [amqp] client with port 42004. Aug 04 11:01:59.847408 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-dcba7499-f9a3-447e-9f61-d61608f08ce8 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921f73ae6c314135a57c1561de5fd9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400197e1b8db4603a2a036b3ee157baa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 11:01:59.857431 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-dcba7499-f9a3-447e-9f61-d61608f08ce8 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] 10.222.0.121 "GET /compute/v2.1/servers/433f7501-26cb-4fb4-8fbd-31fda18a1708" status: 200 len: 1396 microversion: 2.1 time: 0.094951 Aug 04 11:01:59.858264 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 647/1295] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 11:01:59 2022] GET /compute/v2.1/servers/433f7501-26cb-4fb4-8fbd-31fda18a1708 => generated 1396 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 11:01:59.930317 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [req-1fbddf0c-99a5-46a3-bcfb-7438a31abfff req-da4dc17d-fd02-47cf-9b02-8fb0f143aead service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "433f7501-26cb-4fb4-8fbd-31fda18a1708", "name": "network-vif-deleted", "tag": "0a220e88-3223-4d66-be20-4a8db65c2916"}]} {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 11:01:59.941819 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [req-1fbddf0c-99a5-46a3-bcfb-7438a31abfff req-da4dc17d-fd02-47cf-9b02-8fb0f143aead service nova] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 11:01:59.942280 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [req-1fbddf0c-99a5-46a3-bcfb-7438a31abfff req-da4dc17d-fd02-47cf-9b02-8fb0f143aead service nova] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 11:01:59.954742 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.compute.server_external_events [req-1fbddf0c-99a5-46a3-bcfb-7438a31abfff req-da4dc17d-fd02-47cf-9b02-8fb0f143aead service nova] Creating event network-vif-deleted:0a220e88-3223-4d66-be20-4a8db65c2916 for instance 433f7501-26cb-4fb4-8fbd-31fda18a1708 on hv-cinder-85200 Aug 04 11:01:59.960811 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [req-1fbddf0c-99a5-46a3-bcfb-7438a31abfff req-da4dc17d-fd02-47cf-9b02-8fb0f143aead service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034524 Aug 04 11:01:59.961611 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 649/1296] 10.222.0.121 () {64 vars in 1322 bytes} [Thu Aug 4 11:01:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 11:02:00.879578 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-36f69162-48b0-448e-ad8c-e6c8d200beb5 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 11:02:00.880280 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-36f69162-48b0-448e-ad8c-e6c8d200beb5 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] [instance: 433f7501-26cb-4fb4-8fbd-31fda18a1708] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 11:02:00.887253 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-36f69162-48b0-448e-ad8c-e6c8d200beb5 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 11:02:00.887717 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-36f69162-48b0-448e-ad8c-e6c8d200beb5 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 11:02:00.888557 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-36f69162-48b0-448e-ad8c-e6c8d200beb5 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 11:02:00.889003 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-36f69162-48b0-448e-ad8c-e6c8d200beb5 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 11:02:00.905295 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.wsgi [None req-36f69162-48b0-448e-ad8c-e6c8d200beb5 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] HTTP exception thrown: Instance 433f7501-26cb-4fb4-8fbd-31fda18a1708 could not be found. Aug 04 11:02:00.907274 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-36f69162-48b0-448e-ad8c-e6c8d200beb5 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Request method failure captured: Aug 04 11:02:00.907274 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: request: GET /compute/v2.1/servers/433f7501-26cb-4fb4-8fbd-31fda18a1708 HTTP/1.1 Aug 04 11:02:00.907274 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: Accept: application/json Aug 04 11:02:00.907274 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: Accept-Encoding: identity Aug 04 11:02:00.907274 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: Connection: close Aug 04 11:02:00.907274 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: Content-Length: 0 Aug 04 11:02:00.907274 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: Content-Type: application/json Aug 04 11:02:00.907274 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: Host: 10.222.0.121 Aug 04 11:02:00.907274 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: Openstack-System-Scope: None Aug 04 11:02:00.907274 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: User-Agent: python-urllib3/1.26.11 Aug 04 11:02:00.907274 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Auth-Token: gAAAAABi66VP91pDAZgpsTym-Qk06oM7Hft9GpRAElCyhXzMRv32O5_5w86QkS38v5jDso_DnLdASmtwIzsakg-AzTladSDP-DW7AWMHONObeEHsYe1tnx_a_r6joHvLUMd3vaMIxiUOO2AsoEubzFE1fM4k0768VI293PpO92iEGp44cBMi4gk Aug 04 11:02:00.907274 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Domain-Id: None Aug 04 11:02:00.907274 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Domain-Name: None Aug 04 11:02:00.907274 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Identity-Status: Confirmed Aug 04 11:02:00.907274 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Is-Admin-Project: True Aug 04 11:02:00.907274 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Project-Domain-Id: default Aug 04 11:02:00.907274 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Project-Domain-Name: Default Aug 04 11:02:00.907274 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Project-Id: 400197e1b8db4603a2a036b3ee157baa Aug 04 11:02:00.907274 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Project-Name: tempest-TestVolumeBootPattern-1089519314 Aug 04 11:02:00.907274 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Role: reader,member Aug 04 11:02:00.907274 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Roles: reader,member Aug 04 11:02:00.909215 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/400197e1b8db4603a2a036b3ee157baa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/400197e1b8db4603a2a036b3ee157baa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.121:8080", "publicURL": "http://10.222.0.121:8080/v1/AUTH_400197e1b8db4603a2a036b3ee157baa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2/400197e1b8db4603a2a036b3ee157baa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:9696/networking"}]}] Aug 04 11:02:00.909215 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Tenant: tempest-TestVolumeBootPattern-1089519314 Aug 04 11:02:00.909215 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Tenant-Id: 400197e1b8db4603a2a036b3ee157baa Aug 04 11:02:00.909215 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Tenant-Name: tempest-TestVolumeBootPattern-1089519314 Aug 04 11:02:00.909215 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-User: tempest-TestVolumeBootPattern-1089519314-project Aug 04 11:02:00.909215 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-User-Domain-Id: default Aug 04 11:02:00.909215 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-User-Domain-Name: Default Aug 04 11:02:00.909215 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-User-Id: 921f73ae6c314135a57c1561de5fd9d1 Aug 04 11:02:00.909215 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-User-Name: tempest-TestVolumeBootPattern-1089519314-project Aug 04 11:02:00.909215 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: method: > Aug 04 11:02:00.909215 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: exception: Instance 433f7501-26cb-4fb4-8fbd-31fda18a1708 could not be found. Aug 04 11:02:00.909215 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: action_args: {'id': '433f7501-26cb-4fb4-8fbd-31fda18a1708'} Aug 04 11:02:00.910214 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 11:02:00.910214 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 11:02:00.910214 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 11:02:00.910214 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 11:02:00.910214 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 11:02:00.910214 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 11:02:00.910214 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 11:02:00.910214 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 11:02:00.910214 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 11:02:00.910214 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 11:02:00.910214 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 433f7501-26cb-4fb4-8fbd-31fda18a1708 could not be found. Aug 04 11:02:00.910214 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi Aug 04 11:02:00.910214 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 11:02:00.910214 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi Aug 04 11:02:00.910214 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 11:02:00.910214 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 11:02:00.910214 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 11:02:00.910214 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 11:02:00.910214 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 11:02:00.910214 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 11:02:00.911746 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 11:02:00.911746 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 11:02:00.911746 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 11:02:00.911746 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 11:02:00.911746 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 11:02:00.911746 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 11:02:00.911746 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 11:02:00.911746 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 433f7501-26cb-4fb4-8fbd-31fda18a1708 could not be found. Aug 04 11:02:00.911746 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi Aug 04 11:02:00.911746 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 11:02:00.911746 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi Aug 04 11:02:00.911746 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 11:02:00.911746 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 11:02:00.911746 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 11:02:00.911746 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 11:02:00.911746 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 11:02:00.911746 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 433f7501-26cb-4fb4-8fbd-31fda18a1708 could not be found. Aug 04 11:02:00.911746 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi Aug 04 11:02:00.913161 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-36f69162-48b0-448e-ad8c-e6c8d200beb5 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Returning 404 to user: Instance 433f7501-26cb-4fb4-8fbd-31fda18a1708 could not be found. {{(pid=124456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 11:02:00.913161 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-36f69162-48b0-448e-ad8c-e6c8d200beb5 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] 10.222.0.121 "GET /compute/v2.1/servers/433f7501-26cb-4fb4-8fbd-31fda18a1708" status: 404 len: 111 microversion: 2.1 time: 0.033572 Aug 04 11:02:00.913161 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 648/1297] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 11:02:00 2022] GET /compute/v2.1/servers/433f7501-26cb-4fb4-8fbd-31fda18a1708 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 11:02:04.066582 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-0c26282f-b86d-40ec-b1ca-d20b5e52f3fa tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 11:02:04.067238 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-0c26282f-b86d-40ec-b1ca-d20b5e52f3fa tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] [instance: 0ed09af4-e83c-4249-be20-9b6fd928dfa7] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 11:02:04.073165 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [req-9567aef2-8360-49c0-add6-4ac588bef104 req-720f3fc2-0db2-4c0f-bb0e-969c4311637d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ed09af4-e83c-4249-be20-9b6fd928dfa7", "tag": "f131173c-d65f-445b-91c4-70d2eee04db8"}]} {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 11:02:04.083703 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-0c26282f-b86d-40ec-b1ca-d20b5e52f3fa tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 11:02:04.084143 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [req-9567aef2-8360-49c0-add6-4ac588bef104 req-720f3fc2-0db2-4c0f-bb0e-969c4311637d service nova] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 11:02:04.084353 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-0c26282f-b86d-40ec-b1ca-d20b5e52f3fa tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 11:02:04.084978 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [req-9567aef2-8360-49c0-add6-4ac588bef104 req-720f3fc2-0db2-4c0f-bb0e-969c4311637d service nova] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 11:02:04.085235 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-0c26282f-b86d-40ec-b1ca-d20b5e52f3fa tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 11:02:04.085894 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-0c26282f-b86d-40ec-b1ca-d20b5e52f3fa tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 11:02:04.097575 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.compute.server_external_events [req-9567aef2-8360-49c0-add6-4ac588bef104 req-720f3fc2-0db2-4c0f-bb0e-969c4311637d service nova] Creating event network-changed:f131173c-d65f-445b-91c4-70d2eee04db8 for instance 0ed09af4-e83c-4249-be20-9b6fd928dfa7 on hv-cinder-85200 Aug 04 11:02:04.103822 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [req-9567aef2-8360-49c0-add6-4ac588bef104 req-720f3fc2-0db2-4c0f-bb0e-969c4311637d service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034310 Aug 04 11:02:04.104779 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 649/1298] 10.222.0.121 () {64 vars in 1322 bytes} [Thu Aug 4 11:02:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 11:02:04.116917 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-0c26282f-b86d-40ec-b1ca-d20b5e52f3fa tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] [instance: 0ed09af4-e83c-4249-be20-9b6fd928dfa7] Going to try to terminate instance {{(pid=124457) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 11:02:04.213965 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-0c26282f-b86d-40ec-b1ca-d20b5e52f3fa tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] 10.222.0.121 "DELETE /compute/v2.1/servers/0ed09af4-e83c-4249-be20-9b6fd928dfa7" status: 204 len: 0 microversion: 2.1 time: 0.151515 Aug 04 11:02:04.215390 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 650/1299] 10.222.0.121 () {58 vars in 1244 bytes} [Thu Aug 4 11:02:04 2022] DELETE /compute/v2.1/servers/0ed09af4-e83c-4249-be20-9b6fd928dfa7 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 11:02:04.225341 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-94c67065-d26e-4e5c-b554-b562981e544b tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 11:02:04.226409 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-94c67065-d26e-4e5c-b554-b562981e544b tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] [instance: 0ed09af4-e83c-4249-be20-9b6fd928dfa7] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 11:02:04.234265 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-94c67065-d26e-4e5c-b554-b562981e544b tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 11:02:04.234997 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-94c67065-d26e-4e5c-b554-b562981e544b tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 11:02:04.236080 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-94c67065-d26e-4e5c-b554-b562981e544b tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 11:02:04.236695 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-94c67065-d26e-4e5c-b554-b562981e544b tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 11:02:04.386810 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.policy [None req-94c67065-d26e-4e5c-b554-b562981e544b tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921f73ae6c314135a57c1561de5fd9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400197e1b8db4603a2a036b3ee157baa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124456) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 11:02:04.395280 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-94c67065-d26e-4e5c-b554-b562981e544b tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] 10.222.0.121 "GET /compute/v2.1/servers/0ed09af4-e83c-4249-be20-9b6fd928dfa7" status: 200 len: 1580 microversion: 2.1 time: 0.174531 Aug 04 11:02:04.395920 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 650/1300] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 11:02:04 2022] GET /compute/v2.1/servers/0ed09af4-e83c-4249-be20-9b6fd928dfa7 => generated 1580 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 11:02:05.418113 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-9b346e1e-df6b-40bc-a8de-1c483956f9ca tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 11:02:05.418852 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-9b346e1e-df6b-40bc-a8de-1c483956f9ca tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] [instance: 0ed09af4-e83c-4249-be20-9b6fd928dfa7] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 11:02:05.426224 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-9b346e1e-df6b-40bc-a8de-1c483956f9ca tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 11:02:05.426692 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-9b346e1e-df6b-40bc-a8de-1c483956f9ca tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 11:02:05.427497 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-9b346e1e-df6b-40bc-a8de-1c483956f9ca tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 11:02:05.427972 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-9b346e1e-df6b-40bc-a8de-1c483956f9ca tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 11:02:05.573224 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-9b346e1e-df6b-40bc-a8de-1c483956f9ca tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921f73ae6c314135a57c1561de5fd9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400197e1b8db4603a2a036b3ee157baa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 11:02:05.581931 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-9b346e1e-df6b-40bc-a8de-1c483956f9ca tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] 10.222.0.121 "GET /compute/v2.1/servers/0ed09af4-e83c-4249-be20-9b6fd928dfa7" status: 200 len: 1580 microversion: 2.1 time: 0.168330 Aug 04 11:02:05.582447 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 651/1301] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 11:02:05 2022] GET /compute/v2.1/servers/0ed09af4-e83c-4249-be20-9b6fd928dfa7 => generated 1580 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 11:02:06.484382 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [req-527a2462-b8f9-4382-81be-d8c0e79e5db7 req-53088013-16e4-496a-84be-2aa459d37d1d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ed09af4-e83c-4249-be20-9b6fd928dfa7", "name": "network-vif-deleted", "tag": "f131173c-d65f-445b-91c4-70d2eee04db8"}]} {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 11:02:06.495799 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [req-527a2462-b8f9-4382-81be-d8c0e79e5db7 req-53088013-16e4-496a-84be-2aa459d37d1d service nova] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 11:02:06.496552 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [req-527a2462-b8f9-4382-81be-d8c0e79e5db7 req-53088013-16e4-496a-84be-2aa459d37d1d service nova] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 11:02:06.509390 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.compute.server_external_events [req-527a2462-b8f9-4382-81be-d8c0e79e5db7 req-53088013-16e4-496a-84be-2aa459d37d1d service nova] Creating event network-vif-deleted:f131173c-d65f-445b-91c4-70d2eee04db8 for instance 0ed09af4-e83c-4249-be20-9b6fd928dfa7 on hv-cinder-85200 Aug 04 11:02:06.516555 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [req-527a2462-b8f9-4382-81be-d8c0e79e5db7 req-53088013-16e4-496a-84be-2aa459d37d1d service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036034 Aug 04 11:02:06.517832 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 651/1302] 10.222.0.121 () {64 vars in 1322 bytes} [Thu Aug 4 11:02:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 11:02:06.603668 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-647c3150-d806-4318-9376-34e0b252ecf9 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 11:02:06.604374 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-647c3150-d806-4318-9376-34e0b252ecf9 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] [instance: 0ed09af4-e83c-4249-be20-9b6fd928dfa7] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 11:02:06.611628 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-647c3150-d806-4318-9376-34e0b252ecf9 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 11:02:06.612097 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-647c3150-d806-4318-9376-34e0b252ecf9 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 11:02:06.613053 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-647c3150-d806-4318-9376-34e0b252ecf9 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 11:02:06.613497 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-647c3150-d806-4318-9376-34e0b252ecf9 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 11:02:06.685800 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.policy [None req-647c3150-d806-4318-9376-34e0b252ecf9 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '921f73ae6c314135a57c1561de5fd9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400197e1b8db4603a2a036b3ee157baa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124457) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 11:02:06.696475 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-647c3150-d806-4318-9376-34e0b252ecf9 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] 10.222.0.121 "GET /compute/v2.1/servers/0ed09af4-e83c-4249-be20-9b6fd928dfa7" status: 200 len: 1228 microversion: 2.1 time: 0.096731 Aug 04 11:02:06.697372 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 652/1303] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 11:02:06 2022] GET /compute/v2.1/servers/0ed09af4-e83c-4249-be20-9b6fd928dfa7 => generated 1228 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 11:02:07.721585 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-a3eeddb9-18a4-4036-b920-aa25db9dac9f tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 11:02:07.722232 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-a3eeddb9-18a4-4036-b920-aa25db9dac9f tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] [instance: 0ed09af4-e83c-4249-be20-9b6fd928dfa7] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 11:02:07.730355 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-a3eeddb9-18a4-4036-b920-aa25db9dac9f tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 11:02:07.730823 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-a3eeddb9-18a4-4036-b920-aa25db9dac9f tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 11:02:07.731660 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-a3eeddb9-18a4-4036-b920-aa25db9dac9f tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 11:02:07.732156 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-a3eeddb9-18a4-4036-b920-aa25db9dac9f tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 11:02:07.754020 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.wsgi [None req-a3eeddb9-18a4-4036-b920-aa25db9dac9f tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] HTTP exception thrown: Instance 0ed09af4-e83c-4249-be20-9b6fd928dfa7 could not be found. Aug 04 11:02:07.755785 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-a3eeddb9-18a4-4036-b920-aa25db9dac9f tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Request method failure captured: Aug 04 11:02:07.755785 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: request: GET /compute/v2.1/servers/0ed09af4-e83c-4249-be20-9b6fd928dfa7 HTTP/1.1 Aug 04 11:02:07.755785 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: Accept: application/json Aug 04 11:02:07.755785 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: Accept-Encoding: identity Aug 04 11:02:07.755785 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: Connection: close Aug 04 11:02:07.755785 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: Content-Length: 0 Aug 04 11:02:07.755785 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: Content-Type: application/json Aug 04 11:02:07.755785 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: Host: 10.222.0.121 Aug 04 11:02:07.755785 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: Openstack-System-Scope: None Aug 04 11:02:07.755785 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: User-Agent: python-urllib3/1.26.11 Aug 04 11:02:07.755785 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Auth-Token: gAAAAABi66VP91pDAZgpsTym-Qk06oM7Hft9GpRAElCyhXzMRv32O5_5w86QkS38v5jDso_DnLdASmtwIzsakg-AzTladSDP-DW7AWMHONObeEHsYe1tnx_a_r6joHvLUMd3vaMIxiUOO2AsoEubzFE1fM4k0768VI293PpO92iEGp44cBMi4gk Aug 04 11:02:07.755785 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Domain-Id: None Aug 04 11:02:07.755785 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Domain-Name: None Aug 04 11:02:07.755785 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Identity-Status: Confirmed Aug 04 11:02:07.755785 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Is-Admin-Project: True Aug 04 11:02:07.755785 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Project-Domain-Id: default Aug 04 11:02:07.755785 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Project-Domain-Name: Default Aug 04 11:02:07.755785 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Project-Id: 400197e1b8db4603a2a036b3ee157baa Aug 04 11:02:07.755785 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Project-Name: tempest-TestVolumeBootPattern-1089519314 Aug 04 11:02:07.755785 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Role: reader,member Aug 04 11:02:07.755785 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Roles: reader,member Aug 04 11:02:07.757560 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/400197e1b8db4603a2a036b3ee157baa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/400197e1b8db4603a2a036b3ee157baa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.121:8080", "publicURL": "http://10.222.0.121:8080/v1/AUTH_400197e1b8db4603a2a036b3ee157baa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2/400197e1b8db4603a2a036b3ee157baa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:9696/networking"}]}] Aug 04 11:02:07.757560 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Tenant: tempest-TestVolumeBootPattern-1089519314 Aug 04 11:02:07.757560 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Tenant-Id: 400197e1b8db4603a2a036b3ee157baa Aug 04 11:02:07.757560 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Tenant-Name: tempest-TestVolumeBootPattern-1089519314 Aug 04 11:02:07.757560 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-User: tempest-TestVolumeBootPattern-1089519314-project Aug 04 11:02:07.757560 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-User-Domain-Id: default Aug 04 11:02:07.757560 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-User-Domain-Name: Default Aug 04 11:02:07.757560 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-User-Id: 921f73ae6c314135a57c1561de5fd9d1 Aug 04 11:02:07.757560 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-User-Name: tempest-TestVolumeBootPattern-1089519314-project Aug 04 11:02:07.757560 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: method: > Aug 04 11:02:07.757560 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: exception: Instance 0ed09af4-e83c-4249-be20-9b6fd928dfa7 could not be found. Aug 04 11:02:07.757560 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: action_args: {'id': '0ed09af4-e83c-4249-be20-9b6fd928dfa7'} Aug 04 11:02:07.758461 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 11:02:07.758461 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 11:02:07.758461 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 11:02:07.758461 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 11:02:07.758461 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 11:02:07.758461 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 11:02:07.758461 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 11:02:07.758461 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 11:02:07.758461 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 11:02:07.758461 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 11:02:07.758461 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ed09af4-e83c-4249-be20-9b6fd928dfa7 could not be found. Aug 04 11:02:07.758461 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi Aug 04 11:02:07.758461 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 11:02:07.758461 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi Aug 04 11:02:07.758461 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 11:02:07.758461 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 11:02:07.758461 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 11:02:07.758461 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 11:02:07.758461 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 11:02:07.758461 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 11:02:07.760102 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 11:02:07.760102 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 11:02:07.760102 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 11:02:07.760102 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 11:02:07.760102 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 11:02:07.760102 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 11:02:07.760102 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 11:02:07.760102 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ed09af4-e83c-4249-be20-9b6fd928dfa7 could not be found. Aug 04 11:02:07.760102 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi Aug 04 11:02:07.760102 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 11:02:07.760102 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi Aug 04 11:02:07.760102 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 11:02:07.760102 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 11:02:07.760102 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 11:02:07.760102 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 11:02:07.760102 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 11:02:07.760102 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ed09af4-e83c-4249-be20-9b6fd928dfa7 could not be found. Aug 04 11:02:07.760102 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi Aug 04 11:02:07.762005 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-a3eeddb9-18a4-4036-b920-aa25db9dac9f tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Returning 404 to user: Instance 0ed09af4-e83c-4249-be20-9b6fd928dfa7 could not be found. {{(pid=124456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 11:02:07.762005 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-a3eeddb9-18a4-4036-b920-aa25db9dac9f tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] 10.222.0.121 "GET /compute/v2.1/servers/0ed09af4-e83c-4249-be20-9b6fd928dfa7" status: 404 len: 111 microversion: 2.1 time: 0.040649 Aug 04 11:02:07.762005 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 652/1304] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 11:02:07 2022] GET /compute/v2.1/servers/0ed09af4-e83c-4249-be20-9b6fd928dfa7 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 11:02:08.244712 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-1e2e23ea-659f-40b7-afb9-66c31db8f706 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Calling method '>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 11:02:08.245357 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.compute.api [None req-1e2e23ea-659f-40b7-afb9-66c31db8f706 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] [instance: 81551e3b-0b6c-4f69-bc1c-1e752b601ef5] Fetching instance by UUID {{(pid=124457) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 11:02:08.252571 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-1e2e23ea-659f-40b7-afb9-66c31db8f706 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 11:02:08.253035 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-1e2e23ea-659f-40b7-afb9-66c31db8f706 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 11:02:08.253828 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-1e2e23ea-659f-40b7-afb9-66c31db8f706 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 11:02:08.254279 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG oslo_concurrency.lockutils [None req-1e2e23ea-659f-40b7-afb9-66c31db8f706 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 11:02:08.268616 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.wsgi [None req-1e2e23ea-659f-40b7-afb9-66c31db8f706 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] HTTP exception thrown: Instance 81551e3b-0b6c-4f69-bc1c-1e752b601ef5 could not be found. Aug 04 11:02:08.270368 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-1e2e23ea-659f-40b7-afb9-66c31db8f706 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Request method failure captured: Aug 04 11:02:08.270368 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: request: DELETE /compute/v2.1/servers/81551e3b-0b6c-4f69-bc1c-1e752b601ef5 HTTP/1.1 Aug 04 11:02:08.270368 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: Accept: application/json Aug 04 11:02:08.270368 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: Accept-Encoding: identity Aug 04 11:02:08.270368 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: Connection: close Aug 04 11:02:08.270368 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: Content-Length: 0 Aug 04 11:02:08.270368 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: Content-Type: application/json Aug 04 11:02:08.270368 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: Host: 10.222.0.121 Aug 04 11:02:08.270368 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: Openstack-System-Scope: None Aug 04 11:02:08.270368 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: User-Agent: python-urllib3/1.26.11 Aug 04 11:02:08.270368 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Auth-Token: gAAAAABi66VP91pDAZgpsTym-Qk06oM7Hft9GpRAElCyhXzMRv32O5_5w86QkS38v5jDso_DnLdASmtwIzsakg-AzTladSDP-DW7AWMHONObeEHsYe1tnx_a_r6joHvLUMd3vaMIxiUOO2AsoEubzFE1fM4k0768VI293PpO92iEGp44cBMi4gk Aug 04 11:02:08.270368 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Domain-Id: None Aug 04 11:02:08.270368 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Domain-Name: None Aug 04 11:02:08.270368 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Identity-Status: Confirmed Aug 04 11:02:08.270368 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Is-Admin-Project: True Aug 04 11:02:08.270368 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Project-Domain-Id: default Aug 04 11:02:08.270368 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Project-Domain-Name: Default Aug 04 11:02:08.270368 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Project-Id: 400197e1b8db4603a2a036b3ee157baa Aug 04 11:02:08.270368 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Project-Name: tempest-TestVolumeBootPattern-1089519314 Aug 04 11:02:08.270368 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Role: reader,member Aug 04 11:02:08.270368 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Roles: reader,member Aug 04 11:02:08.272240 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/400197e1b8db4603a2a036b3ee157baa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/400197e1b8db4603a2a036b3ee157baa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.121:8080", "publicURL": "http://10.222.0.121:8080/v1/AUTH_400197e1b8db4603a2a036b3ee157baa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2/400197e1b8db4603a2a036b3ee157baa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:9696/networking"}]}] Aug 04 11:02:08.272240 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Tenant: tempest-TestVolumeBootPattern-1089519314 Aug 04 11:02:08.272240 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Tenant-Id: 400197e1b8db4603a2a036b3ee157baa Aug 04 11:02:08.272240 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-Tenant-Name: tempest-TestVolumeBootPattern-1089519314 Aug 04 11:02:08.272240 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-User: tempest-TestVolumeBootPattern-1089519314-project Aug 04 11:02:08.272240 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-User-Domain-Id: default Aug 04 11:02:08.272240 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-User-Domain-Name: Default Aug 04 11:02:08.272240 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-User-Id: 921f73ae6c314135a57c1561de5fd9d1 Aug 04 11:02:08.272240 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: X-User-Name: tempest-TestVolumeBootPattern-1089519314-project Aug 04 11:02:08.272240 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: method: > Aug 04 11:02:08.272240 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: exception: Instance 81551e3b-0b6c-4f69-bc1c-1e752b601ef5 could not be found. Aug 04 11:02:08.272240 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: action_args: {'id': '81551e3b-0b6c-4f69-bc1c-1e752b601ef5'} Aug 04 11:02:08.273394 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 11:02:08.273394 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 11:02:08.273394 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 11:02:08.273394 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 11:02:08.273394 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 11:02:08.273394 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 11:02:08.273394 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 11:02:08.273394 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 11:02:08.273394 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 11:02:08.273394 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 11:02:08.273394 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 81551e3b-0b6c-4f69-bc1c-1e752b601ef5 could not be found. Aug 04 11:02:08.273394 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Aug 04 11:02:08.273394 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 11:02:08.273394 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Aug 04 11:02:08.273394 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 11:02:08.273394 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 11:02:08.273394 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 11:02:08.273394 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 11:02:08.273394 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 11:02:08.273394 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 11:02:08.275129 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 11:02:08.275129 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 11:02:08.275129 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 11:02:08.275129 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 11:02:08.275129 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 11:02:08.275129 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 11:02:08.275129 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 11:02:08.275129 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 11:02:08.275129 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 11:02:08.275129 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 81551e3b-0b6c-4f69-bc1c-1e752b601ef5 could not be found. Aug 04 11:02:08.275129 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Aug 04 11:02:08.275129 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 11:02:08.275129 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Aug 04 11:02:08.275129 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 11:02:08.275129 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 11:02:08.275129 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 11:02:08.275129 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 11:02:08.275129 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 11:02:08.275129 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 81551e3b-0b6c-4f69-bc1c-1e752b601ef5 could not be found. Aug 04 11:02:08.275129 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: ERROR nova.api.openstack.wsgi Aug 04 11:02:08.277020 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-1e2e23ea-659f-40b7-afb9-66c31db8f706 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Returning 404 to user: Instance 81551e3b-0b6c-4f69-bc1c-1e752b601ef5 could not be found. {{(pid=124457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 11:02:08.277020 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-1e2e23ea-659f-40b7-afb9-66c31db8f706 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] 10.222.0.121 "DELETE /compute/v2.1/servers/81551e3b-0b6c-4f69-bc1c-1e752b601ef5" status: 404 len: 111 microversion: 2.1 time: 0.031227 Aug 04 11:02:08.277020 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 653/1305] 10.222.0.121 () {58 vars in 1244 bytes} [Thu Aug 4 11:02:08 2022] DELETE /compute/v2.1/servers/81551e3b-0b6c-4f69-bc1c-1e752b601ef5 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 11:02:08.281706 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-dd08ae24-b416-491b-8065-a25c53bf6ae8 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Calling method '>' {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 11:02:08.282337 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.compute.api [None req-dd08ae24-b416-491b-8065-a25c53bf6ae8 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] [instance: 81551e3b-0b6c-4f69-bc1c-1e752b601ef5] Fetching instance by UUID {{(pid=124456) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 11:02:08.289161 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-dd08ae24-b416-491b-8065-a25c53bf6ae8 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 11:02:08.289625 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-dd08ae24-b416-491b-8065-a25c53bf6ae8 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 11:02:08.290406 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-dd08ae24-b416-491b-8065-a25c53bf6ae8 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 11:02:08.290851 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG oslo_concurrency.lockutils [None req-dd08ae24-b416-491b-8065-a25c53bf6ae8 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Lock "e4c5daf7-b6c6-4192-b3cd-ab91ed13477f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 11:02:08.305412 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.wsgi [None req-dd08ae24-b416-491b-8065-a25c53bf6ae8 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] HTTP exception thrown: Instance 81551e3b-0b6c-4f69-bc1c-1e752b601ef5 could not be found. Aug 04 11:02:08.306974 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-dd08ae24-b416-491b-8065-a25c53bf6ae8 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Request method failure captured: Aug 04 11:02:08.306974 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: request: GET /compute/v2.1/servers/81551e3b-0b6c-4f69-bc1c-1e752b601ef5 HTTP/1.1 Aug 04 11:02:08.306974 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: Accept: application/json Aug 04 11:02:08.306974 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: Accept-Encoding: identity Aug 04 11:02:08.306974 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: Connection: close Aug 04 11:02:08.306974 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: Content-Length: 0 Aug 04 11:02:08.306974 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: Content-Type: application/json Aug 04 11:02:08.306974 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: Host: 10.222.0.121 Aug 04 11:02:08.306974 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: Openstack-System-Scope: None Aug 04 11:02:08.306974 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: User-Agent: python-urllib3/1.26.11 Aug 04 11:02:08.306974 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Auth-Token: gAAAAABi66VP91pDAZgpsTym-Qk06oM7Hft9GpRAElCyhXzMRv32O5_5w86QkS38v5jDso_DnLdASmtwIzsakg-AzTladSDP-DW7AWMHONObeEHsYe1tnx_a_r6joHvLUMd3vaMIxiUOO2AsoEubzFE1fM4k0768VI293PpO92iEGp44cBMi4gk Aug 04 11:02:08.306974 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Domain-Id: None Aug 04 11:02:08.306974 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Domain-Name: None Aug 04 11:02:08.306974 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Identity-Status: Confirmed Aug 04 11:02:08.306974 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Is-Admin-Project: True Aug 04 11:02:08.306974 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Project-Domain-Id: default Aug 04 11:02:08.306974 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Project-Domain-Name: Default Aug 04 11:02:08.306974 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Project-Id: 400197e1b8db4603a2a036b3ee157baa Aug 04 11:02:08.306974 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Project-Name: tempest-TestVolumeBootPattern-1089519314 Aug 04 11:02:08.306974 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Role: reader,member Aug 04 11:02:08.306974 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Roles: reader,member Aug 04 11:02:08.308875 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/400197e1b8db4603a2a036b3ee157baa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/400197e1b8db4603a2a036b3ee157baa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.121:8080", "publicURL": "http://10.222.0.121:8080/v1/AUTH_400197e1b8db4603a2a036b3ee157baa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2/400197e1b8db4603a2a036b3ee157baa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:9696/networking"}]}] Aug 04 11:02:08.308875 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Tenant: tempest-TestVolumeBootPattern-1089519314 Aug 04 11:02:08.308875 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Tenant-Id: 400197e1b8db4603a2a036b3ee157baa Aug 04 11:02:08.308875 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-Tenant-Name: tempest-TestVolumeBootPattern-1089519314 Aug 04 11:02:08.308875 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-User: tempest-TestVolumeBootPattern-1089519314-project Aug 04 11:02:08.308875 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-User-Domain-Id: default Aug 04 11:02:08.308875 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-User-Domain-Name: Default Aug 04 11:02:08.308875 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-User-Id: 921f73ae6c314135a57c1561de5fd9d1 Aug 04 11:02:08.308875 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: X-User-Name: tempest-TestVolumeBootPattern-1089519314-project Aug 04 11:02:08.308875 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: method: > Aug 04 11:02:08.308875 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: exception: Instance 81551e3b-0b6c-4f69-bc1c-1e752b601ef5 could not be found. Aug 04 11:02:08.308875 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: action_args: {'id': '81551e3b-0b6c-4f69-bc1c-1e752b601ef5'} Aug 04 11:02:08.313494 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: {{(pid=124456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 11:02:08.313494 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 11:02:08.313494 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 11:02:08.313494 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 11:02:08.313494 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 11:02:08.313494 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 11:02:08.313494 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 11:02:08.313494 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 11:02:08.313494 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 11:02:08.313494 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 11:02:08.313494 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 81551e3b-0b6c-4f69-bc1c-1e752b601ef5 could not be found. Aug 04 11:02:08.313494 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi Aug 04 11:02:08.313494 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 11:02:08.313494 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi Aug 04 11:02:08.313494 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 11:02:08.313494 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 11:02:08.313494 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 11:02:08.313494 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 11:02:08.313494 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 11:02:08.313494 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 11:02:08.315247 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 11:02:08.315247 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 11:02:08.315247 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 11:02:08.315247 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 11:02:08.315247 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 11:02:08.315247 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 11:02:08.315247 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 11:02:08.315247 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 81551e3b-0b6c-4f69-bc1c-1e752b601ef5 could not be found. Aug 04 11:02:08.315247 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi Aug 04 11:02:08.315247 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 11:02:08.315247 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi Aug 04 11:02:08.315247 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 11:02:08.315247 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 11:02:08.315247 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 11:02:08.315247 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 11:02:08.315247 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 11:02:08.315247 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 81551e3b-0b6c-4f69-bc1c-1e752b601ef5 could not be found. Aug 04 11:02:08.315247 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: ERROR nova.api.openstack.wsgi Aug 04 11:02:08.316832 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: DEBUG nova.api.openstack.wsgi [None req-dd08ae24-b416-491b-8065-a25c53bf6ae8 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Returning 404 to user: Instance 81551e3b-0b6c-4f69-bc1c-1e752b601ef5 could not be found. {{(pid=124456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 11:02:08.316832 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO nova.api.openstack.requestlog [None req-dd08ae24-b416-491b-8065-a25c53bf6ae8 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] 10.222.0.121 "GET /compute/v2.1/servers/81551e3b-0b6c-4f69-bc1c-1e752b601ef5" status: 404 len: 111 microversion: 2.1 time: 0.030882 Aug 04 11:02:08.316832 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: [pid: 124456|app: 0|req: 653/1306] 10.222.0.121 () {58 vars in 1241 bytes} [Thu Aug 4 11:02:08 2022] GET /compute/v2.1/servers/81551e3b-0b6c-4f69-bc1c-1e752b601ef5 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 11:02:09.646036 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: DEBUG nova.api.openstack.wsgi [None req-ea324875-bf00-4188-aeaf-ffdbbafaad11 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] Calling method '.version_select at 0x7f6759777ca0>' {{(pid=124457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 11:02:09.672657 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO nova.api.openstack.requestlog [None req-ea324875-bf00-4188-aeaf-ffdbbafaad11 tempest-TestVolumeBootPattern-1089519314 tempest-TestVolumeBootPattern-1089519314-project] 10.222.0.121 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1596207310" status: 202 len: 0 microversion: 2.1 time: 0.030607 Aug 04 11:02:09.673315 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: [pid: 124457|app: 0|req: 654/1307] 10.222.0.121 () {58 vars in 1268 bytes} [Thu Aug 4 11:02:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1596207310 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 04 11:02:49.894677 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 11:02:49.896245 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: Thu Aug 4 11:02:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 11:03:04.720239 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 11:03:04.722062 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: Thu Aug 4 11:03:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 11:04:31.299001 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 11:04:31.299848 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: Thu Aug 4 11:04:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 11:04:45.308393 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 11:04:45.308393 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: Thu Aug 4 11:04:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 11:05:09.704820 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 11:05:09.705697 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: Thu Aug 4 11:05:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 11:05:10.725261 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 11:05:10.725968 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: Thu Aug 4 11:05:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 11:06:09.904831 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 11:06:09.904831 dv-cinder-852003-1-iscsi devstack@n-api.service[124456]: Thu Aug 4 11:06:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 11:06:24.739746 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 11:06:24.740619 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: Thu Aug 4 11:06:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 11:07:51.308755 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 11:07:51.311445 dv-cinder-852003-1-iscsi devstack@n-api.service[124457]: Thu Aug 4 11:07:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!